Jul 20 12:42:36.404747 ip-10-0-141-54 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 20 12:42:36.404758 ip-10-0-141-54 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 20 12:42:36.404767 ip-10-0-141-54 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 20 12:42:36.405096 ip-10-0-141-54 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 20 12:42:47.298542 ip-10-0-141-54 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 20 12:42:47.298569 ip-10-0-141-54 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 80ce5f57e9aa4f04b157c3a12711b8e7 --
Jul 20 12:44:14.726878 ip-10-0-141-54 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 12:44:15.345792 ip-10-0-141-54 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 12:44:15.345792 ip-10-0-141-54 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 12:44:15.345792 ip-10-0-141-54 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 12:44:15.345792 ip-10-0-141-54 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 12:44:15.345792 ip-10-0-141-54 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 12:44:15.345792 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.200255    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 12:44:15.345792 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205023    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 12:44:15.345792 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205033    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 12:44:15.345792 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205037    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 12:44:15.345792 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205040    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 12:44:15.345792 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205043    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 12:44:15.345792 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205046    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 12:44:15.345792 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205050    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 12:44:15.345792 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205053    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 12:44:15.280640 ip-10-0-141-54 systemd[1]: Started Kubernetes Kubelet.
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205056    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205059    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205061    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205064    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205066    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205069    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205071    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205074    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205076    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205079    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205082    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205084    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205087    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205090    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205094    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205097    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205109    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205112    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205115    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 12:44:15.492317 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205119    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205121    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205124    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205126    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205129    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205132    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205134    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205137    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205154    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205158    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205162    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205168    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205171    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205174    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205176    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205180    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205182    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205185    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205188    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205190    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 12:44:15.493139 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205193    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205196    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205199    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205201    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205203    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205208    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205211    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205214    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205217    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205221    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205224    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205226    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205229    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205232    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205234    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205237    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205239    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205242    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205245    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 12:44:15.493943 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205249    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205253    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205255    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205258    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205261    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205264    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205267    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205270    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205272    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205275    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205277    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205280    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205283    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205286    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205290    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205292    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205295    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205298    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205300    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 12:44:15.494536 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205303    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205306    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205309    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205312    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205314    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205317    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205320    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205322    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205325    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205327    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205329    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205332    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205335    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.205337    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206068    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206075    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206079    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206085    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206088    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206092    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 12:44:15.495316 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206095    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206098    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206101    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206103    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206107    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206109    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206112    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206114    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206117    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206120    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206123    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206127    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206130    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206132    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206135    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206137    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206140    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206142    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206145    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206147    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 12:44:15.495908 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206149    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206152    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206154    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206157    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206160    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206162    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206165    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206167    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206170    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206174    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206176    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206181    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206188    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206191    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206194    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206197    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206199    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206202    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206204    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 12:44:15.496556 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206207    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206210    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206212    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206215    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206219    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206221    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206224    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206226    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206229    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206231    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206233    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206236    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206238    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206241    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206244    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206246    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206249    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206251    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206254    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206256    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 12:44:15.497157 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206258    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206261    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206265    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206267    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206270    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206272    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206278    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206280    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206283    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206285    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206290    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206293    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206296    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206299    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206301    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206304    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206308    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206311    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206313    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 12:44:15.497798 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206316    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206320    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206322    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206325    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206328    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206331    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206333    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206336    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206339    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206342    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206347    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206350    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206353    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206356    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206358    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206760    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206765    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206768    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206771    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206775    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 12:44:15.498441 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206778    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206780    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206783    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206786    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206788    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206791    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206794    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206796    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206799    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206803    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206806    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206809    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206811    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206814    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206817    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206819    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206822    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206824    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206826    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206829    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 12:44:15.499249 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206831    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206834    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206836    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206839    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206842    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206846    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206850    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206854    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206857    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206860    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206862    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206865    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206868    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206871    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206873    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206876    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206878    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206881    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206884    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 12:44:15.499842 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206887    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206890    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206894    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206896    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206899    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206901    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206904    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206906    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206909    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206911    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206914    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206916    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206919    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206922    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206924    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206927    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206929    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206933    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206936    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206939    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 12:44:15.500450 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206942    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206945    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206947    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206950    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206952    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206955    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206957    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206960    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206962    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206965    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206967    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206970    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206972    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206975    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206978    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206981    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206983    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206987    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206990    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 12:44:15.501029 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206993    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206996    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.206998    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207001    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207003    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207006    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207008    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207010    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207013    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207016    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207018    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207021    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207023    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207027    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207029    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207032    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207107    2557 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207116    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207131    2557 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207138    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207145    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 12:44:15.501557 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207150    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207155    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207159    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207162    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207165    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207168    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207173    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207176    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207179    2557 flags.go:64] FLAG: --cgroup-root=""
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207182    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207185    2557 flags.go:64] FLAG: --client-ca-file=""
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207188    2557 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207190    2557 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207195    2557 flags.go:64] FLAG: --cluster-domain=""
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207198    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207201    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207204    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207207    2557 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207211    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207213    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207216    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207219    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207222    2557 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207225    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 12:44:15.502368 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207229    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207232    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207235    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207239    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207242    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207245    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207247    2557 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207250    2557 flags.go:64] FLAG: --enable-server="true"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207259    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207264    2557 flags.go:64] FLAG: --event-burst="100"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207267    2557 flags.go:64] FLAG: --event-qps="50"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207270    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207273    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207276    2557 flags.go:64] FLAG: --eviction-hard=""
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207285    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207288    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207291    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207294    2557 flags.go:64] FLAG: --eviction-soft=""
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207296    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207299    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207303    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207305    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207308    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207311    2557 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207314    2557 flags.go:64] FLAG: --feature-gates=""
Jul 20 12:44:15.503029 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207317    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207320    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207323    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207326    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207329    2557 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207332    2557 flags.go:64] FLAG: --help="false"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207335    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-141-54.ec2.internal"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207340    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207343    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207346    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207349    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207352    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207356    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207358    2557 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207361    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207364    2557 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207367    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207370    2557 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207373    2557 flags.go:64] FLAG: --kube-reserved=""
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207376    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207378    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207383    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207385    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207388    2557 flags.go:64] FLAG: --lock-file=""
Jul 20 12:44:15.503825 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207391    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207393    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207396    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207401    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207404    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207407    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207410    2557 flags.go:64] FLAG: --logging-format="text"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207412    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207416    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207418    2557 flags.go:64] FLAG: --manifest-url=""
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207421    2557 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207425    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207428    2557 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207432    2557 flags.go:64] FLAG: --max-pods="110"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207434    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207439    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207441    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207444    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207447    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207450    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207453    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207459    2557 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207462    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207465    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 12:44:15.504635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207468    2557 flags.go:64] FLAG: --pod-cidr=""
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207471    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207476    2557 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207479    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207482    2557 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207485    2557 flags.go:64] FLAG: --port="10250"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207489    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207492    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e2fc056823da5124"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207495    2557 flags.go:64] FLAG: --qos-reserved=""
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207498    2557 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207501    2557 flags.go:64] FLAG: --register-node="true"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207504    2557 flags.go:64] FLAG: --register-with-taints=""
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207507    2557 flags.go:64] FLAG: --registry-burst="10"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207510    2557 flags.go:64] FLAG: --registry-qps="5"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207513    2557 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207515    2557 flags.go:64] FLAG: --reserved-memory=""
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207519    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207522    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207525    2557 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207528    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207531    2557 flags.go:64] FLAG: --runonce="false"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207533    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207536    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207540    2557 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207543    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 12:44:15.507921 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207546    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207549    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207552    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207555    2557 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207558    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207561    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207563    2557 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207567    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207570    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207573    2557 flags.go:64] FLAG: --system-cgroups=""
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207576    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207581    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207584    2557 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207588    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207593    2557 flags.go:64] FLAG: --tls-min-version=""
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207596    2557 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207598    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207601    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207604    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207607    2557 flags.go:64] FLAG: --v="2"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207611    2557 flags.go:64] FLAG: --version="false"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207615    2557 flags.go:64] FLAG: --vmodule=""
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207633    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.207636    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207746    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 12:44:15.509784 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207750    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207753    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207756    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207759    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207763    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207767    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207770    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207773    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207775    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207778    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207781    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207783    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207786    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207789    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207791    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207794    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207796    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207800    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207802    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207805    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 12:44:15.769267 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207809    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207811    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207814    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207817    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207819    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207822    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207824    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207827    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207829    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207832    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207835    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207837    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207840    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207843    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207845    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207848    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207850    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207856    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207860    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 12:44:15.770220 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207863    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207865    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207868    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207870    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207873    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207875    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207878    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207880    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207882    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207885    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207888    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207892    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207896    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207900    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207903    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207907    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207910    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207913    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207916    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 12:44:15.770748 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207918    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207921    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207923    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207926    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207928    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207931    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207933    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207936    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207938    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207941    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207943    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207947    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207950    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207953    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207955    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207958    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207960    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207963    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207965    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 12:44:15.771268 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207968    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207970    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207973    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207976    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207978    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207980    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207983    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207987    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207990    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207992    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207995    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.207997    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.208000    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.208002    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.208005    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.208007    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.208009    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.208012    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.208014    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.208017    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 12:44:15.771790 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.208020    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.208776    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.216668    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.216685    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.216705    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.216714    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216780    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216784    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216788    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216791    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216794    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216796    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216799    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216801    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216804    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 12:44:15.772353 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216807    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216809    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216812    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216814    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216817    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216819    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216822    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216824    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216827    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216829    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216833    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216835    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216838    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216842    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216846    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216849    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216852    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216855    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216858    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 12:44:15.772781 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216861    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216871    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216874    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216877    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216879    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216882    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216884    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216887    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216890    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216893    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216895    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216898    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216901    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216903    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216906    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216908    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216911    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216914    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216916    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216921    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 12:44:15.773304 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216924    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216926    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216931    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216933    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216936    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216938    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216941    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216944    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216946    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216949    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216951    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216955    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216959    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216962    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216970    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216974    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216977    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216980    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216983    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216985    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 12:44:15.773857 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216988    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216990    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216993    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216995    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.216998    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217000    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217003    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217005    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217008    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217010    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217013    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217016    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217019    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217022    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217026    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217028    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217031    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217033    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217036    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 12:44:15.774404 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217038    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 12:44:15.774909 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217042    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 12:44:15.774909 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217046    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 12:44:15.774909 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217048    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 12:44:15.774909 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217051    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 12:44:15.774909 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217061    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 12:44:15.774909 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217063    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 12:44:15.774909 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217066    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 12:44:15.774909 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217074    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 12:44:15.774909 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217077    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 12:44:15.774909 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217079    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 12:44:15.774909 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217082    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 12:44:15.774909 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.217087    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 12:44:15.774909 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217232    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 12:44:15.774909 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217238    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217240    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217243    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217246    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217249    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217251    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217254    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217256    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217258    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217261    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217265    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217268    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217271    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217273    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217277    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217280    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217283    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217285    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217288    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 12:44:15.775309 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217290    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217294    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217298    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217302    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217305    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217307    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217310    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217313    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217321    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217325    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217328    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217330    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217332    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217335    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217337    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217340    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217342    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217345    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217347    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217350    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 12:44:15.775802 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217352    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217355    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217357    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217363    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217365    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217368    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217370    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217389    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217393    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217396    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217399    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217402    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217405    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217407    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217410    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217413    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217415    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217418    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217420    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217423    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 12:44:15.776352 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217426    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217434    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217437    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217440    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217443    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217445    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217448    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217450    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217452    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217455    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217458    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217460    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217462    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217465    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217467    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217471    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217474    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217476    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217479    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217483    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 12:44:15.776905 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217486    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217488    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217492    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217495    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217498    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217501    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217504    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217506    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217509    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217512    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217515    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217517    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217520    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217522    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217530    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217533    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217535    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217538    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 12:44:15.777488 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:15.217540    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 12:44:15.778017 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.217545    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 12:44:15.778017 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.217687    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 12:44:15.778017 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.221173    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 12:44:15.778017 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.222995    2557 server.go:1019] "Starting client certificate rotation"
Jul 20 12:44:15.778017 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.223103    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 12:44:15.778017 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.223138    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 12:44:15.778017 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.227974    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 12:44:15.778017 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.230879    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 12:44:15.778017 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.242911    2557 log.go:25] "Validated CRI v1 runtime API"
Jul 20 12:44:15.778017 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.246445    2557 log.go:25] "Validated CRI v1 image API"
Jul 20 12:44:15.778017 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.248006    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 12:44:15.778017 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.250555    2557 fs.go:135] Filesystem UUIDs: map[17d46c26-9b98-4dec-8982-b2c38abf0178:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c44d9930-16d6-42d3-b467-7853a6a14a16:/dev/nvme0n1p4]
Jul 20 12:44:15.778374 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.250576    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 12:44:15.778374 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.253974    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.256042    2557 manager.go:216] Machine: {Timestamp:2026-07-20 12:44:15.254497506 +0000 UTC m=+0.387480597 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103719 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25b8b6f02b0c4bc3e3d2cae0a5a85d SystemUUID:ec25b8b6-f02b-0c4b-c3e3-d2cae0a5a85d BootID:80ce5f57-e9aa-4f04-b157-c3a12711b8e7 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2e:c5:73:0c:db Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2e:c5:73:0c:db Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:e7:b9:f8:86:49 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.256149    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.256275    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.261490    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.261525    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-54.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.262481    2557 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.262494    2557 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.262502    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.262516    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.264493    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.268374    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.268504    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.268534    2557 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.268543    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.268570    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.268582    2557 kubelet.go:398] "Adding apiserver pod source"
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.268591    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 12:44:15.778534 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.268958    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.268973    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.271289    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.273985    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.274013    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.275384    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.275398    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.275404    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.275410    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.275419    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.275427    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.275438    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.275443    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.275451    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.275456    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.275465    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.275470    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.276309    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.276319    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.279784    2557 server.go:1268] "Started kubelet"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.279858    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.279939    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.279864    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.284285    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.284399    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-54.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.284489    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.284515    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.285739    2557 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.288216    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.290843    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-54.ec2.internal.18c40017f75b3447  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-54.ec2.internal,UID:ip-10-0-141-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-54.ec2.internal,},FirstTimestamp:2026-07-20 12:44:15.279756359 +0000 UTC m=+0.412739450,LastTimestamp:2026-07-20 12:44:15.279756359 +0000 UTC m=+0.412739450,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-54.ec2.internal,}"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.296300    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mrgx2"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.299052    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.299061    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.299146    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-54.ec2.internal\" not found"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.299823    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.299829    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.299851    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.299967    2557 factory.go:55] Registering systemd factory
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.299981    2557 factory.go:223] Registration of the systemd container factory successfully
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.299984    2557 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.300004    2557 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 12:44:15.779367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.300184    2557 factory.go:153] Registering CRI-O factory
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.300196    2557 factory.go:223] Registration of the crio container factory successfully
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.300246    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.300268    2557 factory.go:103] Registering Raw factory
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.300283    2557 manager.go:1196] Started watching for new ooms in manager
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.300426    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.300495    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.300693    2557 manager.go:349] Starting recovery of all containers
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.301733    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mrgx2"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.310143    2557 manager.go:354] Recovery completed
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.310363    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.314882    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.317735    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.317774    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.317792    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasSufficientPID"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.318248    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.318258    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.318276    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.318676    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.319294    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.319317    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.319330    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasSufficientPID"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.319706    2557 policy_none.go:49] "None policy: Start"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.319719    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.319734    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.320610    2557 policy_none.go:47] "Start"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.370261    2557 manager.go:337] "Starting Device Plugin manager"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.370292    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.370302    2557 server.go:87] "Starting device plugin registration server"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.370610    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.370640    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.370824    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.370928    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.370938    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.371458    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.371509    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-54.ec2.internal\" not found"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.373832    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.373864    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.373883    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.373912    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.376076    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.471723    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.472701    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.472731    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.472742    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasSufficientPID"
Jul 20 12:44:16.031974 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.472769    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.474855    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-54.ec2.internal"]
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.474932    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.475671    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.475692    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.475701    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasSufficientPID"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.476917    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.477021    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.477045    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.477634    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.477653    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.477668    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasSufficientPID"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.478355    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.478379    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.478388    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasSufficientPID"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.478738    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.478766    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.479365    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.479383    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.479396    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeHasSufficientPID"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.482022    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.482045    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-54.ec2.internal\": node \"ip-10-0-141-54.ec2.internal\" not found"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.501460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73f6bdbf997a544246c875c3b1e88545-config\") pod \"kube-apiserver-proxy-ip-10-0-141-54.ec2.internal\" (UID: \"73f6bdbf997a544246c875c3b1e88545\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.501479    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0a498e25e8920f5d6324995f0e2bde44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal\" (UID: \"0a498e25e8920f5d6324995f0e2bde44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.501496    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a498e25e8920f5d6324995f0e2bde44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal\" (UID: \"0a498e25e8920f5d6324995f0e2bde44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.503356    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-54.ec2.internal\" not found"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.513536    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-54.ec2.internal\" not found" node="ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.525090    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-54.ec2.internal\" not found" node="ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.602338    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73f6bdbf997a544246c875c3b1e88545-config\") pod \"kube-apiserver-proxy-ip-10-0-141-54.ec2.internal\" (UID: \"73f6bdbf997a544246c875c3b1e88545\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.034746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.602360    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0a498e25e8920f5d6324995f0e2bde44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal\" (UID: \"0a498e25e8920f5d6324995f0e2bde44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.035559 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.602376    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a498e25e8920f5d6324995f0e2bde44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal\" (UID: \"0a498e25e8920f5d6324995f0e2bde44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.035559 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.602415    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a498e25e8920f5d6324995f0e2bde44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal\" (UID: \"0a498e25e8920f5d6324995f0e2bde44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.035559 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.602433    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73f6bdbf997a544246c875c3b1e88545-config\") pod \"kube-apiserver-proxy-ip-10-0-141-54.ec2.internal\" (UID: \"73f6bdbf997a544246c875c3b1e88545\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.035559 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.602443    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0a498e25e8920f5d6324995f0e2bde44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal\" (UID: \"0a498e25e8920f5d6324995f0e2bde44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.035559 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.604443    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-54.ec2.internal\" not found"
Jul 20 12:44:16.035559 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.704980    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-54.ec2.internal\" not found"
Jul 20 12:44:16.035559 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.805954    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-54.ec2.internal\" not found"
Jul 20 12:44:16.035559 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.818093    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.035559 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:15.829128    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.035559 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:15.906433    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-54.ec2.internal\" not found"
Jul 20 12:44:16.035559 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:16.006931    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-54.ec2.internal\" not found"
Jul 20 12:44:16.303908 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:16.107400    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-54.ec2.internal\" not found"
Jul 20 12:44:16.303908 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:16.207922    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-54.ec2.internal\" not found"
Jul 20 12:44:16.303908 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:16.222067    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 12:44:16.303908 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:16.222191    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 12:44:16.558263 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:16.308657    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-54.ec2.internal\" not found"
Jul 20 12:44:16.558263 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:16.310790    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 12:39:14 +0000 UTC" deadline="2028-04-27 06:33:44.661181694 +0000 UTC"
Jul 20 12:44:16.558263 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:16.310809    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15521h49m28.350375524s"
Jul 20 12:44:16.558263 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:16.409119    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-54.ec2.internal\" not found"
Jul 20 12:44:16.558263 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:16.492109    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 12:44:16.558263 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:16.509968    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-54.ec2.internal\" not found"
Jul 20 12:44:16.558263 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:16.515095    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a498e25e8920f5d6324995f0e2bde44.slice/crio-583f82c736e6c04105e56b4df1019221d2da0158590adeadc10b5e6fc2d6eacf WatchSource:0}: Error finding container 583f82c736e6c04105e56b4df1019221d2da0158590adeadc10b5e6fc2d6eacf: Status 404 returned error can't find the container with id 583f82c736e6c04105e56b4df1019221d2da0158590adeadc10b5e6fc2d6eacf
Jul 20 12:44:16.558263 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:16.515354    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f6bdbf997a544246c875c3b1e88545.slice/crio-7842543d97bc6d4a06f9a4452dd8db2c2d170011ae942160b577c8e4fd0e7824 WatchSource:0}: Error finding container 7842543d97bc6d4a06f9a4452dd8db2c2d170011ae942160b577c8e4fd0e7824: Status 404 returned error can't find the container with id 7842543d97bc6d4a06f9a4452dd8db2c2d170011ae942160b577c8e4fd0e7824
Jul 20 12:44:16.558263 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:16.519038    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 12:44:16.828851 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:16.607228    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 12:44:16.828851 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:16.699765    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.828851 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:16.713304    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 12:44:16.828851 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:16.715876    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-54.ec2.internal"
Jul 20 12:44:16.828851 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:16.717141    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 12:44:16.828851 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:16.725135    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.270192    2557 apiserver.go:52] "Watching apiserver"
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.278091    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.278861    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-v75j2","openshift-multus/network-metrics-daemon-j62gp","openshift-network-diagnostics/network-check-target-zhxk9","kube-system/global-pull-secret-syncer-h4x68","kube-system/konnectivity-agent-d9nvp","kube-system/kube-apiserver-proxy-ip-10-0-141-54.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89","openshift-cluster-node-tuning-operator/tuned-ksd2f","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal","openshift-network-operator/iptables-alerter-v9xnn","openshift-ovn-kubernetes/ovnkube-node-chtb7","openshift-dns/node-resolver-zfnzx","openshift-image-registry/node-ca-n85wg","openshift-multus/multus-additional-cni-plugins-j5sb7"]
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.280221    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.281983    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n85wg"
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.283276    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:17.283333    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.283478    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.283582    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.283604    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.283700    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.283748    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-779f5\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.283833    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.283874    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.283984    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-96p8h\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.284556    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:17.284629    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.286274    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d9nvp"
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.287369    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.288115    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.288154    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.288331    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lr8x6\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.288833    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.289224    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.289276    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-llctl\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.289652    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.289703    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.290993    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.291325    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.291375    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8w2p7\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.291504    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 12:44:17.298889 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.291516    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.291817    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.292033    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:17.292080    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.293212    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v9xnn"
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.294739    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.296781    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zfnzx"
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.297250    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.297579    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.297679    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.298310    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.298447    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.298900    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.299085    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v6q6m\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.299277    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.299415    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pt7q6\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.299555    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.299755    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.299798    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.299948    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.300111    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.300215    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.298642    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4pdpw\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.300408    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vtxbv\""
Jul 20 12:44:17.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.300837    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.313931    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-host\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.313962    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e69362ab-634e-4cb4-bb34-816a21ff3586-iptables-alerter-script\") pod \"iptables-alerter-v9xnn\" (UID: \"e69362ab-634e-4cb4-bb34-816a21ff3586\") " pod="openshift-network-operator/iptables-alerter-v9xnn"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.313987    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xv9j\" (UniqueName: \"kubernetes.io/projected/e69362ab-634e-4cb4-bb34-816a21ff3586-kube-api-access-6xv9j\") pod \"iptables-alerter-v9xnn\" (UID: \"e69362ab-634e-4cb4-bb34-816a21ff3586\") " pod="openshift-network-operator/iptables-alerter-v9xnn"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314009    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7-serviceca\") pod \"node-ca-n85wg\" (UID: \"f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7\") " pod="openshift-image-registry/node-ca-n85wg"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314031    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m7zd\" (UniqueName: \"kubernetes.io/projected/68e46b46-20dc-475b-b1d0-fa7197557966-kube-api-access-6m7zd\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314051    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-lib-modules\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314072    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-run-openvswitch\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314092    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-run-ovn-kubernetes\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314114    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-multus-cni-dir\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314135    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-run-multus-certs\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314154    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-systemd\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314175    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4435b501-e398-4e47-ac8e-21b1f87f0723-ovn-node-metrics-cert\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314195    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp8df\" (UniqueName: \"kubernetes.io/projected/aa98a74e-b651-463c-b67c-d1cb18bad0f3-kube-api-access-vp8df\") pod \"node-resolver-zfnzx\" (UID: \"aa98a74e-b651-463c-b67c-d1cb18bad0f3\") " pod="openshift-dns/node-resolver-zfnzx"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314215    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-registration-dir\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314237    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-multus-socket-dir-parent\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.383915 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314257    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-var-lib-cni-bin\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314278    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-systemd-units\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314299    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-run-systemd\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314319    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-sysctl-conf\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-run\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314384    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-system-cni-dir\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314406    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-run-k8s-cni-cncf-io\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314427    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-var-lib-cni-multus\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314448    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-var-lib-kubelet\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314469    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-os-release\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314491    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-run-netns\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314519    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-var-lib-kubelet\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314548    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhw5m\" (UniqueName: \"kubernetes.io/projected/f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7-kube-api-access-rhw5m\") pod \"node-ca-n85wg\" (UID: \"f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7\") " pod="openshift-image-registry/node-ca-n85wg"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314570    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9-konnectivity-ca\") pod \"konnectivity-agent-d9nvp\" (UID: \"aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9\") " pod="kube-system/konnectivity-agent-d9nvp"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314591    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314636    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.384666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314661    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-kubernetes\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314709    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4435b501-e398-4e47-ac8e-21b1f87f0723-env-overrides\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314391    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314789    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-cni-binary-copy\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314892    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-tuned\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314921    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-node-log\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.314972    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4435b501-e398-4e47-ac8e-21b1f87f0723-ovnkube-config\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315006    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4435b501-e398-4e47-ac8e-21b1f87f0723-ovnkube-script-lib\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315039    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65qxp\" (UniqueName: \"kubernetes.io/projected/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-kube-api-access-65qxp\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315066    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-multus-daemon-config\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315089    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa98a74e-b651-463c-b67c-d1cb18bad0f3-tmp-dir\") pod \"node-resolver-zfnzx\" (UID: \"aa98a74e-b651-463c-b67c-d1cb18bad0f3\") " pod="openshift-dns/node-resolver-zfnzx"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315111    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315140    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-cnibin\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315172    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e36416eb-a5b9-4591-b291-6bc7a04efb04-tmp\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315205    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86cgv\" (UniqueName: \"kubernetes.io/projected/e36416eb-a5b9-4591-b291-6bc7a04efb04-kube-api-access-86cgv\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e69362ab-634e-4cb4-bb34-816a21ff3586-host-slash\") pod \"iptables-alerter-v9xnn\" (UID: \"e69362ab-634e-4cb4-bb34-816a21ff3586\") " pod="openshift-network-operator/iptables-alerter-v9xnn"
Jul 20 12:44:17.386169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315280    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7-host\") pod \"node-ca-n85wg\" (UID: \"f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7\") " pod="openshift-image-registry/node-ca-n85wg"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315339    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa98a74e-b651-463c-b67c-d1cb18bad0f3-hosts-file\") pod \"node-resolver-zfnzx\" (UID: \"aa98a74e-b651-463c-b67c-d1cb18bad0f3\") " pod="openshift-dns/node-resolver-zfnzx"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315364    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-socket-dir\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315399    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-modprobe-d\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315424    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76r9b\" (UniqueName: \"kubernetes.io/projected/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-kube-api-access-76r9b\") pod \"network-metrics-daemon-j62gp\" (UID: \"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd\") " pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315588    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-etc-openvswitch\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315637    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-cni-bin\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315657    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-etc-selinux\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315678    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-os-release\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315701    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315722    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs\") pod \"network-metrics-daemon-j62gp\" (UID: \"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd\") " pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315741    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thq4p\" (UniqueName: \"kubernetes.io/projected/4435b501-e398-4e47-ac8e-21b1f87f0723-kube-api-access-thq4p\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315760    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-sysctl-d\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315790    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-dbus\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315824    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-cnibin\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.386824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315845    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-system-cni-dir\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315873    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315893    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-sysconfig\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315912    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-sys\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315933    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-kubelet-config\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315959    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-multus-conf-dir\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.315984    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9-agent-certs\") pod \"konnectivity-agent-d9nvp\" (UID: \"aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9\") " pod="kube-system/konnectivity-agent-d9nvp"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.316010    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldfgz\" (UniqueName: \"kubernetes.io/projected/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-kube-api-access-ldfgz\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.316031    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-kubelet\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.316056    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-slash\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.316085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-run-ovn\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.316122    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nplsg\" (UniqueName: \"kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg\") pod \"network-check-target-zhxk9\" (UID: \"16ada65b-ff10-46fe-8477-f9fc9f101d29\") " pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.316144    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-device-dir\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.316165    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-sys-fs\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.316195    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-run-netns\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.316223    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-var-lib-openvswitch\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.387992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.316248    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-log-socket\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.388823 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.316267    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-cni-netd\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.388823 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.316288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-hostroot\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.388823 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.316318    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-etc-kubernetes\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.388823 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.332238    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cmcx9"
Jul 20 12:44:17.388823 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.347166    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cmcx9"
Jul 20 12:44:17.388823 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.387190    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 12:44:17.391329 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.390505    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-54.ec2.internal" event={"ID":"73f6bdbf997a544246c875c3b1e88545","Type":"ContainerStarted","Data":"7842543d97bc6d4a06f9a4452dd8db2c2d170011ae942160b577c8e4fd0e7824"}
Jul 20 12:44:17.391329 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.390570    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal" event={"ID":"0a498e25e8920f5d6324995f0e2bde44","Type":"ContainerStarted","Data":"583f82c736e6c04105e56b4df1019221d2da0158590adeadc10b5e6fc2d6eacf"}
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416628    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4435b501-e398-4e47-ac8e-21b1f87f0723-ovn-node-metrics-cert\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416671    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp8df\" (UniqueName: \"kubernetes.io/projected/aa98a74e-b651-463c-b67c-d1cb18bad0f3-kube-api-access-vp8df\") pod \"node-resolver-zfnzx\" (UID: \"aa98a74e-b651-463c-b67c-d1cb18bad0f3\") " pod="openshift-dns/node-resolver-zfnzx"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416696    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-registration-dir\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416718    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-multus-socket-dir-parent\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416742    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-var-lib-cni-bin\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416765    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-systemd-units\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416788    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-run-systemd\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416812    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-sysctl-conf\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416819    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-var-lib-cni-bin\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416832    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-run\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416855    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-system-cni-dir\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416877    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-run-k8s-cni-cncf-io\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416899    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-var-lib-cni-multus\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416919    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-multus-socket-dir-parent\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416921    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-var-lib-kubelet\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416940    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416984    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-run\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.461027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416998    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-sysctl-conf\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417026    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-run-systemd\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417029    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-system-cni-dir\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416788    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-registration-dir\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417048    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-systemd-units\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417059    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-os-release\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.416960    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-os-release\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417083    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-var-lib-kubelet\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417095    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-var-lib-cni-multus\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417081    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-run-k8s-cni-cncf-io\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417130    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-run-netns\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417161    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-var-lib-kubelet\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417186    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhw5m\" (UniqueName: \"kubernetes.io/projected/f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7-kube-api-access-rhw5m\") pod \"node-ca-n85wg\" (UID: \"f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7\") " pod="openshift-image-registry/node-ca-n85wg"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417210    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9-konnectivity-ca\") pod \"konnectivity-agent-d9nvp\" (UID: \"aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9\") " pod="kube-system/konnectivity-agent-d9nvp"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-var-lib-kubelet\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417234    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417271    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.462314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417297    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-kubernetes\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417320    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417344    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4435b501-e398-4e47-ac8e-21b1f87f0723-env-overrides\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417366    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-cni-binary-copy\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-tuned\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417409    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-node-log\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417421    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-kubernetes\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417211    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-run-netns\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417425    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417446    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4435b501-e398-4e47-ac8e-21b1f87f0723-ovnkube-config\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417468    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4435b501-e398-4e47-ac8e-21b1f87f0723-ovnkube-script-lib\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417488    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65qxp\" (UniqueName: \"kubernetes.io/projected/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-kube-api-access-65qxp\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417530    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-multus-daemon-config\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417570    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa98a74e-b651-463c-b67c-d1cb18bad0f3-tmp-dir\") pod \"node-resolver-zfnzx\" (UID: \"aa98a74e-b651-463c-b67c-d1cb18bad0f3\") " pod="openshift-dns/node-resolver-zfnzx"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417600    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417641    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-cnibin\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417660    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e36416eb-a5b9-4591-b291-6bc7a04efb04-tmp\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.463261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417683    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86cgv\" (UniqueName: \"kubernetes.io/projected/e36416eb-a5b9-4591-b291-6bc7a04efb04-kube-api-access-86cgv\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417719    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e69362ab-634e-4cb4-bb34-816a21ff3586-host-slash\") pod \"iptables-alerter-v9xnn\" (UID: \"e69362ab-634e-4cb4-bb34-816a21ff3586\") " pod="openshift-network-operator/iptables-alerter-v9xnn"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417742    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7-host\") pod \"node-ca-n85wg\" (UID: \"f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7\") " pod="openshift-image-registry/node-ca-n85wg"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417765    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417779    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9-konnectivity-ca\") pod \"konnectivity-agent-d9nvp\" (UID: \"aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9\") " pod="kube-system/konnectivity-agent-d9nvp"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417789    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa98a74e-b651-463c-b67c-d1cb18bad0f3-hosts-file\") pod \"node-resolver-zfnzx\" (UID: \"aa98a74e-b651-463c-b67c-d1cb18bad0f3\") " pod="openshift-dns/node-resolver-zfnzx"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417813    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-socket-dir\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417835    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-modprobe-d\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417863    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76r9b\" (UniqueName: \"kubernetes.io/projected/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-kube-api-access-76r9b\") pod \"network-metrics-daemon-j62gp\" (UID: \"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd\") " pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417885    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-etc-openvswitch\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417906    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-cni-bin\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417928    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-etc-selinux\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417951    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-os-release\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417960    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-cni-binary-copy\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417974    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418017    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418030    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs\") pod \"network-metrics-daemon-j62gp\" (UID: \"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd\") " pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:17.466167 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418057    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thq4p\" (UniqueName: \"kubernetes.io/projected/4435b501-e398-4e47-ac8e-21b1f87f0723-kube-api-access-thq4p\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418083    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-sysctl-d\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418131    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-dbus\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418156    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-cnibin\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418183    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-system-cni-dir\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418214    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418241    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-sysconfig\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418267    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-sys\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418294    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-kubelet-config\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418320    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-multus-conf-dir\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418331    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4435b501-e398-4e47-ac8e-21b1f87f0723-env-overrides\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418347    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9-agent-certs\") pod \"konnectivity-agent-d9nvp\" (UID: \"aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9\") " pod="kube-system/konnectivity-agent-d9nvp"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.417969    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418374    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldfgz\" (UniqueName: \"kubernetes.io/projected/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-kube-api-access-ldfgz\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418396    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-kubelet\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418422    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-slash\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418443    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-run-ovn\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.466885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418464    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nplsg\" (UniqueName: \"kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg\") pod \"network-check-target-zhxk9\" (UID: \"16ada65b-ff10-46fe-8477-f9fc9f101d29\") " pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418484    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-device-dir\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418507    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-sys-fs\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418528    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-run-netns\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418562    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-var-lib-openvswitch\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418586    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-log-socket\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418628    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-cni-netd\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418650    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-hostroot\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418655    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4435b501-e398-4e47-ac8e-21b1f87f0723-ovnkube-script-lib\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418673    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-etc-kubernetes\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418695    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-host\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418706    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-node-log\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418723    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e69362ab-634e-4cb4-bb34-816a21ff3586-iptables-alerter-script\") pod \"iptables-alerter-v9xnn\" (UID: \"e69362ab-634e-4cb4-bb34-816a21ff3586\") " pod="openshift-network-operator/iptables-alerter-v9xnn"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418749    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xv9j\" (UniqueName: \"kubernetes.io/projected/e69362ab-634e-4cb4-bb34-816a21ff3586-kube-api-access-6xv9j\") pod \"iptables-alerter-v9xnn\" (UID: \"e69362ab-634e-4cb4-bb34-816a21ff3586\") " pod="openshift-network-operator/iptables-alerter-v9xnn"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418774    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7-serviceca\") pod \"node-ca-n85wg\" (UID: \"f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7\") " pod="openshift-image-registry/node-ca-n85wg"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418798    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m7zd\" (UniqueName: \"kubernetes.io/projected/68e46b46-20dc-475b-b1d0-fa7197557966-kube-api-access-6m7zd\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418812    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-multus-daemon-config\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.467708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418820    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-lib-modules\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418842    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-run-openvswitch\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418885    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-run-openvswitch\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.418924    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-cnibin\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419004    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-run-ovn-kubernetes\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419032    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-multus-cni-dir\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419057    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-run-multus-certs\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419080    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-systemd\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419101    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4435b501-e398-4e47-ac8e-21b1f87f0723-ovnkube-config\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419128    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa98a74e-b651-463c-b67c-d1cb18bad0f3-tmp-dir\") pod \"node-resolver-zfnzx\" (UID: \"aa98a74e-b651-463c-b67c-d1cb18bad0f3\") " pod="openshift-dns/node-resolver-zfnzx"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419163    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-systemd\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419186    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-sys\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419203    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-run-ovn-kubernetes\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419300    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-multus-cni-dir\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419336    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-host-run-multus-certs\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419352    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e69362ab-634e-4cb4-bb34-816a21ff3586-host-slash\") pod \"iptables-alerter-v9xnn\" (UID: \"e69362ab-634e-4cb4-bb34-816a21ff3586\") " pod="openshift-network-operator/iptables-alerter-v9xnn"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419373    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-run-netns\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419410    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7-host\") pod \"node-ca-n85wg\" (UID: \"f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7\") " pod="openshift-image-registry/node-ca-n85wg"
Jul 20 12:44:17.468381 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419414    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-var-lib-openvswitch\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419451    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-etc-selinux\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419583    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-multus-conf-dir\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419648    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-host\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:17.419660    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419683    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419687    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa98a74e-b651-463c-b67c-d1cb18bad0f3-hosts-file\") pod \"node-resolver-zfnzx\" (UID: \"aa98a74e-b651-463c-b67c-d1cb18bad0f3\") " pod="openshift-dns/node-resolver-zfnzx"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419724    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:17.419743    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret podName:5bbd5447-6fb8-45a5-bf3f-ecb313480f2b nodeName:}" failed. No retries permitted until 2026-07-20 12:44:17.919708578 +0000 UTC m=+3.052691669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret") pod "global-pull-secret-syncer-h4x68" (UID: "5bbd5447-6fb8-45a5-bf3f-ecb313480f2b") : object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419748    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-socket-dir\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419782    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-kubelet-config\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419782    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-modprobe-d\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419811    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-slash\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419822    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-cni-bin\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419831    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-run-ovn\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.421820    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-lib-modules\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.422307    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7-serviceca\") pod \"node-ca-n85wg\" (UID: \"f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7\") " pod="openshift-image-registry/node-ca-n85wg"
Jul 20 12:44:17.469196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.422723    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.422828    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-sys-fs\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.422827    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e69362ab-634e-4cb4-bb34-816a21ff3586-iptables-alerter-script\") pod \"iptables-alerter-v9xnn\" (UID: \"e69362ab-634e-4cb4-bb34-816a21ff3586\") " pod="openshift-network-operator/iptables-alerter-v9xnn"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.419851    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-etc-openvswitch\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.422924    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-log-socket\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.423220    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e36416eb-a5b9-4591-b291-6bc7a04efb04-tmp\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.423515    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-sysconfig\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.422776    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-system-cni-dir\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.424223    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4435b501-e398-4e47-ac8e-21b1f87f0723-ovn-node-metrics-cert\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.424414    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68e46b46-20dc-475b-b1d0-fa7197557966-device-dir\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.424768    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-os-release\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.424638    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9-agent-certs\") pod \"konnectivity-agent-d9nvp\" (UID: \"aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9\") " pod="kube-system/konnectivity-agent-d9nvp"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.425447    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-cnibin\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.425497    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-cni-netd\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:17.425580    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.425655    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-hostroot\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:17.425663    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs podName:c44e5f72-2a44-4fc6-bcac-56ce085e2bdd nodeName:}" failed. No retries permitted until 2026-07-20 12:44:17.925631369 +0000 UTC m=+3.058614446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs") pod "network-metrics-daemon-j62gp" (UID: "c44e5f72-2a44-4fc6-bcac-56ce085e2bdd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:17.469943 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.425770    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-sysctl-d\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.425775    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-etc-kubernetes\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.425821    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4435b501-e398-4e47-ac8e-21b1f87f0723-host-kubelet\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.425873    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-dbus\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.427440    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e36416eb-a5b9-4591-b291-6bc7a04efb04-etc-tuned\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.429600    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp8df\" (UniqueName: \"kubernetes.io/projected/aa98a74e-b651-463c-b67c-d1cb18bad0f3-kube-api-access-vp8df\") pod \"node-resolver-zfnzx\" (UID: \"aa98a74e-b651-463c-b67c-d1cb18bad0f3\") " pod="openshift-dns/node-resolver-zfnzx"
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.429698    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhw5m\" (UniqueName: \"kubernetes.io/projected/f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7-kube-api-access-rhw5m\") pod \"node-ca-n85wg\" (UID: \"f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7\") " pod="openshift-image-registry/node-ca-n85wg"
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.430360    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65qxp\" (UniqueName: \"kubernetes.io/projected/55ec64d0-1738-4a94-b720-14a8d8a7e2f7-kube-api-access-65qxp\") pod \"multus-v75j2\" (UID: \"55ec64d0-1738-4a94-b720-14a8d8a7e2f7\") " pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.432099    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86cgv\" (UniqueName: \"kubernetes.io/projected/e36416eb-a5b9-4591-b291-6bc7a04efb04-kube-api-access-86cgv\") pod \"tuned-ksd2f\" (UID: \"e36416eb-a5b9-4591-b291-6bc7a04efb04\") " pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.432581    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xv9j\" (UniqueName: \"kubernetes.io/projected/e69362ab-634e-4cb4-bb34-816a21ff3586-kube-api-access-6xv9j\") pod \"iptables-alerter-v9xnn\" (UID: \"e69362ab-634e-4cb4-bb34-816a21ff3586\") " pod="openshift-network-operator/iptables-alerter-v9xnn"
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.432967    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76r9b\" (UniqueName: \"kubernetes.io/projected/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-kube-api-access-76r9b\") pod \"network-metrics-daemon-j62gp\" (UID: \"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd\") " pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:17.433213    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:17.433228    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:17.433240    2557 projected.go:196] Error preparing data for projected volume kube-api-access-nplsg for pod openshift-network-diagnostics/network-check-target-zhxk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:17.433295    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg podName:16ada65b-ff10-46fe-8477-f9fc9f101d29 nodeName:}" failed. No retries permitted until 2026-07-20 12:44:17.93328004 +0000 UTC m=+3.066263116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nplsg" (UniqueName: "kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg") pod "network-check-target-zhxk9" (UID: "16ada65b-ff10-46fe-8477-f9fc9f101d29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.434335    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m7zd\" (UniqueName: \"kubernetes.io/projected/68e46b46-20dc-475b-b1d0-fa7197557966-kube-api-access-6m7zd\") pod \"aws-ebs-csi-driver-node-tcn89\" (UID: \"68e46b46-20dc-475b-b1d0-fa7197557966\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.434703    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldfgz\" (UniqueName: \"kubernetes.io/projected/b2e46c1e-c52b-46b5-b19c-e25efea77fa2-kube-api-access-ldfgz\") pod \"multus-additional-cni-plugins-j5sb7\" (UID: \"b2e46c1e-c52b-46b5-b19c-e25efea77fa2\") " pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.471151 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.466357    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thq4p\" (UniqueName: \"kubernetes.io/projected/4435b501-e398-4e47-ac8e-21b1f87f0723-kube-api-access-thq4p\") pod \"ovnkube-node-chtb7\" (UID: \"4435b501-e398-4e47-ac8e-21b1f87f0723\") " pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.798858 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.593005    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89"
Jul 20 12:44:17.798858 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.601664    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n85wg"
Jul 20 12:44:17.798858 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.614133    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d9nvp"
Jul 20 12:44:17.798858 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.654989    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j5sb7"
Jul 20 12:44:17.798858 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.667916    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ksd2f"
Jul 20 12:44:17.798858 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.675379    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v75j2"
Jul 20 12:44:17.798858 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.701189    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v9xnn"
Jul 20 12:44:17.798858 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.717639    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:17.798858 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.720278    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zfnzx"
Jul 20 12:44:17.923470 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:17.922218    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:17.923470 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:17.922361    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:17.923470 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:17.922417    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret podName:5bbd5447-6fb8-45a5-bf3f-ecb313480f2b nodeName:}" failed. No retries permitted until 2026-07-20 12:44:18.922403611 +0000 UTC m=+4.055386688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret") pod "global-pull-secret-syncer-h4x68" (UID: "5bbd5447-6fb8-45a5-bf3f-ecb313480f2b") : object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:18.155631 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:18.023314    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs\") pod \"network-metrics-daemon-j62gp\" (UID: \"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd\") " pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:18.155631 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:18.023350    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nplsg\" (UniqueName: \"kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg\") pod \"network-check-target-zhxk9\" (UID: \"16ada65b-ff10-46fe-8477-f9fc9f101d29\") " pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:18.155631 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:18.023461    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 12:44:18.155631 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:18.023460    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:18.155631 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:18.023525    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs podName:c44e5f72-2a44-4fc6-bcac-56ce085e2bdd nodeName:}" failed. No retries permitted until 2026-07-20 12:44:19.023511772 +0000 UTC m=+4.156494853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs") pod "network-metrics-daemon-j62gp" (UID: "c44e5f72-2a44-4fc6-bcac-56ce085e2bdd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:18.155631 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:18.023475    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 12:44:18.155631 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:18.023549    2557 projected.go:196] Error preparing data for projected volume kube-api-access-nplsg for pod openshift-network-diagnostics/network-check-target-zhxk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:18.155631 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:18.023586    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg podName:16ada65b-ff10-46fe-8477-f9fc9f101d29 nodeName:}" failed. No retries permitted until 2026-07-20 12:44:19.023578097 +0000 UTC m=+4.156561174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nplsg" (UniqueName: "kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg") pod "network-check-target-zhxk9" (UID: "16ada65b-ff10-46fe-8477-f9fc9f101d29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:18.519646 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:18.349323    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 12:39:17 +0000 UTC" deadline="2028-04-02 09:43:26.444278538 +0000 UTC"
Jul 20 12:44:18.519646 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:18.349368    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14924h59m8.09492968s"
Jul 20 12:44:18.519646 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:18.514742    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4e1d7c_8c44_4a7b_96a8_6306ca0a6af9.slice/crio-8d5305fdfbfce036d8ffe8eae0062f1b92d7038bafc9cb9aeffdc80451f5a0ee WatchSource:0}: Error finding container 8d5305fdfbfce036d8ffe8eae0062f1b92d7038bafc9cb9aeffdc80451f5a0ee: Status 404 returned error can't find the container with id 8d5305fdfbfce036d8ffe8eae0062f1b92d7038bafc9cb9aeffdc80451f5a0ee
Jul 20 12:44:18.522430 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:18.522407    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode69362ab_634e_4cb4_bb34_816a21ff3586.slice/crio-cf84e9d77f7658b87cc55a84f1ff1bbf16f489c82c7162fa3839996fe0a3642b WatchSource:0}: Error finding container cf84e9d77f7658b87cc55a84f1ff1bbf16f489c82c7162fa3839996fe0a3642b: Status 404 returned error can't find the container with id cf84e9d77f7658b87cc55a84f1ff1bbf16f489c82c7162fa3839996fe0a3642b
Jul 20 12:44:18.523578 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:18.523416    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4435b501_e398_4e47_ac8e_21b1f87f0723.slice/crio-e9df5b00ea74ebf04345bacd8fa56e1ddd3ff3e8c135b7f8d008a5df3cb7ac06 WatchSource:0}: Error finding container e9df5b00ea74ebf04345bacd8fa56e1ddd3ff3e8c135b7f8d008a5df3cb7ac06: Status 404 returned error can't find the container with id e9df5b00ea74ebf04345bacd8fa56e1ddd3ff3e8c135b7f8d008a5df3cb7ac06
Jul 20 12:44:18.524117 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:18.524088    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9bbfbe6_3003_4ca0_aa5e_be4f921ddcc7.slice/crio-dacf2c5375f979b3e794fd0244ba4f6a400bbfec81fcc80c276e415667bdedfd WatchSource:0}: Error finding container dacf2c5375f979b3e794fd0244ba4f6a400bbfec81fcc80c276e415667bdedfd: Status 404 returned error can't find the container with id dacf2c5375f979b3e794fd0244ba4f6a400bbfec81fcc80c276e415667bdedfd
Jul 20 12:44:18.525271 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:18.525137    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55ec64d0_1738_4a94_b720_14a8d8a7e2f7.slice/crio-b38f257c7a6952d27a437b247128a1ad38bc60de86c01bbd5d263121601d37a7 WatchSource:0}: Error finding container b38f257c7a6952d27a437b247128a1ad38bc60de86c01bbd5d263121601d37a7: Status 404 returned error can't find the container with id b38f257c7a6952d27a437b247128a1ad38bc60de86c01bbd5d263121601d37a7
Jul 20 12:44:18.525956 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:18.525812    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e46c1e_c52b_46b5_b19c_e25efea77fa2.slice/crio-91ac1bf530d6bdd48fa565ff5f18af9a95e8a22ddd01ef86a403e888fd0a0b25 WatchSource:0}: Error finding container 91ac1bf530d6bdd48fa565ff5f18af9a95e8a22ddd01ef86a403e888fd0a0b25: Status 404 returned error can't find the container with id 91ac1bf530d6bdd48fa565ff5f18af9a95e8a22ddd01ef86a403e888fd0a0b25
Jul 20 12:44:18.527686 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:18.527648    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e46b46_20dc_475b_b1d0_fa7197557966.slice/crio-46fc6c14269d9f5761c941a0cc4d4135afc25cb66b78f42a4ec6731fce3860ce WatchSource:0}: Error finding container 46fc6c14269d9f5761c941a0cc4d4135afc25cb66b78f42a4ec6731fce3860ce: Status 404 returned error can't find the container with id 46fc6c14269d9f5761c941a0cc4d4135afc25cb66b78f42a4ec6731fce3860ce
Jul 20 12:44:18.528979 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:18.528954    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36416eb_a5b9_4591_b291_6bc7a04efb04.slice/crio-46d429ee0dda37aec04753d8e08a6393e0b9b5ebeda3b04373884fee1d2e6760 WatchSource:0}: Error finding container 46d429ee0dda37aec04753d8e08a6393e0b9b5ebeda3b04373884fee1d2e6760: Status 404 returned error can't find the container with id 46d429ee0dda37aec04753d8e08a6393e0b9b5ebeda3b04373884fee1d2e6760
Jul 20 12:44:18.930525 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:18.930494    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:18.931063 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:18.930637    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:18.931063 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:18.930697    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret podName:5bbd5447-6fb8-45a5-bf3f-ecb313480f2b nodeName:}" failed. No retries permitted until 2026-07-20 12:44:20.930673082 +0000 UTC m=+6.063656162 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret") pod "global-pull-secret-syncer-h4x68" (UID: "5bbd5447-6fb8-45a5-bf3f-ecb313480f2b") : object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:19.031331 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.031251    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nplsg\" (UniqueName: \"kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg\") pod \"network-check-target-zhxk9\" (UID: \"16ada65b-ff10-46fe-8477-f9fc9f101d29\") " pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:19.031331 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.031318    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs\") pod \"network-metrics-daemon-j62gp\" (UID: \"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd\") " pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:19.031521 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:19.031408    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:19.031521 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:19.031437    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 12:44:19.031521 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:19.031454    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs podName:c44e5f72-2a44-4fc6-bcac-56ce085e2bdd nodeName:}" failed. No retries permitted until 2026-07-20 12:44:21.031440659 +0000 UTC m=+6.164423736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs") pod "network-metrics-daemon-j62gp" (UID: "c44e5f72-2a44-4fc6-bcac-56ce085e2bdd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:19.031521 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:19.031457    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 12:44:19.031521 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:19.031469    2557 projected.go:196] Error preparing data for projected volume kube-api-access-nplsg for pod openshift-network-diagnostics/network-check-target-zhxk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:19.031521 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:19.031516    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg podName:16ada65b-ff10-46fe-8477-f9fc9f101d29 nodeName:}" failed. No retries permitted until 2026-07-20 12:44:21.031500714 +0000 UTC m=+6.164483807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nplsg" (UniqueName: "kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg") pod "network-check-target-zhxk9" (UID: "16ada65b-ff10-46fe-8477-f9fc9f101d29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:19.350562 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.350463    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 12:39:17 +0000 UTC" deadline="2028-02-12 07:35:13.826920807 +0000 UTC"
Jul 20 12:44:19.350562 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.350518    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13722h50m54.47640602s"
Jul 20 12:44:19.377835 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.377812    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:19.377976 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:19.377922    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:19.378317 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.378298    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:19.378409 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:19.378391    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:19.378460 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.378454    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:19.378552 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:19.378526    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:19.399137 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.398722    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-54.ec2.internal" event={"ID":"73f6bdbf997a544246c875c3b1e88545","Type":"ContainerStarted","Data":"376ebfd77a681f866711f0779d9364ff3a7ece5dd2fd200d65b19177d0939359"}
Jul 20 12:44:19.402747 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.402560    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89" event={"ID":"68e46b46-20dc-475b-b1d0-fa7197557966","Type":"ContainerStarted","Data":"46fc6c14269d9f5761c941a0cc4d4135afc25cb66b78f42a4ec6731fce3860ce"}
Jul 20 12:44:19.405901 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.405875    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v75j2" event={"ID":"55ec64d0-1738-4a94-b720-14a8d8a7e2f7","Type":"ContainerStarted","Data":"b38f257c7a6952d27a437b247128a1ad38bc60de86c01bbd5d263121601d37a7"}
Jul 20 12:44:19.410836 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.410784    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n85wg" event={"ID":"f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7","Type":"ContainerStarted","Data":"dacf2c5375f979b3e794fd0244ba4f6a400bbfec81fcc80c276e415667bdedfd"}
Jul 20 12:44:19.416128 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.416101    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v9xnn" event={"ID":"e69362ab-634e-4cb4-bb34-816a21ff3586","Type":"ContainerStarted","Data":"cf84e9d77f7658b87cc55a84f1ff1bbf16f489c82c7162fa3839996fe0a3642b"}
Jul 20 12:44:19.420544 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.420488    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zfnzx" event={"ID":"aa98a74e-b651-463c-b67c-d1cb18bad0f3","Type":"ContainerStarted","Data":"7aa22a96736bd4715cd90fb1f39b1a87c359bfecf7d7918ad59ee81575b09143"}
Jul 20 12:44:19.422569 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.422501    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d9nvp" event={"ID":"aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9","Type":"ContainerStarted","Data":"8d5305fdfbfce036d8ffe8eae0062f1b92d7038bafc9cb9aeffdc80451f5a0ee"}
Jul 20 12:44:19.428499 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.427735    2557 generic.go:356] "Generic (PLEG): container finished" podID="0a498e25e8920f5d6324995f0e2bde44" containerID="3b2b65d7c006ee867e14e469e124d55911483f9eb1b0afa3ec3e69b650f1c0ed" exitCode=0
Jul 20 12:44:19.428499 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.427808    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal" event={"ID":"0a498e25e8920f5d6324995f0e2bde44","Type":"ContainerDied","Data":"3b2b65d7c006ee867e14e469e124d55911483f9eb1b0afa3ec3e69b650f1c0ed"}
Jul 20 12:44:19.444089 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.444026    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ksd2f" event={"ID":"e36416eb-a5b9-4591-b291-6bc7a04efb04","Type":"ContainerStarted","Data":"46d429ee0dda37aec04753d8e08a6393e0b9b5ebeda3b04373884fee1d2e6760"}
Jul 20 12:44:19.449225 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.448773    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-54.ec2.internal" podStartSLOduration=3.448754459 podStartE2EDuration="3.448754459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:44:19.414973332 +0000 UTC m=+4.547956430" watchObservedRunningTime="2026-07-20 12:44:19.448754459 +0000 UTC m=+4.581737556"
Jul 20 12:44:19.456435 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.456408    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5sb7" event={"ID":"b2e46c1e-c52b-46b5-b19c-e25efea77fa2","Type":"ContainerStarted","Data":"91ac1bf530d6bdd48fa565ff5f18af9a95e8a22ddd01ef86a403e888fd0a0b25"}
Jul 20 12:44:19.469014 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:19.468982    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7" event={"ID":"4435b501-e398-4e47-ac8e-21b1f87f0723","Type":"ContainerStarted","Data":"e9df5b00ea74ebf04345bacd8fa56e1ddd3ff3e8c135b7f8d008a5df3cb7ac06"}
Jul 20 12:44:20.485663 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:20.485198    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal" event={"ID":"0a498e25e8920f5d6324995f0e2bde44","Type":"ContainerStarted","Data":"554b8b44797ecefa5307699c4e6071861ddc8ca3a73f71bb59c78f2634f7aecc"}
Jul 20 12:44:20.500431 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:20.500381    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-54.ec2.internal" podStartSLOduration=4.500363507 podStartE2EDuration="4.500363507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:44:20.50019168 +0000 UTC m=+5.633174782" watchObservedRunningTime="2026-07-20 12:44:20.500363507 +0000 UTC m=+5.633346608"
Jul 20 12:44:20.945243 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:20.945168    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:20.945472 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:20.945453    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:20.945534 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:20.945524    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret podName:5bbd5447-6fb8-45a5-bf3f-ecb313480f2b nodeName:}" failed. No retries permitted until 2026-07-20 12:44:24.94550487 +0000 UTC m=+10.078487951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret") pod "global-pull-secret-syncer-h4x68" (UID: "5bbd5447-6fb8-45a5-bf3f-ecb313480f2b") : object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:21.046252 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:21.046214    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs\") pod \"network-metrics-daemon-j62gp\" (UID: \"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd\") " pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:21.046424 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:21.046274    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nplsg\" (UniqueName: \"kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg\") pod \"network-check-target-zhxk9\" (UID: \"16ada65b-ff10-46fe-8477-f9fc9f101d29\") " pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:21.046424 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:21.046411    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 12:44:21.046523 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:21.046429    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 12:44:21.046523 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:21.046450    2557 projected.go:196] Error preparing data for projected volume kube-api-access-nplsg for pod openshift-network-diagnostics/network-check-target-zhxk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:21.046523 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:21.046506    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg podName:16ada65b-ff10-46fe-8477-f9fc9f101d29 nodeName:}" failed. No retries permitted until 2026-07-20 12:44:25.046488118 +0000 UTC m=+10.179471220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nplsg" (UniqueName: "kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg") pod "network-check-target-zhxk9" (UID: "16ada65b-ff10-46fe-8477-f9fc9f101d29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:21.046921 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:21.046902    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:21.047025 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:21.046956    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs podName:c44e5f72-2a44-4fc6-bcac-56ce085e2bdd nodeName:}" failed. No retries permitted until 2026-07-20 12:44:25.046942183 +0000 UTC m=+10.179925280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs") pod "network-metrics-daemon-j62gp" (UID: "c44e5f72-2a44-4fc6-bcac-56ce085e2bdd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:21.374808 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:21.374724    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:21.374954 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:21.374865    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:21.375299 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:21.375232    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:21.375379 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:21.375321    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:21.377304 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:21.377275    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:21.377417 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:21.377371    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:23.376646 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:23.375976    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:23.376646 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:23.376131    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:23.376646 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:23.376547    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:23.377562 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:23.377331    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:23.377562 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:23.377420    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:23.377562 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:23.377500    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:24.977176 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:24.977135    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:24.977642 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:24.977340    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:24.977642 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:24.977413    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret podName:5bbd5447-6fb8-45a5-bf3f-ecb313480f2b nodeName:}" failed. No retries permitted until 2026-07-20 12:44:32.977392714 +0000 UTC m=+18.110375797 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret") pod "global-pull-secret-syncer-h4x68" (UID: "5bbd5447-6fb8-45a5-bf3f-ecb313480f2b") : object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:25.078259 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:25.078212    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs\") pod \"network-metrics-daemon-j62gp\" (UID: \"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd\") " pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:25.078415 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:25.078271    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nplsg\" (UniqueName: \"kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg\") pod \"network-check-target-zhxk9\" (UID: \"16ada65b-ff10-46fe-8477-f9fc9f101d29\") " pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:25.078494 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:25.078438    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 12:44:25.078494 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:25.078466    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 12:44:25.078494 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:25.078479    2557 projected.go:196] Error preparing data for projected volume kube-api-access-nplsg for pod openshift-network-diagnostics/network-check-target-zhxk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:25.078648 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:25.078540    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg podName:16ada65b-ff10-46fe-8477-f9fc9f101d29 nodeName:}" failed. No retries permitted until 2026-07-20 12:44:33.078521287 +0000 UTC m=+18.211504377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nplsg" (UniqueName: "kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg") pod "network-check-target-zhxk9" (UID: "16ada65b-ff10-46fe-8477-f9fc9f101d29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:25.078965 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:25.078948    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:25.079071 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:25.079002    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs podName:c44e5f72-2a44-4fc6-bcac-56ce085e2bdd nodeName:}" failed. No retries permitted until 2026-07-20 12:44:33.078985604 +0000 UTC m=+18.211968685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs") pod "network-metrics-daemon-j62gp" (UID: "c44e5f72-2a44-4fc6-bcac-56ce085e2bdd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:25.375448 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:25.374860    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:25.375448 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:25.374970    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:25.375448 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:25.374980    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:25.375448 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:25.374998    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:25.375448 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:25.375065    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:25.375448 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:25.375140    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:27.375807 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:27.375737    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:27.376279 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:27.375852    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:27.376279 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:27.375737    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:27.376403 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:27.376340    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:27.376516 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:27.376434    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:27.376568 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:27.376512    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:29.374364 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:29.374335    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:29.374746 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:29.374477    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:29.374746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:29.374507    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:29.374746 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:29.374635    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:29.374746 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:29.374668    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:29.374919 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:29.374744    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:31.374980 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:31.374943    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:31.375437 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:31.374943    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:31.375437 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:31.375070    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:31.375437 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:31.375180    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:31.375437 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:31.374945    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:31.375437 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:31.375306    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:33.043860 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:33.043825    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:33.044294 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:33.043991    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:33.044294 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:33.044071    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret podName:5bbd5447-6fb8-45a5-bf3f-ecb313480f2b nodeName:}" failed. No retries permitted until 2026-07-20 12:44:49.044049517 +0000 UTC m=+34.177032595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret") pod "global-pull-secret-syncer-h4x68" (UID: "5bbd5447-6fb8-45a5-bf3f-ecb313480f2b") : object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:33.144209 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:33.144175    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs\") pod \"network-metrics-daemon-j62gp\" (UID: \"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd\") " pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:33.144386 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:33.144218    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nplsg\" (UniqueName: \"kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg\") pod \"network-check-target-zhxk9\" (UID: \"16ada65b-ff10-46fe-8477-f9fc9f101d29\") " pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:33.144386 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:33.144358    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:33.144494 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:33.144416    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 12:44:33.144494 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:33.144437    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 12:44:33.144494 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:33.144449    2557 projected.go:196] Error preparing data for projected volume kube-api-access-nplsg for pod openshift-network-diagnostics/network-check-target-zhxk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:33.144494 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:33.144439    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs podName:c44e5f72-2a44-4fc6-bcac-56ce085e2bdd nodeName:}" failed. No retries permitted until 2026-07-20 12:44:49.144416038 +0000 UTC m=+34.277399137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs") pod "network-metrics-daemon-j62gp" (UID: "c44e5f72-2a44-4fc6-bcac-56ce085e2bdd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:33.144684 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:33.144500    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg podName:16ada65b-ff10-46fe-8477-f9fc9f101d29 nodeName:}" failed. No retries permitted until 2026-07-20 12:44:49.144486036 +0000 UTC m=+34.277469113 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nplsg" (UniqueName: "kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg") pod "network-check-target-zhxk9" (UID: "16ada65b-ff10-46fe-8477-f9fc9f101d29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:33.374111 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:33.374033    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:33.374281 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:33.374031    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:33.374281 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:33.374157    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:33.374281 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:33.374248    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:33.374281 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:33.374038    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:33.374499 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:33.374346    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:35.375919 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:35.375693    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:35.375919 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:35.375776    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:35.375919 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:35.375822    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:35.375919 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:35.375830    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:35.375919 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:35.375917    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:35.376572 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:35.376002    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:37.374452 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.374171    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:37.375072 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:37.374569    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:37.375072 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.374171    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:37.375072 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:37.374684    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:37.375072 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.374370    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:37.375072 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:37.374763    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:37.524833 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.524808    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89" event={"ID":"68e46b46-20dc-475b-b1d0-fa7197557966","Type":"ContainerStarted","Data":"1c02f5ae5257f514dea9ae26cab8e8c21183585f8b5876a50f5d4055e49b1ee8"}
Jul 20 12:44:37.526154 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.526131    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v75j2" event={"ID":"55ec64d0-1738-4a94-b720-14a8d8a7e2f7","Type":"ContainerStarted","Data":"d0266483485364f89793c5001e0e72aacddd17f73644ca1b5f4973c3a985c9ec"}
Jul 20 12:44:37.527435 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.527411    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n85wg" event={"ID":"f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7","Type":"ContainerStarted","Data":"6f01441dd9f46db27309906abcc8f6232d72a5fd6c82e65202ffb29fb513ecf8"}
Jul 20 12:44:37.528775 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.528753    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zfnzx" event={"ID":"aa98a74e-b651-463c-b67c-d1cb18bad0f3","Type":"ContainerStarted","Data":"721b49d263e03ae43bdf3a20f0f77b0985522d10e416c2ddc408661d225e6710"}
Jul 20 12:44:37.530106 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.530086    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d9nvp" event={"ID":"aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9","Type":"ContainerStarted","Data":"5d41659ed19edf553205d120eb08f2ffa89d6f263a3270b6d859bd3d5fa3e239"}
Jul 20 12:44:37.531470 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.531450    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ksd2f" event={"ID":"e36416eb-a5b9-4591-b291-6bc7a04efb04","Type":"ContainerStarted","Data":"841b215443be180199261bc8bd3afa886138dc40e87ebeedc3cd00fb98ee6866"}
Jul 20 12:44:37.532953 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.532931    2557 generic.go:356] "Generic (PLEG): container finished" podID="b2e46c1e-c52b-46b5-b19c-e25efea77fa2" containerID="edc4dad15b03aa0a4f6fb12b2d8218a925051cc70e121fa48370d1e08e4adc89" exitCode=0
Jul 20 12:44:37.533021 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.533010    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5sb7" event={"ID":"b2e46c1e-c52b-46b5-b19c-e25efea77fa2","Type":"ContainerDied","Data":"edc4dad15b03aa0a4f6fb12b2d8218a925051cc70e121fa48370d1e08e4adc89"}
Jul 20 12:44:37.535514 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.535490    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7" event={"ID":"4435b501-e398-4e47-ac8e-21b1f87f0723","Type":"ContainerStarted","Data":"d2fea64650bd695d078f1b59b46a932969841480d95806c5fbec171b68714308"}
Jul 20 12:44:37.535603 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.535564    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7" event={"ID":"4435b501-e398-4e47-ac8e-21b1f87f0723","Type":"ContainerStarted","Data":"193ed19c47ff5d82ea19d7cbd14ef3f8ba88e06083b62265c489543f7830439a"}
Jul 20 12:44:37.535666 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.535614    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7" event={"ID":"4435b501-e398-4e47-ac8e-21b1f87f0723","Type":"ContainerStarted","Data":"66376cc2f7075372f83852dd7c89e3febbe657ebc5bbdba178a02dff47117e6c"}
Jul 20 12:44:37.535701 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.535682    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7" event={"ID":"4435b501-e398-4e47-ac8e-21b1f87f0723","Type":"ContainerStarted","Data":"ea6c3f76f89dfa2a0b3f34755085d371543017fb08532760c55bf58ef66f5fed"}
Jul 20 12:44:37.543529 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.543483    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v75j2" podStartSLOduration=3.905286807 podStartE2EDuration="22.543467688s" totalImagesPullingTime="18.638180881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:44:37.543206032 +0000 UTC m=+22.676189132" watchObservedRunningTime="2026-07-20 12:44:37.543467688 +0000 UTC m=+22.676450789"
Jul 20 12:44:37.556606 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.556561    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d9nvp" podStartSLOduration=12.056473157 podStartE2EDuration="22.556548017s" totalImagesPullingTime="10.50007486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:44:37.555861183 +0000 UTC m=+22.688844283" watchObservedRunningTime="2026-07-20 12:44:37.556548017 +0000 UTC m=+22.689531118"
Jul 20 12:44:37.571027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.570640    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zfnzx" podStartSLOduration=3.9808557909999998 podStartE2EDuration="22.57061111s" totalImagesPullingTime="18.589755319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:44:37.570171655 +0000 UTC m=+22.703154755" watchObservedRunningTime="2026-07-20 12:44:37.57061111 +0000 UTC m=+22.703594210"
Jul 20 12:44:37.582268 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.582235    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n85wg" podStartSLOduration=3.99950043 podStartE2EDuration="22.582223629s" totalImagesPullingTime="18.582723199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:44:37.582014472 +0000 UTC m=+22.714997572" watchObservedRunningTime="2026-07-20 12:44:37.582223629 +0000 UTC m=+22.715206729"
Jul 20 12:44:37.621502 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.621462    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ksd2f" podStartSLOduration=4.046049992 podStartE2EDuration="22.621451451s" totalImagesPullingTime="18.575401459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:44:37.621282697 +0000 UTC m=+22.754265797" watchObservedRunningTime="2026-07-20 12:44:37.621451451 +0000 UTC m=+22.754434549"
Jul 20 12:44:37.913014 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.912944    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d9nvp"
Jul 20 12:44:37.913415 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:37.913400    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d9nvp"
Jul 20 12:44:38.541700 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:38.541664    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7" event={"ID":"4435b501-e398-4e47-ac8e-21b1f87f0723","Type":"ContainerStarted","Data":"a30c33dd80c89172b4579b9bdac38113a0d1c0c4a279f540f5b0af1c13130e05"}
Jul 20 12:44:38.542140 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:38.541791    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7" event={"ID":"4435b501-e398-4e47-ac8e-21b1f87f0723","Type":"ContainerStarted","Data":"16948bdc494eb29ddf50713ebf024c6291498c9950f9104243c384eb62c151ad"}
Jul 20 12:44:38.543739 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:38.543681    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v9xnn" event={"ID":"e69362ab-634e-4cb4-bb34-816a21ff3586","Type":"ContainerStarted","Data":"01c3e582df0740f564db033b55fb0daa05fa0de724d4874341114704229f5fd1"}
Jul 20 12:44:38.544712 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:38.544670    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d9nvp"
Jul 20 12:44:38.545130 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:38.545109    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d9nvp"
Jul 20 12:44:38.557977 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:38.557929    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v9xnn" podStartSLOduration=4.972922106 podStartE2EDuration="23.557911453s" totalImagesPullingTime="18.584989347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:44:38.557570564 +0000 UTC m=+23.690553665" watchObservedRunningTime="2026-07-20 12:44:38.557911453 +0000 UTC m=+23.690894555"
Jul 20 12:44:39.111998 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:39.111979    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 12:44:39.374717 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:39.374644    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:39.375021 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:39.374772    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:39.375021 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:39.374961    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:39.375158 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:39.374961    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:39.375158 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:39.375079    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:39.375249 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:39.375183    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:39.389876 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:39.389802    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T12:44:39.111994639Z","UUID":"fea9eabc-599e-495f-b053-95b734b6e06f","Handler":null,"Name":"","Endpoint":""}
Jul 20 12:44:39.391169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:39.391152    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 12:44:39.391256 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:39.391209    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 12:44:39.547804 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:39.547765    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89" event={"ID":"68e46b46-20dc-475b-b1d0-fa7197557966","Type":"ContainerStarted","Data":"66d9ce27580c6c825a38265ebbd8b4ffad7c6e854965074a8e9ec71dbd79063f"}
Jul 20 12:44:40.553383 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:40.553170    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7" event={"ID":"4435b501-e398-4e47-ac8e-21b1f87f0723","Type":"ContainerStarted","Data":"c288fbfd76999a0a67fc0b40e784201e462e8063b8cbc8f0cd265047bb5d7780"}
Jul 20 12:44:41.374502 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:41.374464    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:41.374741 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:41.374464    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:41.374741 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:41.374588    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:41.374741 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:41.374589    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:41.374741 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:41.374694    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:41.374904 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:41.374799    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:41.557713 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:41.557674    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89" event={"ID":"68e46b46-20dc-475b-b1d0-fa7197557966","Type":"ContainerStarted","Data":"b1a9070f3151d8caf99764d802a38279bc1eef94f874729220a3b2e6819d42d0"}
Jul 20 12:44:41.575459 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:41.575414    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tcn89" podStartSLOduration=4.926015888 podStartE2EDuration="26.575400053s" totalImagesPullingTime="21.649384165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:44:41.574746376 +0000 UTC m=+26.707729479" watchObservedRunningTime="2026-07-20 12:44:41.575400053 +0000 UTC m=+26.708383169"
Jul 20 12:44:43.374164 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:43.374092    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:43.374779 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:43.374092    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:43.374779 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:43.374194    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:43.374779 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:43.374293    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:43.374779 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:43.374102    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:43.374779 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:43.374402    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:43.563016 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:43.562986    2557 generic.go:356] "Generic (PLEG): container finished" podID="b2e46c1e-c52b-46b5-b19c-e25efea77fa2" containerID="082fddf8f6cd7f5445bfa66871bbfd037a3a615c8d3d29c8c556ebd1b60b09e2" exitCode=0
Jul 20 12:44:43.563146 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:43.563055    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5sb7" event={"ID":"b2e46c1e-c52b-46b5-b19c-e25efea77fa2","Type":"ContainerDied","Data":"082fddf8f6cd7f5445bfa66871bbfd037a3a615c8d3d29c8c556ebd1b60b09e2"}
Jul 20 12:44:43.566872 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:43.566851    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7" event={"ID":"4435b501-e398-4e47-ac8e-21b1f87f0723","Type":"ContainerStarted","Data":"c0ade7637a263cf6f5e919c5f6c7c0eba1c0a2604cb86cad5ba82086c3546371"}
Jul 20 12:44:43.567093 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:43.567074    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:43.567161 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:43.567150    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:43.583080 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:43.583062    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:43.611268 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:43.611231    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7" podStartSLOduration=9.95154798 podStartE2EDuration="28.611220716s" totalImagesPullingTime="18.659672736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:44:43.610930887 +0000 UTC m=+28.743913986" watchObservedRunningTime="2026-07-20 12:44:43.611220716 +0000 UTC m=+28.744203815"
Jul 20 12:44:44.570327 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:44.570298    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:44.586018 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:44.585993    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:44:44.728045 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:44.728015    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h4x68"]
Jul 20 12:44:44.728192 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:44.728119    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:44.728246 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:44.728199    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:44.730667 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:44.730642    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j62gp"]
Jul 20 12:44:44.730793 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:44.730735    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:44.730847 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:44.730810    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:44.731195 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:44.731168    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zhxk9"]
Jul 20 12:44:44.731342 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:44.731269    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:44.731408 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:44.731348    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:45.574220 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:45.574189    2557 generic.go:356] "Generic (PLEG): container finished" podID="b2e46c1e-c52b-46b5-b19c-e25efea77fa2" containerID="9eafd29bbdbbd12e2c3225b1f620ceafc782e0c527ceade10fe85d6627d51037" exitCode=0
Jul 20 12:44:45.574641 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:45.574277    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5sb7" event={"ID":"b2e46c1e-c52b-46b5-b19c-e25efea77fa2","Type":"ContainerDied","Data":"9eafd29bbdbbd12e2c3225b1f620ceafc782e0c527ceade10fe85d6627d51037"}
Jul 20 12:44:46.374259 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:46.374096    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:46.374390 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:46.374133    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:46.374390 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:46.374343    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:46.374509 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:46.374143    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:46.374509 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:46.374420    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:46.374596 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:46.374533    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:46.578476 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:46.578405    2557 generic.go:356] "Generic (PLEG): container finished" podID="b2e46c1e-c52b-46b5-b19c-e25efea77fa2" containerID="2f0d456719572b9dbca55df88aa1c82aac7a4ad72b4d2d16481a699309f86c0d" exitCode=0
Jul 20 12:44:46.578843 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:46.578492    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5sb7" event={"ID":"b2e46c1e-c52b-46b5-b19c-e25efea77fa2","Type":"ContainerDied","Data":"2f0d456719572b9dbca55df88aa1c82aac7a4ad72b4d2d16481a699309f86c0d"}
Jul 20 12:44:48.374638 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:48.374598    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:48.375223 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:48.374652    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:48.375223 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:48.374652    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:48.375223 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:48.374731    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h4x68" podUID="5bbd5447-6fb8-45a5-bf3f-ecb313480f2b"
Jul 20 12:44:48.375223 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:48.374819    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhxk9" podUID="16ada65b-ff10-46fe-8477-f9fc9f101d29"
Jul 20 12:44:48.375223 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:48.374908    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j62gp" podUID="c44e5f72-2a44-4fc6-bcac-56ce085e2bdd"
Jul 20 12:44:49.065722 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.065678    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:49.065869 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:49.065818    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:49.065903 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:49.065875    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret podName:5bbd5447-6fb8-45a5-bf3f-ecb313480f2b nodeName:}" failed. No retries permitted until 2026-07-20 12:45:21.065859652 +0000 UTC m=+66.198842729 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret") pod "global-pull-secret-syncer-h4x68" (UID: "5bbd5447-6fb8-45a5-bf3f-ecb313480f2b") : object "kube-system"/"original-pull-secret" not registered
Jul 20 12:44:49.166718 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.166673    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs\") pod \"network-metrics-daemon-j62gp\" (UID: \"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd\") " pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:49.166904 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.166732    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nplsg\" (UniqueName: \"kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg\") pod \"network-check-target-zhxk9\" (UID: \"16ada65b-ff10-46fe-8477-f9fc9f101d29\") " pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:49.166904 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:49.166832    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:49.166904 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:49.166874    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 12:44:49.166904 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:49.166891    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 12:44:49.166904 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:49.166904    2557 projected.go:196] Error preparing data for projected volume kube-api-access-nplsg for pod openshift-network-diagnostics/network-check-target-zhxk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:49.167125 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:49.166914    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs podName:c44e5f72-2a44-4fc6-bcac-56ce085e2bdd nodeName:}" failed. No retries permitted until 2026-07-20 12:45:21.166893139 +0000 UTC m=+66.299876239 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs") pod "network-metrics-daemon-j62gp" (UID: "c44e5f72-2a44-4fc6-bcac-56ce085e2bdd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 12:44:49.167125 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:49.166953    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg podName:16ada65b-ff10-46fe-8477-f9fc9f101d29 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:21.166936436 +0000 UTC m=+66.299919520 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nplsg" (UniqueName: "kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg") pod "network-check-target-zhxk9" (UID: "16ada65b-ff10-46fe-8477-f9fc9f101d29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 12:44:49.682762 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.682733    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-54.ec2.internal" event="NodeReady"
Jul 20 12:44:49.683230 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.682887    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 12:44:49.719430 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.719399    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67fdbc7bc9-k66r4"]
Jul 20 12:44:49.722651 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.722630    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.724656 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.724633    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 12:44:49.724792 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.724732    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 12:44:49.725054 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.725029    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 12:44:49.725158 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.725086    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4nbld\""
Jul 20 12:44:49.727926 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.727904    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5fzgt"]
Jul 20 12:44:49.731006 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.730980    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 12:44:49.731732 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.731710    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pv4fk"]
Jul 20 12:44:49.731945 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.731927    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:49.735023 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.734749    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 12:44:49.735023 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.734822    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 12:44:49.735023 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.734759    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dcf82\""
Jul 20 12:44:49.736196 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.736177    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67fdbc7bc9-k66r4"]
Jul 20 12:44:49.736283 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.736251    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pv4fk"
Jul 20 12:44:49.738248 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.738227    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 12:44:49.738346 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.738261    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 12:44:49.738346 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.738286    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 12:44:49.738346 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.738288    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-47mnr\""
Jul 20 12:44:49.741319 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.741298    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5fzgt"]
Jul 20 12:44:49.742300 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.742073    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pv4fk"]
Jul 20 12:44:49.873219 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.873148    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c1b8953-bf93-46e6-9442-fd38a3d9412c-trusted-ca\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.873219 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.873194    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c1b8953-bf93-46e6-9442-fd38a3d9412c-ca-trust-extracted\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.873406 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.873222    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-certificates\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.873406 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.873252    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-bound-sa-token\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.873406 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.873278    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c1b8953-bf93-46e6-9442-fd38a3d9412c-image-registry-private-configuration\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.873406 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.873344    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.873406 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.873379    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c1b8953-bf93-46e6-9442-fd38a3d9412c-installation-pull-secrets\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.873599 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.873409    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4067e76-be14-4847-8a2e-de8c8377c7e0-cert\") pod \"ingress-canary-pv4fk\" (UID: \"e4067e76-be14-4847-8a2e-de8c8377c7e0\") " pod="openshift-ingress-canary/ingress-canary-pv4fk"
Jul 20 12:44:49.873599 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.873435    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-tmp-dir\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:49.873599 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.873481    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgn9f\" (UniqueName: \"kubernetes.io/projected/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-kube-api-access-xgn9f\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:49.873599 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.873527    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-config-volume\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:49.873599 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.873576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:49.873782 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.873654    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzbkl\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-kube-api-access-lzbkl\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.873782 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.873677    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbxbd\" (UniqueName: \"kubernetes.io/projected/e4067e76-be14-4847-8a2e-de8c8377c7e0-kube-api-access-tbxbd\") pod \"ingress-canary-pv4fk\" (UID: \"e4067e76-be14-4847-8a2e-de8c8377c7e0\") " pod="openshift-ingress-canary/ingress-canary-pv4fk"
Jul 20 12:44:49.974453 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.974413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c1b8953-bf93-46e6-9442-fd38a3d9412c-ca-trust-extracted\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.974642 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.974463    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-certificates\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.974642 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.974596    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-bound-sa-token\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.974749 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.974655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c1b8953-bf93-46e6-9442-fd38a3d9412c-image-registry-private-configuration\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.974749 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.974686    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.974749 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.974711    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c1b8953-bf93-46e6-9442-fd38a3d9412c-installation-pull-secrets\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.974749 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.974745    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4067e76-be14-4847-8a2e-de8c8377c7e0-cert\") pod \"ingress-canary-pv4fk\" (UID: \"e4067e76-be14-4847-8a2e-de8c8377c7e0\") " pod="openshift-ingress-canary/ingress-canary-pv4fk"
Jul 20 12:44:49.974868 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.974772    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-tmp-dir\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:49.974868 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.974802    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgn9f\" (UniqueName: \"kubernetes.io/projected/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-kube-api-access-xgn9f\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:49.974868 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.974826    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-config-volume\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:49.974868 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.974851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:49.974998 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.974903    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c1b8953-bf93-46e6-9442-fd38a3d9412c-ca-trust-extracted\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.974998 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.974920    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzbkl\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-kube-api-access-lzbkl\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.974998 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.974951    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbxbd\" (UniqueName: \"kubernetes.io/projected/e4067e76-be14-4847-8a2e-de8c8377c7e0-kube-api-access-tbxbd\") pod \"ingress-canary-pv4fk\" (UID: \"e4067e76-be14-4847-8a2e-de8c8377c7e0\") " pod="openshift-ingress-canary/ingress-canary-pv4fk"
Jul 20 12:44:49.975092 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.975012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c1b8953-bf93-46e6-9442-fd38a3d9412c-trusted-ca\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.975910 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.975145    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-certificates\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.975910 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:49.975248    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 12:44:49.975910 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:49.975264    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fdbc7bc9-k66r4: secret "image-registry-tls" not found
Jul 20 12:44:49.975910 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.975283    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-tmp-dir\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:49.975910 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:49.975317    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls podName:0c1b8953-bf93-46e6-9442-fd38a3d9412c nodeName:}" failed. No retries permitted until 2026-07-20 12:44:50.475297143 +0000 UTC m=+35.608280223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls") pod "image-registry-67fdbc7bc9-k66r4" (UID: "0c1b8953-bf93-46e6-9442-fd38a3d9412c") : secret "image-registry-tls" not found
Jul 20 12:44:49.975910 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:49.975832    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 12:44:49.975910 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:49.975875    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls podName:10bcc69c-4bb6-4c9e-8120-8745ad7c2784 nodeName:}" failed. No retries permitted until 2026-07-20 12:44:50.475861969 +0000 UTC m=+35.608845061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls") pod "dns-default-5fzgt" (UID: "10bcc69c-4bb6-4c9e-8120-8745ad7c2784") : secret "dns-default-metrics-tls" not found
Jul 20 12:44:49.975910 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.975898    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c1b8953-bf93-46e6-9442-fd38a3d9412c-trusted-ca\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.976328 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.976029    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-config-volume\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:49.979637 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.979598    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c1b8953-bf93-46e6-9442-fd38a3d9412c-installation-pull-secrets\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.979742 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.979597    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c1b8953-bf93-46e6-9442-fd38a3d9412c-image-registry-private-configuration\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.979742 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.979673    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4067e76-be14-4847-8a2e-de8c8377c7e0-cert\") pod \"ingress-canary-pv4fk\" (UID: \"e4067e76-be14-4847-8a2e-de8c8377c7e0\") " pod="openshift-ingress-canary/ingress-canary-pv4fk"
Jul 20 12:44:49.983109 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.983084    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-bound-sa-token\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:49.983876 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.983842    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgn9f\" (UniqueName: \"kubernetes.io/projected/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-kube-api-access-xgn9f\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:49.983984 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.983939    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbxbd\" (UniqueName: \"kubernetes.io/projected/e4067e76-be14-4847-8a2e-de8c8377c7e0-kube-api-access-tbxbd\") pod \"ingress-canary-pv4fk\" (UID: \"e4067e76-be14-4847-8a2e-de8c8377c7e0\") " pod="openshift-ingress-canary/ingress-canary-pv4fk"
Jul 20 12:44:49.984065 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:49.984048    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzbkl\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-kube-api-access-lzbkl\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:50.052104 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:50.052068    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pv4fk"
Jul 20 12:44:50.374828 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:50.374792    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:44:50.375070 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:50.374914    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:44:50.375070 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:50.374945    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:44:50.377113 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:50.377089    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 12:44:50.377348 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:50.377330    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 12:44:50.377348 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:50.377342    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 12:44:50.377489 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:50.377454    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 12:44:50.377545 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:50.377491    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pvfjj\""
Jul 20 12:44:50.377615 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:50.377598    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cg6n8\""
Jul 20 12:44:50.478006 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:50.477967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:50.478185 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:50.478036    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:50.478185 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:50.478131    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 12:44:50.478185 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:50.478149    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fdbc7bc9-k66r4: secret "image-registry-tls" not found
Jul 20 12:44:50.478323 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:50.478207    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls podName:0c1b8953-bf93-46e6-9442-fd38a3d9412c nodeName:}" failed. No retries permitted until 2026-07-20 12:44:51.478187306 +0000 UTC m=+36.611170402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls") pod "image-registry-67fdbc7bc9-k66r4" (UID: "0c1b8953-bf93-46e6-9442-fd38a3d9412c") : secret "image-registry-tls" not found
Jul 20 12:44:50.478323 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:50.478215    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 12:44:50.478323 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:50.478296    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls podName:10bcc69c-4bb6-4c9e-8120-8745ad7c2784 nodeName:}" failed. No retries permitted until 2026-07-20 12:44:51.478276732 +0000 UTC m=+36.611259831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls") pod "dns-default-5fzgt" (UID: "10bcc69c-4bb6-4c9e-8120-8745ad7c2784") : secret "dns-default-metrics-tls" not found
Jul 20 12:44:51.488107 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:51.488079    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:51.488453 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:51.488129    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:51.488453 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:51.488231    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 12:44:51.488453 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:51.488246    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fdbc7bc9-k66r4: secret "image-registry-tls" not found
Jul 20 12:44:51.488453 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:51.488298    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 12:44:51.488453 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:51.488303    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls podName:0c1b8953-bf93-46e6-9442-fd38a3d9412c nodeName:}" failed. No retries permitted until 2026-07-20 12:44:53.48828854 +0000 UTC m=+38.621271638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls") pod "image-registry-67fdbc7bc9-k66r4" (UID: "0c1b8953-bf93-46e6-9442-fd38a3d9412c") : secret "image-registry-tls" not found
Jul 20 12:44:51.488453 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:51.488365    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls podName:10bcc69c-4bb6-4c9e-8120-8745ad7c2784 nodeName:}" failed. No retries permitted until 2026-07-20 12:44:53.48834864 +0000 UTC m=+38.621331718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls") pod "dns-default-5fzgt" (UID: "10bcc69c-4bb6-4c9e-8120-8745ad7c2784") : secret "dns-default-metrics-tls" not found
Jul 20 12:44:51.551149 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:51.551113    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pv4fk"]
Jul 20 12:44:51.630369 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:44:51.630334    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4067e76_be14_4847_8a2e_de8c8377c7e0.slice/crio-76a1b6439a3bf61e964c88165cd9040fcd0341deb48083d94878966ccab700af WatchSource:0}: Error finding container 76a1b6439a3bf61e964c88165cd9040fcd0341deb48083d94878966ccab700af: Status 404 returned error can't find the container with id 76a1b6439a3bf61e964c88165cd9040fcd0341deb48083d94878966ccab700af
Jul 20 12:44:52.597079 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:52.597044    2557 generic.go:356] "Generic (PLEG): container finished" podID="b2e46c1e-c52b-46b5-b19c-e25efea77fa2" containerID="f91c508d1e7fd64c08969a92247e7520455f196fdb50083325bacff423d2673b" exitCode=0
Jul 20 12:44:52.597523 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:52.597158    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5sb7" event={"ID":"b2e46c1e-c52b-46b5-b19c-e25efea77fa2","Type":"ContainerDied","Data":"f91c508d1e7fd64c08969a92247e7520455f196fdb50083325bacff423d2673b"}
Jul 20 12:44:52.598463 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:52.598432    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pv4fk" event={"ID":"e4067e76-be14-4847-8a2e-de8c8377c7e0","Type":"ContainerStarted","Data":"76a1b6439a3bf61e964c88165cd9040fcd0341deb48083d94878966ccab700af"}
Jul 20 12:44:53.502058 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:53.502022    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:53.502255 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:53.502204    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:53.502255 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:53.502228    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 12:44:53.502352 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:53.502300    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 12:44:53.502352 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:53.502315    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fdbc7bc9-k66r4: secret "image-registry-tls" not found
Jul 20 12:44:53.502352 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:53.502308    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls podName:10bcc69c-4bb6-4c9e-8120-8745ad7c2784 nodeName:}" failed. No retries permitted until 2026-07-20 12:44:57.50228658 +0000 UTC m=+42.635269664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls") pod "dns-default-5fzgt" (UID: "10bcc69c-4bb6-4c9e-8120-8745ad7c2784") : secret "dns-default-metrics-tls" not found
Jul 20 12:44:53.502484 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:53.502363    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls podName:0c1b8953-bf93-46e6-9442-fd38a3d9412c nodeName:}" failed. No retries permitted until 2026-07-20 12:44:57.50234726 +0000 UTC m=+42.635330342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls") pod "image-registry-67fdbc7bc9-k66r4" (UID: "0c1b8953-bf93-46e6-9442-fd38a3d9412c") : secret "image-registry-tls" not found
Jul 20 12:44:53.604759 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:53.604720    2557 generic.go:356] "Generic (PLEG): container finished" podID="b2e46c1e-c52b-46b5-b19c-e25efea77fa2" containerID="25a3054ce09a3eaefd3f532f40090dfcf570903ca552a7731029b485a2bb264e" exitCode=0
Jul 20 12:44:53.605187 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:53.604786    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5sb7" event={"ID":"b2e46c1e-c52b-46b5-b19c-e25efea77fa2","Type":"ContainerDied","Data":"25a3054ce09a3eaefd3f532f40090dfcf570903ca552a7731029b485a2bb264e"}
Jul 20 12:44:54.609564 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:54.609382    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5sb7" event={"ID":"b2e46c1e-c52b-46b5-b19c-e25efea77fa2","Type":"ContainerStarted","Data":"57f159327c8fcccfbebd0fe89ac48101365215a060aeaa55dbc840462b0a7e16"}
Jul 20 12:44:54.631459 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:54.631403    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j5sb7" podStartSLOduration=16.692238368 podStartE2EDuration="39.631386243s" totalImagesPullingTime="22.939147875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:44:54.630019308 +0000 UTC m=+39.763002408" watchObservedRunningTime="2026-07-20 12:44:54.631386243 +0000 UTC m=+39.764369345"
Jul 20 12:44:55.613547 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:55.613513    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pv4fk" event={"ID":"e4067e76-be14-4847-8a2e-de8c8377c7e0","Type":"ContainerStarted","Data":"b6641a7a9d75d41872ae9aa6bed04335861940749bf55c15c9d9fe81f5d85825"}
Jul 20 12:44:55.629171 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:55.629127    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pv4fk" podStartSLOduration=3.5992667430000003 podStartE2EDuration="6.629112339s" totalImagesPullingTime="3.029845596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:44:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:44:55.6287322 +0000 UTC m=+40.761715300" watchObservedRunningTime="2026-07-20 12:44:55.629112339 +0000 UTC m=+40.762095439"
Jul 20 12:44:57.531103 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:57.531067    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:44:57.531527 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:44:57.531115    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:44:57.531527 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:57.531247    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 12:44:57.531527 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:57.531275    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fdbc7bc9-k66r4: secret "image-registry-tls" not found
Jul 20 12:44:57.531527 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:57.531274    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 12:44:57.531527 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:57.531342    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls podName:0c1b8953-bf93-46e6-9442-fd38a3d9412c nodeName:}" failed. No retries permitted until 2026-07-20 12:45:05.531322324 +0000 UTC m=+50.664305419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls") pod "image-registry-67fdbc7bc9-k66r4" (UID: "0c1b8953-bf93-46e6-9442-fd38a3d9412c") : secret "image-registry-tls" not found
Jul 20 12:44:57.531527 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:44:57.531396    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls podName:10bcc69c-4bb6-4c9e-8120-8745ad7c2784 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:05.53137941 +0000 UTC m=+50.664362487 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls") pod "dns-default-5fzgt" (UID: "10bcc69c-4bb6-4c9e-8120-8745ad7c2784") : secret "dns-default-metrics-tls" not found
Jul 20 12:45:00.475861 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.475820    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc"]
Jul 20 12:45:00.507885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.507861    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"]
Jul 20 12:45:00.508025 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.507976    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc"
Jul 20 12:45:00.509891 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.509865    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 20 12:45:00.510129 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.510112    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 20 12:45:00.510209 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.510133    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 20 12:45:00.510209 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.510171    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 20 12:45:00.510322 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.510301    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bl5kk\""
Jul 20 12:45:00.521901 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.521880    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc"]
Jul 20 12:45:00.522051 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.521919    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"]
Jul 20 12:45:00.522051 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.521992    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:00.523815 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.523793    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 20 12:45:00.523937 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.523824    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 12:45:00.524262 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.524240    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 12:45:00.524351 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.524284    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6wrp7\""
Jul 20 12:45:00.525136 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.525121    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 20 12:45:00.586345 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.586316    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-pflw4"]
Jul 20 12:45:00.607782 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.607760    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"]
Jul 20 12:45:00.607906 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.607877    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.612894 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.612875    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 20 12:45:00.615431 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.615413    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-885ns\""
Jul 20 12:45:00.616229 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.616213    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 12:45:00.616380 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.616364    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 12:45:00.617809 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.617794    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 20 12:45:00.623888 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.623866    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-pflw4"]
Jul 20 12:45:00.623969 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.623938    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"
Jul 20 12:45:00.628523 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.628504    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 20 12:45:00.629437 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.629417    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8wst8\""
Jul 20 12:45:00.629920 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.629904    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 20 12:45:00.631671 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.631656    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 20 12:45:00.632524 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.632506    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 20 12:45:00.632647 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.632614    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"]
Jul 20 12:45:00.651861 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.651833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzzzz\" (UniqueName: \"kubernetes.io/projected/18ee5454-ba9f-4e21-b351-e76d4a48143d-kube-api-access-bzzzz\") pod \"service-ca-operator-5bcbc94c78-4rwhc\" (UID: \"18ee5454-ba9f-4e21-b351-e76d4a48143d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc"
Jul 20 12:45:00.651953 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.651869    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tnk2\" (UniqueName: \"kubernetes.io/projected/5cbd3fd4-9a3b-4076-9179-40314357c9d9-kube-api-access-2tnk2\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:00.652014 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.651965    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18ee5454-ba9f-4e21-b351-e76d4a48143d-config\") pod \"service-ca-operator-5bcbc94c78-4rwhc\" (UID: \"18ee5454-ba9f-4e21-b351-e76d4a48143d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc"
Jul 20 12:45:00.652014 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.651991    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5cbd3fd4-9a3b-4076-9179-40314357c9d9-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:00.652115 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.652048    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:00.652115 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.652089    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18ee5454-ba9f-4e21-b351-e76d4a48143d-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4rwhc\" (UID: \"18ee5454-ba9f-4e21-b351-e76d4a48143d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc"
Jul 20 12:45:00.753357 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753297    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c829d12-c2b9-4335-bc78-65693d34da89-service-ca-bundle\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.753357 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753341    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18ee5454-ba9f-4e21-b351-e76d4a48143d-config\") pod \"service-ca-operator-5bcbc94c78-4rwhc\" (UID: \"18ee5454-ba9f-4e21-b351-e76d4a48143d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc"
Jul 20 12:45:00.753525 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753475    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18ee5454-ba9f-4e21-b351-e76d4a48143d-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4rwhc\" (UID: \"18ee5454-ba9f-4e21-b351-e76d4a48143d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc"
Jul 20 12:45:00.753525 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753514    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljgmq\" (UniqueName: \"kubernetes.io/projected/9c829d12-c2b9-4335-bc78-65693d34da89-kube-api-access-ljgmq\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.753656 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753558    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c829d12-c2b9-4335-bc78-65693d34da89-tmp\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.753656 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753590    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5gd6s\" (UID: \"37e0c262-015c-40d3-8323-ee404c8beb8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"
Jul 20 12:45:00.753656 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753640    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tnk2\" (UniqueName: \"kubernetes.io/projected/5cbd3fd4-9a3b-4076-9179-40314357c9d9-kube-api-access-2tnk2\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:00.753797 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753681    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzzzz\" (UniqueName: \"kubernetes.io/projected/18ee5454-ba9f-4e21-b351-e76d4a48143d-kube-api-access-bzzzz\") pod \"service-ca-operator-5bcbc94c78-4rwhc\" (UID: \"18ee5454-ba9f-4e21-b351-e76d4a48143d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc"
Jul 20 12:45:00.753797 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753716    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:00.753797 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753744    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5cbd3fd4-9a3b-4076-9179-40314357c9d9-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:00.753797 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753766    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c829d12-c2b9-4335-bc78-65693d34da89-serving-cert\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.753976 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753804    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c829d12-c2b9-4335-bc78-65693d34da89-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.753976 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753828    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18ee5454-ba9f-4e21-b351-e76d4a48143d-config\") pod \"service-ca-operator-5bcbc94c78-4rwhc\" (UID: \"18ee5454-ba9f-4e21-b351-e76d4a48143d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc"
Jul 20 12:45:00.753976 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:00.753843    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 12:45:00.753976 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753843    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkm2c\" (UniqueName: \"kubernetes.io/projected/37e0c262-015c-40d3-8323-ee404c8beb8b-kube-api-access-gkm2c\") pod \"cluster-samples-operator-79b7c55f87-5gd6s\" (UID: \"37e0c262-015c-40d3-8323-ee404c8beb8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"
Jul 20 12:45:00.753976 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:00.753900    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls podName:5cbd3fd4-9a3b-4076-9179-40314357c9d9 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:01.253883383 +0000 UTC m=+46.386866473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2lqkh" (UID: "5cbd3fd4-9a3b-4076-9179-40314357c9d9") : secret "cluster-monitoring-operator-tls" not found
Jul 20 12:45:00.754161 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.753971    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9c829d12-c2b9-4335-bc78-65693d34da89-snapshots\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.754418 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.754392    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5cbd3fd4-9a3b-4076-9179-40314357c9d9-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:00.757542 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.757526    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18ee5454-ba9f-4e21-b351-e76d4a48143d-serving-cert\") pod \"service-ca-operator-5bcbc94c78-4rwhc\" (UID: \"18ee5454-ba9f-4e21-b351-e76d4a48143d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc"
Jul 20 12:45:00.761192 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.761169    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzzzz\" (UniqueName: \"kubernetes.io/projected/18ee5454-ba9f-4e21-b351-e76d4a48143d-kube-api-access-bzzzz\") pod \"service-ca-operator-5bcbc94c78-4rwhc\" (UID: \"18ee5454-ba9f-4e21-b351-e76d4a48143d\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc"
Jul 20 12:45:00.761550 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.761526    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tnk2\" (UniqueName: \"kubernetes.io/projected/5cbd3fd4-9a3b-4076-9179-40314357c9d9-kube-api-access-2tnk2\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:00.816504 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.816475    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc"
Jul 20 12:45:00.855231 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.855204    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljgmq\" (UniqueName: \"kubernetes.io/projected/9c829d12-c2b9-4335-bc78-65693d34da89-kube-api-access-ljgmq\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.855331 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.855263    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c829d12-c2b9-4335-bc78-65693d34da89-tmp\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.855331 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.855292    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5gd6s\" (UID: \"37e0c262-015c-40d3-8323-ee404c8beb8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"
Jul 20 12:45:00.855440 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.855348    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c829d12-c2b9-4335-bc78-65693d34da89-serving-cert\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.855440 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.855382    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c829d12-c2b9-4335-bc78-65693d34da89-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.855440 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.855418    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkm2c\" (UniqueName: \"kubernetes.io/projected/37e0c262-015c-40d3-8323-ee404c8beb8b-kube-api-access-gkm2c\") pod \"cluster-samples-operator-79b7c55f87-5gd6s\" (UID: \"37e0c262-015c-40d3-8323-ee404c8beb8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"
Jul 20 12:45:00.855440 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:00.855421    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 12:45:00.855647 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.855446    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9c829d12-c2b9-4335-bc78-65693d34da89-snapshots\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.855647 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:00.855497    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls podName:37e0c262-015c-40d3-8323-ee404c8beb8b nodeName:}" failed. No retries permitted until 2026-07-20 12:45:01.355475963 +0000 UTC m=+46.488459059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5gd6s" (UID: "37e0c262-015c-40d3-8323-ee404c8beb8b") : secret "samples-operator-tls" not found
Jul 20 12:45:00.855647 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.855521    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c829d12-c2b9-4335-bc78-65693d34da89-service-ca-bundle\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.855824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.855688    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c829d12-c2b9-4335-bc78-65693d34da89-tmp\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.856020 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.855970    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9c829d12-c2b9-4335-bc78-65693d34da89-snapshots\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.856334 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.856279    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c829d12-c2b9-4335-bc78-65693d34da89-service-ca-bundle\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.856393 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.856376    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c829d12-c2b9-4335-bc78-65693d34da89-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.857757 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.857737    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c829d12-c2b9-4335-bc78-65693d34da89-serving-cert\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.863630 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.863593    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkm2c\" (UniqueName: \"kubernetes.io/projected/37e0c262-015c-40d3-8323-ee404c8beb8b-kube-api-access-gkm2c\") pod \"cluster-samples-operator-79b7c55f87-5gd6s\" (UID: \"37e0c262-015c-40d3-8323-ee404c8beb8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"
Jul 20 12:45:00.863770 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.863749    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljgmq\" (UniqueName: \"kubernetes.io/projected/9c829d12-c2b9-4335-bc78-65693d34da89-kube-api-access-ljgmq\") pod \"insights-operator-555d9d7885-pflw4\" (UID: \"9c829d12-c2b9-4335-bc78-65693d34da89\") " pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.926140 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.926105    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-pflw4"
Jul 20 12:45:00.968491 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:00.968455    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc"]
Jul 20 12:45:00.971297 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:45:00.971271    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ee5454_ba9f_4e21_b351_e76d4a48143d.slice/crio-2e32f2d8a493f061adb7092d4e87fd530b016d806c23b1efa5f47a81a390923d WatchSource:0}: Error finding container 2e32f2d8a493f061adb7092d4e87fd530b016d806c23b1efa5f47a81a390923d: Status 404 returned error can't find the container with id 2e32f2d8a493f061adb7092d4e87fd530b016d806c23b1efa5f47a81a390923d
Jul 20 12:45:01.054160 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:01.054128    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-pflw4"]
Jul 20 12:45:01.057324 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:45:01.057299    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c829d12_c2b9_4335_bc78_65693d34da89.slice/crio-1dc6f8c7aaed3f993a022f68b423fcec9533b3146a64549e867602a9ee989bf3 WatchSource:0}: Error finding container 1dc6f8c7aaed3f993a022f68b423fcec9533b3146a64549e867602a9ee989bf3: Status 404 returned error can't find the container with id 1dc6f8c7aaed3f993a022f68b423fcec9533b3146a64549e867602a9ee989bf3
Jul 20 12:45:01.259349 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:01.259310    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:01.259508 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:01.259436    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 12:45:01.259508 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:01.259496    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls podName:5cbd3fd4-9a3b-4076-9179-40314357c9d9 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:02.259481963 +0000 UTC m=+47.392465041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2lqkh" (UID: "5cbd3fd4-9a3b-4076-9179-40314357c9d9") : secret "cluster-monitoring-operator-tls" not found
Jul 20 12:45:01.360406 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:01.360375    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5gd6s\" (UID: \"37e0c262-015c-40d3-8323-ee404c8beb8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"
Jul 20 12:45:01.360543 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:01.360517    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 12:45:01.360592 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:01.360580    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls podName:37e0c262-015c-40d3-8323-ee404c8beb8b nodeName:}" failed. No retries permitted until 2026-07-20 12:45:02.360564737 +0000 UTC m=+47.493547814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5gd6s" (UID: "37e0c262-015c-40d3-8323-ee404c8beb8b") : secret "samples-operator-tls" not found
Jul 20 12:45:01.627045 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:01.626962    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc" event={"ID":"18ee5454-ba9f-4e21-b351-e76d4a48143d","Type":"ContainerStarted","Data":"2e32f2d8a493f061adb7092d4e87fd530b016d806c23b1efa5f47a81a390923d"}
Jul 20 12:45:01.627946 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:01.627922    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-pflw4" event={"ID":"9c829d12-c2b9-4335-bc78-65693d34da89","Type":"ContainerStarted","Data":"1dc6f8c7aaed3f993a022f68b423fcec9533b3146a64549e867602a9ee989bf3"}
Jul 20 12:45:02.267168 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:02.267134    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:02.267330 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:02.267305    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 12:45:02.267402 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:02.267386    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls podName:5cbd3fd4-9a3b-4076-9179-40314357c9d9 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:04.267365321 +0000 UTC m=+49.400348424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2lqkh" (UID: "5cbd3fd4-9a3b-4076-9179-40314357c9d9") : secret "cluster-monitoring-operator-tls" not found
Jul 20 12:45:02.367853 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:02.367814    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5gd6s\" (UID: \"37e0c262-015c-40d3-8323-ee404c8beb8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"
Jul 20 12:45:02.368030 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:02.367994    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 12:45:02.368104 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:02.368069    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls podName:37e0c262-015c-40d3-8323-ee404c8beb8b nodeName:}" failed. No retries permitted until 2026-07-20 12:45:04.368047708 +0000 UTC m=+49.501030788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5gd6s" (UID: "37e0c262-015c-40d3-8323-ee404c8beb8b") : secret "samples-operator-tls" not found
Jul 20 12:45:04.286542 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:04.286490    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:04.286944 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:04.286679    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 12:45:04.286944 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:04.286744    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls podName:5cbd3fd4-9a3b-4076-9179-40314357c9d9 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:08.286728565 +0000 UTC m=+53.419711644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2lqkh" (UID: "5cbd3fd4-9a3b-4076-9179-40314357c9d9") : secret "cluster-monitoring-operator-tls" not found
Jul 20 12:45:04.387821 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:04.387794    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5gd6s\" (UID: \"37e0c262-015c-40d3-8323-ee404c8beb8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"
Jul 20 12:45:04.387969 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:04.387948    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 12:45:04.388026 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:04.388016    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls podName:37e0c262-015c-40d3-8323-ee404c8beb8b nodeName:}" failed. No retries permitted until 2026-07-20 12:45:08.387998628 +0000 UTC m=+53.520981705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5gd6s" (UID: "37e0c262-015c-40d3-8323-ee404c8beb8b") : secret "samples-operator-tls" not found
Jul 20 12:45:04.637997 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:04.637959    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-pflw4" event={"ID":"9c829d12-c2b9-4335-bc78-65693d34da89","Type":"ContainerStarted","Data":"fef5fdb3f5d3b7c3a5fd31be49318b5e51eca3fef911d304e0c0b079ab1ddadb"}
Jul 20 12:45:04.639363 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:04.639338    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc" event={"ID":"18ee5454-ba9f-4e21-b351-e76d4a48143d","Type":"ContainerStarted","Data":"a5624cc754f8c94abb0727eff83530e9dc34aa68229c5ef9e8aa21a0fc2cd352"}
Jul 20 12:45:04.654542 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:04.654484    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-pflw4" podStartSLOduration=1.277592961 podStartE2EDuration="4.654465571s" totalImagesPullingTime="3.37687261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:04.653653231 +0000 UTC m=+49.786636328" watchObservedRunningTime="2026-07-20 12:45:04.654465571 +0000 UTC m=+49.787448675"
Jul 20 12:45:04.667138 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:04.667098    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc" podStartSLOduration=1.21058094 podStartE2EDuration="4.667083198s" totalImagesPullingTime="3.456502258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:04.666186879 +0000 UTC m=+49.799169980" watchObservedRunningTime="2026-07-20 12:45:04.667083198 +0000 UTC m=+49.800066330"
Jul 20 12:45:05.595651 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:05.595606    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:45:05.596125 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:05.595706    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:45:05.596125 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:05.595780    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 12:45:05.596125 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:05.595809    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67fdbc7bc9-k66r4: secret "image-registry-tls" not found
Jul 20 12:45:05.596125 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:05.595795    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 12:45:05.596125 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:05.595870    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls podName:0c1b8953-bf93-46e6-9442-fd38a3d9412c nodeName:}" failed. No retries permitted until 2026-07-20 12:45:21.595851005 +0000 UTC m=+66.728834084 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls") pod "image-registry-67fdbc7bc9-k66r4" (UID: "0c1b8953-bf93-46e6-9442-fd38a3d9412c") : secret "image-registry-tls" not found
Jul 20 12:45:05.596125 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:05.595917    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls podName:10bcc69c-4bb6-4c9e-8120-8745ad7c2784 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:21.595906293 +0000 UTC m=+66.728889371 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls") pod "dns-default-5fzgt" (UID: "10bcc69c-4bb6-4c9e-8120-8745ad7c2784") : secret "dns-default-metrics-tls" not found
Jul 20 12:45:05.908211 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:05.908129    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7jz9z"]
Jul 20 12:45:05.929690 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:05.929658    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7jz9z"]
Jul 20 12:45:05.929834 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:05.929766    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:05.931858 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:05.931836    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 12:45:05.931967 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:05.931880    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 12:45:05.932189 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:05.932173    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wcv98\""
Jul 20 12:45:06.000089 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.000048    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbxfk\" (UniqueName: \"kubernetes.io/projected/2d1d58ae-a9ab-4354-8c70-a070e4f49955-kube-api-access-dbxfk\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.000261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.000108    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.000261 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.000165    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d1d58ae-a9ab-4354-8c70-a070e4f49955-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.000371 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.000301    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d1d58ae-a9ab-4354-8c70-a070e4f49955-crio-socket\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.000371 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.000349    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d1d58ae-a9ab-4354-8c70-a070e4f49955-data-volume\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.101523 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.101486    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d1d58ae-a9ab-4354-8c70-a070e4f49955-crio-socket\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.101755 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.101547    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d1d58ae-a9ab-4354-8c70-a070e4f49955-data-volume\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.101755 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.101585    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbxfk\" (UniqueName: \"kubernetes.io/projected/2d1d58ae-a9ab-4354-8c70-a070e4f49955-kube-api-access-dbxfk\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.101755 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.101605    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.101755 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.101643    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d1d58ae-a9ab-4354-8c70-a070e4f49955-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.101755 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.101701    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d1d58ae-a9ab-4354-8c70-a070e4f49955-crio-socket\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.102047 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:06.101753    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 12:45:06.102047 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:06.101828    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls podName:2d1d58ae-a9ab-4354-8c70-a070e4f49955 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:06.601808109 +0000 UTC m=+51.734791187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7jz9z" (UID: "2d1d58ae-a9ab-4354-8c70-a070e4f49955") : secret "insights-runtime-extractor-tls" not found
Jul 20 12:45:06.102047 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.101976    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d1d58ae-a9ab-4354-8c70-a070e4f49955-data-volume\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.102224 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.102209    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d1d58ae-a9ab-4354-8c70-a070e4f49955-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.114834 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.114811    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbxfk\" (UniqueName: \"kubernetes.io/projected/2d1d58ae-a9ab-4354-8c70-a070e4f49955-kube-api-access-dbxfk\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.606745 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:06.606712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:06.607306 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:06.606883    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 12:45:06.607306 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:06.606976    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls podName:2d1d58ae-a9ab-4354-8c70-a070e4f49955 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:07.606953921 +0000 UTC m=+52.739937019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7jz9z" (UID: "2d1d58ae-a9ab-4354-8c70-a070e4f49955") : secret "insights-runtime-extractor-tls" not found
Jul 20 12:45:07.408036 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:07.408003    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6gs6j"]
Jul 20 12:45:07.421074 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:07.421045    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6gs6j"]
Jul 20 12:45:07.421233 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:07.421145    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6gs6j"
Jul 20 12:45:07.423283 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:07.423258    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 20 12:45:07.423778 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:07.423758    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-twn6n\""
Jul 20 12:45:07.423860 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:07.423760    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 20 12:45:07.515728 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:07.515683    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kch72\" (UniqueName: \"kubernetes.io/projected/76d62d7c-b918-4610-a496-ffc02e02c958-kube-api-access-kch72\") pod \"migrator-7cc9c7ffd7-6gs6j\" (UID: \"76d62d7c-b918-4610-a496-ffc02e02c958\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6gs6j"
Jul 20 12:45:07.616848 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:07.616821    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:07.617173 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:07.616854    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kch72\" (UniqueName: \"kubernetes.io/projected/76d62d7c-b918-4610-a496-ffc02e02c958-kube-api-access-kch72\") pod \"migrator-7cc9c7ffd7-6gs6j\" (UID: \"76d62d7c-b918-4610-a496-ffc02e02c958\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6gs6j"
Jul 20 12:45:07.617173 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:07.616971    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 12:45:07.617173 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:07.617039    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls podName:2d1d58ae-a9ab-4354-8c70-a070e4f49955 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:09.617024379 +0000 UTC m=+54.750007456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7jz9z" (UID: "2d1d58ae-a9ab-4354-8c70-a070e4f49955") : secret "insights-runtime-extractor-tls" not found
Jul 20 12:45:07.625459 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:07.625438    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kch72\" (UniqueName: \"kubernetes.io/projected/76d62d7c-b918-4610-a496-ffc02e02c958-kube-api-access-kch72\") pod \"migrator-7cc9c7ffd7-6gs6j\" (UID: \"76d62d7c-b918-4610-a496-ffc02e02c958\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6gs6j"
Jul 20 12:45:07.730242 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:07.730185    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6gs6j"
Jul 20 12:45:07.801026 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:07.801000    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zfnzx_aa98a74e-b651-463c-b67c-d1cb18bad0f3/dns-node-resolver/0.log"
Jul 20 12:45:07.867829 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:07.867801    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6gs6j"]
Jul 20 12:45:07.885126 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:45:07.885094    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76d62d7c_b918_4610_a496_ffc02e02c958.slice/crio-2f7b33a642600919662f787c368a2df09e725f49c4cc2bbf8ff4b68d763a9ec9 WatchSource:0}: Error finding container 2f7b33a642600919662f787c368a2df09e725f49c4cc2bbf8ff4b68d763a9ec9: Status 404 returned error can't find the container with id 2f7b33a642600919662f787c368a2df09e725f49c4cc2bbf8ff4b68d763a9ec9
Jul 20 12:45:08.323671 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:08.323640    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:08.323831 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:08.323750    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 12:45:08.323831 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:08.323802    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls podName:5cbd3fd4-9a3b-4076-9179-40314357c9d9 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:16.323789399 +0000 UTC m=+61.456772477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2lqkh" (UID: "5cbd3fd4-9a3b-4076-9179-40314357c9d9") : secret "cluster-monitoring-operator-tls" not found
Jul 20 12:45:08.424210 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:08.424175    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5gd6s\" (UID: \"37e0c262-015c-40d3-8323-ee404c8beb8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"
Jul 20 12:45:08.424374 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:08.424297    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 20 12:45:08.424374 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:08.424355    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls podName:37e0c262-015c-40d3-8323-ee404c8beb8b nodeName:}" failed. No retries permitted until 2026-07-20 12:45:16.424340236 +0000 UTC m=+61.557323314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-5gd6s" (UID: "37e0c262-015c-40d3-8323-ee404c8beb8b") : secret "samples-operator-tls" not found
Jul 20 12:45:08.601561 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:08.601492    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n85wg_f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7/node-ca/0.log"
Jul 20 12:45:08.650325 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:08.650287    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6gs6j" event={"ID":"76d62d7c-b918-4610-a496-ffc02e02c958","Type":"ContainerStarted","Data":"2f7b33a642600919662f787c368a2df09e725f49c4cc2bbf8ff4b68d763a9ec9"}
Jul 20 12:45:09.400979 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:09.400952    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pv4fk_e4067e76-be14-4847-8a2e-de8c8377c7e0/serve-healthcheck-canary/0.log"
Jul 20 12:45:09.635350 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:09.635305    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:09.635534 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:09.635453    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 12:45:09.635534 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:09.635518    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls podName:2d1d58ae-a9ab-4354-8c70-a070e4f49955 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:13.635503905 +0000 UTC m=+58.768486982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7jz9z" (UID: "2d1d58ae-a9ab-4354-8c70-a070e4f49955") : secret "insights-runtime-extractor-tls" not found
Jul 20 12:45:09.654585 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:09.654561    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6gs6j" event={"ID":"76d62d7c-b918-4610-a496-ffc02e02c958","Type":"ContainerStarted","Data":"0e7828e04556a44772aea8dcc74aea721d50e1cce54c1d68f0c46522e9e3b1eb"}
Jul 20 12:45:09.654913 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:09.654605    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6gs6j" event={"ID":"76d62d7c-b918-4610-a496-ffc02e02c958","Type":"ContainerStarted","Data":"fe1a7f1673e63ccbb37cd33d5a05fd1f08d36f58e862c2f22b33a86ebcd6f0ca"}
Jul 20 12:45:09.670740 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:09.670701    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6gs6j" podStartSLOduration=1.347969287 podStartE2EDuration="2.67068614s" totalImagesPullingTime="1.322716853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:09.669916174 +0000 UTC m=+54.802899274" watchObservedRunningTime="2026-07-20 12:45:09.67068614 +0000 UTC m=+54.803669240"
Jul 20 12:45:13.669324 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:13.669292    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:13.669788 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:13.669432    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 12:45:13.669788 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:13.669501    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls podName:2d1d58ae-a9ab-4354-8c70-a070e4f49955 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:21.669485676 +0000 UTC m=+66.802468755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7jz9z" (UID: "2d1d58ae-a9ab-4354-8c70-a070e4f49955") : secret "insights-runtime-extractor-tls" not found
Jul 20 12:45:16.391255 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:16.391215    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:16.391769 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:16.391386    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 12:45:16.391769 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:16.391457    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls podName:5cbd3fd4-9a3b-4076-9179-40314357c9d9 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:32.391438388 +0000 UTC m=+77.524421466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-2lqkh" (UID: "5cbd3fd4-9a3b-4076-9179-40314357c9d9") : secret "cluster-monitoring-operator-tls" not found
Jul 20 12:45:16.492202 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:16.492138    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5gd6s\" (UID: \"37e0c262-015c-40d3-8323-ee404c8beb8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"
Jul 20 12:45:16.494431 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:16.494401    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/37e0c262-015c-40d3-8323-ee404c8beb8b-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-5gd6s\" (UID: \"37e0c262-015c-40d3-8323-ee404c8beb8b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"
Jul 20 12:45:16.534652 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:16.534606    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8wst8\""
Jul 20 12:45:16.543400 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:16.543380    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"
Jul 20 12:45:16.589664 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:16.589636    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-chtb7"
Jul 20 12:45:16.659179 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:16.659117    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s"]
Jul 20 12:45:17.675856 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:17.675817    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s" event={"ID":"37e0c262-015c-40d3-8323-ee404c8beb8b","Type":"ContainerStarted","Data":"537773b4e82911bd80492a12af7797433052c3d479171ba93f500f3d1090df82"}
Jul 20 12:45:18.680558 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:18.680529    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s" event={"ID":"37e0c262-015c-40d3-8323-ee404c8beb8b","Type":"ContainerStarted","Data":"d1434918e2bd5329d1b56061ac9f8ca4ac5cc524be6696f15e42398289670d3f"}
Jul 20 12:45:19.684869 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:19.684828    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s" event={"ID":"37e0c262-015c-40d3-8323-ee404c8beb8b","Type":"ContainerStarted","Data":"8e54437615ae0a2f1bc95a094b7fa9b6163a19df75797154ab9c04749a143f2f"}
Jul 20 12:45:19.700479 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:19.700431    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-5gd6s" podStartSLOduration=17.777067786 podStartE2EDuration="19.700417052s" totalImagesPullingTime="1.923349266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:19.699606225 +0000 UTC m=+64.832589327" watchObservedRunningTime="2026-07-20 12:45:19.700417052 +0000 UTC m=+64.833400151"
Jul 20 12:45:21.128679 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.128631    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:45:21.131022 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.131005    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 12:45:21.141692 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.141665    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bbd5447-6fb8-45a5-bf3f-ecb313480f2b-original-pull-secret\") pod \"global-pull-secret-syncer-h4x68\" (UID: \"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b\") " pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:45:21.229057 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.229023    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs\") pod \"network-metrics-daemon-j62gp\" (UID: \"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd\") " pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:45:21.229057 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.229063    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nplsg\" (UniqueName: \"kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg\") pod \"network-check-target-zhxk9\" (UID: \"16ada65b-ff10-46fe-8477-f9fc9f101d29\") " pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:45:21.231115 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.231097    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 12:45:21.231168 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.231104    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 12:45:21.241743 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.241724    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 12:45:21.241826 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.241801    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c44e5f72-2a44-4fc6-bcac-56ce085e2bdd-metrics-certs\") pod \"network-metrics-daemon-j62gp\" (UID: \"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd\") " pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:45:21.252219 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.252193    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nplsg\" (UniqueName: \"kubernetes.io/projected/16ada65b-ff10-46fe-8477-f9fc9f101d29-kube-api-access-nplsg\") pod \"network-check-target-zhxk9\" (UID: \"16ada65b-ff10-46fe-8477-f9fc9f101d29\") " pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:45:21.287211 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.287194    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h4x68"
Jul 20 12:45:21.296905 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.296884    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cg6n8\""
Jul 20 12:45:21.303441 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.303422    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pvfjj\""
Jul 20 12:45:21.306022 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.306002    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:45:21.311737 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.311719    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j62gp"
Jul 20 12:45:21.434148 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.434119    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h4x68"]
Jul 20 12:45:21.437578 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.437552    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zhxk9"]
Jul 20 12:45:21.437846 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:45:21.437822    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bbd5447_6fb8_45a5_bf3f_ecb313480f2b.slice/crio-598e0598bc5ce694d84f373d638dd64dfd1e0cd5be6e15c42c32bcbd0170e3b2 WatchSource:0}: Error finding container 598e0598bc5ce694d84f373d638dd64dfd1e0cd5be6e15c42c32bcbd0170e3b2: Status 404 returned error can't find the container with id 598e0598bc5ce694d84f373d638dd64dfd1e0cd5be6e15c42c32bcbd0170e3b2
Jul 20 12:45:21.440535 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:45:21.440512    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ada65b_ff10_46fe_8477_f9fc9f101d29.slice/crio-41a3bfa1d7abaea1516b233653d81a614562dd744bf1bfbba9133746893dc8de WatchSource:0}: Error finding container 41a3bfa1d7abaea1516b233653d81a614562dd744bf1bfbba9133746893dc8de: Status 404 returned error can't find the container with id 41a3bfa1d7abaea1516b233653d81a614562dd744bf1bfbba9133746893dc8de
Jul 20 12:45:21.463829 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.463808    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j62gp"]
Jul 20 12:45:21.466056 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:45:21.466032    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc44e5f72_2a44_4fc6_bcac_56ce085e2bdd.slice/crio-b9905b98e02b10f2009090ac60ab3c7151a7b36e941f004ce21df74860ad4860 WatchSource:0}: Error finding container b9905b98e02b10f2009090ac60ab3c7151a7b36e941f004ce21df74860ad4860: Status 404 returned error can't find the container with id b9905b98e02b10f2009090ac60ab3c7151a7b36e941f004ce21df74860ad4860
Jul 20 12:45:21.631817 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.631792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:45:21.631919 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.631837    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:45:21.633988 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.633966    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/10bcc69c-4bb6-4c9e-8120-8745ad7c2784-metrics-tls\") pod \"dns-default-5fzgt\" (UID: \"10bcc69c-4bb6-4c9e-8120-8745ad7c2784\") " pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:45:21.634198 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.634181    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls\") pod \"image-registry-67fdbc7bc9-k66r4\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") " pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:45:21.690700 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.690637    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j62gp" event={"ID":"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd","Type":"ContainerStarted","Data":"b9905b98e02b10f2009090ac60ab3c7151a7b36e941f004ce21df74860ad4860"}
Jul 20 12:45:21.691637 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.691603    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zhxk9" event={"ID":"16ada65b-ff10-46fe-8477-f9fc9f101d29","Type":"ContainerStarted","Data":"41a3bfa1d7abaea1516b233653d81a614562dd744bf1bfbba9133746893dc8de"}
Jul 20 12:45:21.692711 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.692694    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h4x68" event={"ID":"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b","Type":"ContainerStarted","Data":"598e0598bc5ce694d84f373d638dd64dfd1e0cd5be6e15c42c32bcbd0170e3b2"}
Jul 20 12:45:21.732298 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.732275    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:21.734221 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.734198    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d1d58ae-a9ab-4354-8c70-a070e4f49955-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jz9z\" (UID: \"2d1d58ae-a9ab-4354-8c70-a070e4f49955\") " pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:21.838453 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.838436    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4nbld\""
Jul 20 12:45:21.843493 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.843476    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wcv98\""
Jul 20 12:45:21.846978 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.846963    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:45:21.847420 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.847406    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dcf82\""
Jul 20 12:45:21.852110 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.852096    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7jz9z"
Jul 20 12:45:21.856321 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:21.856304    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:45:22.012178 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:22.011995    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67fdbc7bc9-k66r4"]
Jul 20 12:45:22.016805 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:45:22.016774    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c1b8953_bf93_46e6_9442_fd38a3d9412c.slice/crio-cb4004fdce5e84f1b2117824501f098e2477e9b31fd359f1d7b258bdf3ec5f92 WatchSource:0}: Error finding container cb4004fdce5e84f1b2117824501f098e2477e9b31fd359f1d7b258bdf3ec5f92: Status 404 returned error can't find the container with id cb4004fdce5e84f1b2117824501f098e2477e9b31fd359f1d7b258bdf3ec5f92
Jul 20 12:45:22.040605 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:22.040578    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7jz9z"]
Jul 20 12:45:22.044894 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:45:22.044858    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1d58ae_a9ab_4354_8c70_a070e4f49955.slice/crio-04850ac7d8a97a115720b3ae064a64c012115defd0f256df7503c038865ca195 WatchSource:0}: Error finding container 04850ac7d8a97a115720b3ae064a64c012115defd0f256df7503c038865ca195: Status 404 returned error can't find the container with id 04850ac7d8a97a115720b3ae064a64c012115defd0f256df7503c038865ca195
Jul 20 12:45:22.060829 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:22.060807    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5fzgt"]
Jul 20 12:45:22.064187 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:45:22.064160    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10bcc69c_4bb6_4c9e_8120_8745ad7c2784.slice/crio-1c6c55fd5b1c15975009c1b5431b20ac9a27e156e9f170dbf0590013153f5739 WatchSource:0}: Error finding container 1c6c55fd5b1c15975009c1b5431b20ac9a27e156e9f170dbf0590013153f5739: Status 404 returned error can't find the container with id 1c6c55fd5b1c15975009c1b5431b20ac9a27e156e9f170dbf0590013153f5739
Jul 20 12:45:22.700595 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:22.700435    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4" event={"ID":"0c1b8953-bf93-46e6-9442-fd38a3d9412c","Type":"ContainerStarted","Data":"0bca5238222f3057e9b3474663456d10cca69f18c10f3f0572b1a4b54faeac70"}
Jul 20 12:45:22.700595 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:22.700483    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4" event={"ID":"0c1b8953-bf93-46e6-9442-fd38a3d9412c","Type":"ContainerStarted","Data":"cb4004fdce5e84f1b2117824501f098e2477e9b31fd359f1d7b258bdf3ec5f92"}
Jul 20 12:45:22.701791 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:22.701284    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:45:22.702981 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:22.702915    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5fzgt" event={"ID":"10bcc69c-4bb6-4c9e-8120-8745ad7c2784","Type":"ContainerStarted","Data":"1c6c55fd5b1c15975009c1b5431b20ac9a27e156e9f170dbf0590013153f5739"}
Jul 20 12:45:22.705529 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:22.705464    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jz9z" event={"ID":"2d1d58ae-a9ab-4354-8c70-a070e4f49955","Type":"ContainerStarted","Data":"04850ac7d8a97a115720b3ae064a64c012115defd0f256df7503c038865ca195"}
Jul 20 12:45:22.721143 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:22.720800    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4" podStartSLOduration=67.720782201 podStartE2EDuration="1m7.720782201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:44:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:22.718770077 +0000 UTC m=+67.851753179" watchObservedRunningTime="2026-07-20 12:45:22.720782201 +0000 UTC m=+67.853765297"
Jul 20 12:45:23.715960 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:23.715865    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j62gp" event={"ID":"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd","Type":"ContainerStarted","Data":"4a08ae1c89e24c822ff17d87aa117c64ea0edd3ffecbe0fb956c5027d239aecc"}
Jul 20 12:45:23.715960 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:23.715918    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j62gp" event={"ID":"c44e5f72-2a44-4fc6-bcac-56ce085e2bdd","Type":"ContainerStarted","Data":"53b0a3a551d01358b39f5e40ed320ce64357f4bb8866fcaeec767a6bd8b6d944"}
Jul 20 12:45:23.734112 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:23.733924    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j62gp" podStartSLOduration=66.790487931 podStartE2EDuration="1m8.733903113s" totalImagesPullingTime="1.943415182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:23.732456728 +0000 UTC m=+68.865439826" watchObservedRunningTime="2026-07-20 12:45:23.733903113 +0000 UTC m=+68.866886213"
Jul 20 12:45:28.505986 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.505925    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"]
Jul 20 12:45:28.526299 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.526244    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"]
Jul 20 12:45:28.526472 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.526406    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"
Jul 20 12:45:28.530488 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.529690    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 20 12:45:28.530488 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.529939    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 12:45:28.530488 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.530169    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 12:45:28.530488 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.530346    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 12:45:28.531645 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.531423    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"]
Jul 20 12:45:28.531645 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.531464    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"]
Jul 20 12:45:28.531645 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.531557    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.533982 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.533483    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 20 12:45:28.533982 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.533578    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 20 12:45:28.533982 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.533775    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 20 12:45:28.533982 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.533829    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 20 12:45:28.592268 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.592231    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d355d5a1-5653-43e9-98bd-f3c6e3b31835-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.592436 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.592292    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d355d5a1-5653-43e9-98bd-f3c6e3b31835-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.592436 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.592352    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d355d5a1-5653-43e9-98bd-f3c6e3b31835-ca\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.592559 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.592459    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0f8f74de-2982-442e-9b3e-b4d70ce075ab-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b44d4fdcb-t92qg\" (UID: \"0f8f74de-2982-442e-9b3e-b4d70ce075ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"
Jul 20 12:45:28.592559 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.592493    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d355d5a1-5653-43e9-98bd-f3c6e3b31835-hub\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.592559 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.592537    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d355d5a1-5653-43e9-98bd-f3c6e3b31835-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.592723 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.592614    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9zmz\" (UniqueName: \"kubernetes.io/projected/d355d5a1-5653-43e9-98bd-f3c6e3b31835-kube-api-access-z9zmz\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.592723 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.592675    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f8f74de-2982-442e-9b3e-b4d70ce075ab-tmp\") pod \"klusterlet-addon-workmgr-6b44d4fdcb-t92qg\" (UID: \"0f8f74de-2982-442e-9b3e-b4d70ce075ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"
Jul 20 12:45:28.592723 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.592714    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q5lr\" (UniqueName: \"kubernetes.io/projected/0f8f74de-2982-442e-9b3e-b4d70ce075ab-kube-api-access-7q5lr\") pod \"klusterlet-addon-workmgr-6b44d4fdcb-t92qg\" (UID: \"0f8f74de-2982-442e-9b3e-b4d70ce075ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"
Jul 20 12:45:28.693522 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.693475    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9zmz\" (UniqueName: \"kubernetes.io/projected/d355d5a1-5653-43e9-98bd-f3c6e3b31835-kube-api-access-z9zmz\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.693522 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.693525    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f8f74de-2982-442e-9b3e-b4d70ce075ab-tmp\") pod \"klusterlet-addon-workmgr-6b44d4fdcb-t92qg\" (UID: \"0f8f74de-2982-442e-9b3e-b4d70ce075ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"
Jul 20 12:45:28.693775 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.693550    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q5lr\" (UniqueName: \"kubernetes.io/projected/0f8f74de-2982-442e-9b3e-b4d70ce075ab-kube-api-access-7q5lr\") pod \"klusterlet-addon-workmgr-6b44d4fdcb-t92qg\" (UID: \"0f8f74de-2982-442e-9b3e-b4d70ce075ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"
Jul 20 12:45:28.693775 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.693591    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d355d5a1-5653-43e9-98bd-f3c6e3b31835-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.693775 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.693641    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d355d5a1-5653-43e9-98bd-f3c6e3b31835-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.693775 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.693677    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d355d5a1-5653-43e9-98bd-f3c6e3b31835-ca\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.693775 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.693712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0f8f74de-2982-442e-9b3e-b4d70ce075ab-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b44d4fdcb-t92qg\" (UID: \"0f8f74de-2982-442e-9b3e-b4d70ce075ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"
Jul 20 12:45:28.693775 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.693739    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d355d5a1-5653-43e9-98bd-f3c6e3b31835-hub\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.693775 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.693766    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d355d5a1-5653-43e9-98bd-f3c6e3b31835-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.694117 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.693963    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f8f74de-2982-442e-9b3e-b4d70ce075ab-tmp\") pod \"klusterlet-addon-workmgr-6b44d4fdcb-t92qg\" (UID: \"0f8f74de-2982-442e-9b3e-b4d70ce075ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"
Jul 20 12:45:28.694507 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.694479    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d355d5a1-5653-43e9-98bd-f3c6e3b31835-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.696562 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.696540    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d355d5a1-5653-43e9-98bd-f3c6e3b31835-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.696774 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.696753    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d355d5a1-5653-43e9-98bd-f3c6e3b31835-hub\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.696868 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.696847    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0f8f74de-2982-442e-9b3e-b4d70ce075ab-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b44d4fdcb-t92qg\" (UID: \"0f8f74de-2982-442e-9b3e-b4d70ce075ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"
Jul 20 12:45:28.697490 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.697466    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d355d5a1-5653-43e9-98bd-f3c6e3b31835-ca\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.697670 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.697655    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d355d5a1-5653-43e9-98bd-f3c6e3b31835-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.716230 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.716203    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q5lr\" (UniqueName: \"kubernetes.io/projected/0f8f74de-2982-442e-9b3e-b4d70ce075ab-kube-api-access-7q5lr\") pod \"klusterlet-addon-workmgr-6b44d4fdcb-t92qg\" (UID: \"0f8f74de-2982-442e-9b3e-b4d70ce075ab\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"
Jul 20 12:45:28.733513 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.733465    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9zmz\" (UniqueName: \"kubernetes.io/projected/d355d5a1-5653-43e9-98bd-f3c6e3b31835-kube-api-access-z9zmz\") pod \"cluster-proxy-proxy-agent-5c79654976-tzbhv\" (UID: \"d355d5a1-5653-43e9-98bd-f3c6e3b31835\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:28.840789 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.840737    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"
Jul 20 12:45:28.854032 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:28.854000    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"
Jul 20 12:45:29.832382 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:29.832347    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"]
Jul 20 12:45:30.069013 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:45:30.068972    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f8f74de_2982_442e_9b3e_b4d70ce075ab.slice/crio-4580f66c889fa9d93a82faf7b63f16a7917fa3859e498c9feeb94d5b648545a5 WatchSource:0}: Error finding container 4580f66c889fa9d93a82faf7b63f16a7917fa3859e498c9feeb94d5b648545a5: Status 404 returned error can't find the container with id 4580f66c889fa9d93a82faf7b63f16a7917fa3859e498c9feeb94d5b648545a5
Jul 20 12:45:30.225692 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:30.225669    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv"]
Jul 20 12:45:30.229016 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:45:30.228982    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd355d5a1_5653_43e9_98bd_f3c6e3b31835.slice/crio-d760c01dcdbdc96e35377f6b70d6fe1fcc7b17b0e1d33d2eaf5fe81926381c4e WatchSource:0}: Error finding container d760c01dcdbdc96e35377f6b70d6fe1fcc7b17b0e1d33d2eaf5fe81926381c4e: Status 404 returned error can't find the container with id d760c01dcdbdc96e35377f6b70d6fe1fcc7b17b0e1d33d2eaf5fe81926381c4e
Jul 20 12:45:30.744112 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:30.744073    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zhxk9" event={"ID":"16ada65b-ff10-46fe-8477-f9fc9f101d29","Type":"ContainerStarted","Data":"c34faa15cdf705c0938384b35386c2c82ab56f89e33fd636f6949b215b15df2d"}
Jul 20 12:45:30.744275 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:30.744193    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:45:30.745966 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:30.745934    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h4x68" event={"ID":"5bbd5447-6fb8-45a5-bf3f-ecb313480f2b","Type":"ContainerStarted","Data":"8ab6142e7900c9dc83625440c13cd24dada78bd2c470c2757e62789ae40d2095"}
Jul 20 12:45:30.748247 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:30.748214    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5fzgt" event={"ID":"10bcc69c-4bb6-4c9e-8120-8745ad7c2784","Type":"ContainerStarted","Data":"63913aba41da49c7ba7ff4ed2d417fd5c5e5f6d1beae44b9627bf607a32a8170"}
Jul 20 12:45:30.748373 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:30.748264    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5fzgt" event={"ID":"10bcc69c-4bb6-4c9e-8120-8745ad7c2784","Type":"ContainerStarted","Data":"0bab1b48ecce59d2fe95a6ba1aa6b0ea529141e57ad0e411aa4b3f8dabd8995a"}
Jul 20 12:45:30.748373 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:30.748293    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:45:30.749874 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:30.749851    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jz9z" event={"ID":"2d1d58ae-a9ab-4354-8c70-a070e4f49955","Type":"ContainerStarted","Data":"efd8d79e84124abd837ba2183b0cd81e95e0bcf29e495d4406e1c01bef6667c0"}
Jul 20 12:45:30.751103 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:30.751079    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv" event={"ID":"d355d5a1-5653-43e9-98bd-f3c6e3b31835","Type":"ContainerStarted","Data":"d760c01dcdbdc96e35377f6b70d6fe1fcc7b17b0e1d33d2eaf5fe81926381c4e"}
Jul 20 12:45:30.752247 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:30.752226    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg" event={"ID":"0f8f74de-2982-442e-9b3e-b4d70ce075ab","Type":"ContainerStarted","Data":"4580f66c889fa9d93a82faf7b63f16a7917fa3859e498c9feeb94d5b648545a5"}
Jul 20 12:45:30.759740 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:30.759692    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zhxk9" podStartSLOduration=67.497367157 podStartE2EDuration="1m15.759676559s" totalImagesPullingTime="8.262309402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:30.758932459 +0000 UTC m=+75.891915562" watchObservedRunningTime="2026-07-20 12:45:30.759676559 +0000 UTC m=+75.892659661"
Jul 20 12:45:30.774946 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:30.774700    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h4x68" podStartSLOduration=67.14555538 podStartE2EDuration="1m15.77468221s" totalImagesPullingTime="8.62912683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:30.773196375 +0000 UTC m=+75.906179467" watchObservedRunningTime="2026-07-20 12:45:30.77468221 +0000 UTC m=+75.907665313"
Jul 20 12:45:30.789457 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:30.789411    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5fzgt" podStartSLOduration=34.150975494 podStartE2EDuration="41.789393883s" totalImagesPullingTime="7.638418389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:44:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:30.788638492 +0000 UTC m=+75.921621593" watchObservedRunningTime="2026-07-20 12:45:30.789393883 +0000 UTC m=+75.922376984"
Jul 20 12:45:32.427502 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:32.427020    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:32.432935 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:32.432880    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cbd3fd4-9a3b-4076-9179-40314357c9d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-2lqkh\" (UID: \"5cbd3fd4-9a3b-4076-9179-40314357c9d9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:32.631946 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:32.631740    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6wrp7\""
Jul 20 12:45:32.640495 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:32.640470    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"
Jul 20 12:45:37.528369 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:37.528298    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh"]
Jul 20 12:45:37.532518 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:45:37.532360    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cbd3fd4_9a3b_4076_9179_40314357c9d9.slice/crio-1e68f99403445de90f065c888daa85b6f6197706bdc82926cd21d803fd22cce9 WatchSource:0}: Error finding container 1e68f99403445de90f065c888daa85b6f6197706bdc82926cd21d803fd22cce9: Status 404 returned error can't find the container with id 1e68f99403445de90f065c888daa85b6f6197706bdc82926cd21d803fd22cce9
Jul 20 12:45:37.783202 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:37.783164    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jz9z" event={"ID":"2d1d58ae-a9ab-4354-8c70-a070e4f49955","Type":"ContainerStarted","Data":"2198a775a6266a0f31089fc74088fca0ceed2d4d34a8a84f55601ef9696084a9"}
Jul 20 12:45:37.785190 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:37.785156    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv" event={"ID":"d355d5a1-5653-43e9-98bd-f3c6e3b31835","Type":"ContainerStarted","Data":"a4d2e956bfaab5c0a625009bd15d86bf54d9c1bfc0ae62e80142dbe33755b591"}
Jul 20 12:45:37.785325 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:37.785201    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv" event={"ID":"d355d5a1-5653-43e9-98bd-f3c6e3b31835","Type":"ContainerStarted","Data":"3b39861ceb7f9a32104e8bc69ffec9d56201ede6918fbb0c816ee70f57b24438"}
Jul 20 12:45:37.785325 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:37.785214    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv" event={"ID":"d355d5a1-5653-43e9-98bd-f3c6e3b31835","Type":"ContainerStarted","Data":"81ef1bfe896ced0968d1dd284861a9471041a257933ee2ca3c97c981151ff7f2"}
Jul 20 12:45:37.786592 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:37.786557    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg" event={"ID":"0f8f74de-2982-442e-9b3e-b4d70ce075ab","Type":"ContainerStarted","Data":"b21cc34cd9d9a085a5f22fdc0992d6b7c54aec69e6eebd4d4e3174f3a20f8fc4"}
Jul 20 12:45:37.786780 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:37.786754    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"
Jul 20 12:45:37.787749 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:37.787723    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh" event={"ID":"5cbd3fd4-9a3b-4076-9179-40314357c9d9","Type":"ContainerStarted","Data":"1e68f99403445de90f065c888daa85b6f6197706bdc82926cd21d803fd22cce9"}
Jul 20 12:45:37.788732 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:37.788715    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg"
Jul 20 12:45:37.804474 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:37.804437    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c79654976-tzbhv" podStartSLOduration=2.654733766 podStartE2EDuration="9.804422781s" totalImagesPullingTime="7.149689015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:37.803205376 +0000 UTC m=+82.936188477" watchObservedRunningTime="2026-07-20 12:45:37.804422781 +0000 UTC m=+82.937405921"
Jul 20 12:45:37.818297 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:37.818256    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b44d4fdcb-t92qg" podStartSLOduration=2.508710164 podStartE2EDuration="9.818244187s" totalImagesPullingTime="7.309534023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:37.817198055 +0000 UTC m=+82.950181157" watchObservedRunningTime="2026-07-20 12:45:37.818244187 +0000 UTC m=+82.951227288"
Jul 20 12:45:40.760800 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:40.760771    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5fzgt"
Jul 20 12:45:41.804258 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:41.804150    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jz9z" event={"ID":"2d1d58ae-a9ab-4354-8c70-a070e4f49955","Type":"ContainerStarted","Data":"4c8e42e17e33bbab24f0fa54d22abf874a5c75dcef31e364334969eddffa214f"}
Jul 20 12:45:41.805661 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:41.805636    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh" event={"ID":"5cbd3fd4-9a3b-4076-9179-40314357c9d9","Type":"ContainerStarted","Data":"74514ff4842087f8fbe4bead0121fb27acdc323b89f0b6c115a6fff84640fd30"}
Jul 20 12:45:41.829971 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:41.829918    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7jz9z" podStartSLOduration=17.694509782 podStartE2EDuration="36.829902025s" totalImagesPullingTime="19.135392243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 12:45:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:41.828500383 +0000 UTC m=+86.961483484" watchObservedRunningTime="2026-07-20 12:45:41.829902025 +0000 UTC m=+86.962885122"
Jul 20 12:45:41.843395 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:41.843347    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-2lqkh" podStartSLOduration=38.057329495 podStartE2EDuration="41.843333031s" totalImagesPullingTime="3.786003536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:41.842381992 +0000 UTC m=+86.975365091" watchObservedRunningTime="2026-07-20 12:45:41.843333031 +0000 UTC m=+86.976316131"
Jul 20 12:45:41.851639 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:41.851588    2557 patch_prober.go:28] interesting pod/image-registry-67fdbc7bc9-k66r4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 20 12:45:41.851786 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:41.851663    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4" podUID="0c1b8953-bf93-46e6-9442-fd38a3d9412c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 12:45:44.723893 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:44.723864    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:45:50.961804 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:50.961769    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67fdbc7bc9-k66r4"]
Jul 20 12:45:53.233793 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.233762    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8rgnc"]
Jul 20 12:45:53.240089 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.240065    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.242794 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.242765    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 12:45:53.242952 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.242830    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 12:45:53.242952 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.242836    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 12:45:53.243093 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.243075    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ft8lg\""
Jul 20 12:45:53.244966 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.244949    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 12:45:53.391523 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.391493    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-tls\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.391675 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.391526    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fc36941-41db-4bf5-b1bf-05487f4c4337-metrics-client-ca\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.391675 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.391545    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-textfile\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.391675 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.391561    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-accelerators-collector-config\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.391675 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.391608    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fc36941-41db-4bf5-b1bf-05487f4c4337-sys\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.391815 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.391679    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.391815 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.391703    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0fc36941-41db-4bf5-b1bf-05487f4c4337-root\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.391815 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.391722    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lslj\" (UniqueName: \"kubernetes.io/projected/0fc36941-41db-4bf5-b1bf-05487f4c4337-kube-api-access-5lslj\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.391815 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.391751    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-wtmp\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.492821 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.492756    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fc36941-41db-4bf5-b1bf-05487f4c4337-sys\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.492935 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.492829    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.492935 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.492850    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0fc36941-41db-4bf5-b1bf-05487f4c4337-root\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.492935 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.492863    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fc36941-41db-4bf5-b1bf-05487f4c4337-sys\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.492935 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.492868    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lslj\" (UniqueName: \"kubernetes.io/projected/0fc36941-41db-4bf5-b1bf-05487f4c4337-kube-api-access-5lslj\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.492935 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.492930    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-wtmp\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.493113 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.492942    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0fc36941-41db-4bf5-b1bf-05487f4c4337-root\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.493113 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.492988    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-tls\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.493113 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.493013    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fc36941-41db-4bf5-b1bf-05487f4c4337-metrics-client-ca\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.493113 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.493032    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-textfile\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.493113 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.493048    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-accelerators-collector-config\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.493113 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.493057    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-wtmp\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.493443 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:53.493209    2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 20 12:45:53.493443 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:45:53.493270    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-tls podName:0fc36941-41db-4bf5-b1bf-05487f4c4337 nodeName:}" failed. No retries permitted until 2026-07-20 12:45:53.993252945 +0000 UTC m=+99.126236030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-tls") pod "node-exporter-8rgnc" (UID: "0fc36941-41db-4bf5-b1bf-05487f4c4337") : secret "node-exporter-tls" not found
Jul 20 12:45:53.493443 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.493382    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-textfile\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.493664 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.493643    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fc36941-41db-4bf5-b1bf-05487f4c4337-metrics-client-ca\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.493738 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.493709    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-accelerators-collector-config\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.495155 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.495135    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.503213 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.503193    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lslj\" (UniqueName: \"kubernetes.io/projected/0fc36941-41db-4bf5-b1bf-05487f4c4337-kube-api-access-5lslj\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.997390 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.997357    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-tls\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:53.999604 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:53.999581    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fc36941-41db-4bf5-b1bf-05487f4c4337-node-exporter-tls\") pod \"node-exporter-8rgnc\" (UID: \"0fc36941-41db-4bf5-b1bf-05487f4c4337\") " pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:54.149638 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:54.149596    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8rgnc"
Jul 20 12:45:54.162142 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:45:54.162117    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc36941_41db_4bf5_b1bf_05487f4c4337.slice/crio-a444ee98b9be5ea95b49d4330c52f878f12a121db8871a13004ecc235dabd1e6 WatchSource:0}: Error finding container a444ee98b9be5ea95b49d4330c52f878f12a121db8871a13004ecc235dabd1e6: Status 404 returned error can't find the container with id a444ee98b9be5ea95b49d4330c52f878f12a121db8871a13004ecc235dabd1e6
Jul 20 12:45:54.849814 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:54.849773    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8rgnc" event={"ID":"0fc36941-41db-4bf5-b1bf-05487f4c4337","Type":"ContainerStarted","Data":"a444ee98b9be5ea95b49d4330c52f878f12a121db8871a13004ecc235dabd1e6"}
Jul 20 12:45:55.854588 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:55.854484    2557 generic.go:356] "Generic (PLEG): container finished" podID="0fc36941-41db-4bf5-b1bf-05487f4c4337" containerID="d06dcd9d8f62c577ae98bd9d1d30dd2016c051b7fca15a997036757cd5c9e777" exitCode=0
Jul 20 12:45:55.854588 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:55.854567    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8rgnc" event={"ID":"0fc36941-41db-4bf5-b1bf-05487f4c4337","Type":"ContainerDied","Data":"d06dcd9d8f62c577ae98bd9d1d30dd2016c051b7fca15a997036757cd5c9e777"}
Jul 20 12:45:56.860753 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:56.860718    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8rgnc" event={"ID":"0fc36941-41db-4bf5-b1bf-05487f4c4337","Type":"ContainerStarted","Data":"b41fd11152eef47169eb1035b78d981f7af2bbcda21cf91581715cccf25feb5c"}
Jul 20 12:45:56.861126 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:56.860773    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8rgnc" event={"ID":"0fc36941-41db-4bf5-b1bf-05487f4c4337","Type":"ContainerStarted","Data":"fd18341d32ee842fecad08cb08a066c2cf1e8cc0e5a3537da33e1dc3f2bdc4aa"}
Jul 20 12:45:56.879721 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:45:56.879674    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8rgnc" podStartSLOduration=2.385752688 podStartE2EDuration="3.879656793s" totalImagesPullingTime="1.432429626s" totalInitContainerRuntime="61.474479ms" isStatefulPod=true podCreationTimestamp="2026-07-20 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:45:56.877826578 +0000 UTC m=+102.010809678" watchObservedRunningTime="2026-07-20 12:45:56.879656793 +0000 UTC m=+102.012639894"
Jul 20 12:46:01.760772 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:01.760738    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zhxk9"
Jul 20 12:46:15.982016 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:15.981946    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4" podUID="0c1b8953-bf93-46e6-9442-fd38a3d9412c" containerName="registry" containerID="cri-o://0bca5238222f3057e9b3474663456d10cca69f18c10f3f0572b1a4b54faeac70" gracePeriod=30
Jul 20 12:46:16.218747 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.218725    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:46:16.240721 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.240654    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls\") pod \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") "
Jul 20 12:46:16.240721 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.240688    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c1b8953-bf93-46e6-9442-fd38a3d9412c-image-registry-private-configuration\") pod \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") "
Jul 20 12:46:16.240721 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.240711    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c1b8953-bf93-46e6-9442-fd38a3d9412c-installation-pull-secrets\") pod \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") "
Jul 20 12:46:16.240960 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.240740    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c1b8953-bf93-46e6-9442-fd38a3d9412c-trusted-ca\") pod \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") "
Jul 20 12:46:16.240960 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.240763    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-bound-sa-token\") pod \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") "
Jul 20 12:46:16.240960 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.240819    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c1b8953-bf93-46e6-9442-fd38a3d9412c-ca-trust-extracted\") pod \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") "
Jul 20 12:46:16.240960 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.240848    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzbkl\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-kube-api-access-lzbkl\") pod \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") "
Jul 20 12:46:16.240960 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.240879    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-certificates\") pod \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\" (UID: \"0c1b8953-bf93-46e6-9442-fd38a3d9412c\") "
Jul 20 12:46:16.241289 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.241263    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c1b8953-bf93-46e6-9442-fd38a3d9412c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0c1b8953-bf93-46e6-9442-fd38a3d9412c" (UID: "0c1b8953-bf93-46e6-9442-fd38a3d9412c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:46:16.241441 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.241390    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0c1b8953-bf93-46e6-9442-fd38a3d9412c" (UID: "0c1b8953-bf93-46e6-9442-fd38a3d9412c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:46:16.243730 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.243686    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0c1b8953-bf93-46e6-9442-fd38a3d9412c" (UID: "0c1b8953-bf93-46e6-9442-fd38a3d9412c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:46:16.243893 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.243864    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-kube-api-access-lzbkl" (OuterVolumeSpecName: "kube-api-access-lzbkl") pod "0c1b8953-bf93-46e6-9442-fd38a3d9412c" (UID: "0c1b8953-bf93-46e6-9442-fd38a3d9412c"). InnerVolumeSpecName "kube-api-access-lzbkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:46:16.243957 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.243926    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0c1b8953-bf93-46e6-9442-fd38a3d9412c" (UID: "0c1b8953-bf93-46e6-9442-fd38a3d9412c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:46:16.244125 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.244103    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c1b8953-bf93-46e6-9442-fd38a3d9412c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0c1b8953-bf93-46e6-9442-fd38a3d9412c" (UID: "0c1b8953-bf93-46e6-9442-fd38a3d9412c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:46:16.244453 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.244423    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c1b8953-bf93-46e6-9442-fd38a3d9412c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0c1b8953-bf93-46e6-9442-fd38a3d9412c" (UID: "0c1b8953-bf93-46e6-9442-fd38a3d9412c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:46:16.250347 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.250316    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c1b8953-bf93-46e6-9442-fd38a3d9412c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0c1b8953-bf93-46e6-9442-fd38a3d9412c" (UID: "0c1b8953-bf93-46e6-9442-fd38a3d9412c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:46:16.341981 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.341935    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-tls\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:46:16.341981 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.341973    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0c1b8953-bf93-46e6-9442-fd38a3d9412c-image-registry-private-configuration\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:46:16.341981 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.341983    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0c1b8953-bf93-46e6-9442-fd38a3d9412c-installation-pull-secrets\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:46:16.341981 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.341993    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c1b8953-bf93-46e6-9442-fd38a3d9412c-trusted-ca\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:46:16.342234 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.342002    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-bound-sa-token\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:46:16.342234 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.342009    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0c1b8953-bf93-46e6-9442-fd38a3d9412c-ca-trust-extracted\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:46:16.342234 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.342017    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzbkl\" (UniqueName: \"kubernetes.io/projected/0c1b8953-bf93-46e6-9442-fd38a3d9412c-kube-api-access-lzbkl\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:46:16.342234 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.342025    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0c1b8953-bf93-46e6-9442-fd38a3d9412c-registry-certificates\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:46:16.929334 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.929298    2557 generic.go:356] "Generic (PLEG): container finished" podID="0c1b8953-bf93-46e6-9442-fd38a3d9412c" containerID="0bca5238222f3057e9b3474663456d10cca69f18c10f3f0572b1a4b54faeac70" exitCode=0
Jul 20 12:46:16.929334 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.929333    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4"
Jul 20 12:46:16.929539 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.929351    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4" event={"ID":"0c1b8953-bf93-46e6-9442-fd38a3d9412c","Type":"ContainerDied","Data":"0bca5238222f3057e9b3474663456d10cca69f18c10f3f0572b1a4b54faeac70"}
Jul 20 12:46:16.929539 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.929394    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67fdbc7bc9-k66r4" event={"ID":"0c1b8953-bf93-46e6-9442-fd38a3d9412c","Type":"ContainerDied","Data":"cb4004fdce5e84f1b2117824501f098e2477e9b31fd359f1d7b258bdf3ec5f92"}
Jul 20 12:46:16.929539 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.929414    2557 scope.go:117] "RemoveContainer" containerID="0bca5238222f3057e9b3474663456d10cca69f18c10f3f0572b1a4b54faeac70"
Jul 20 12:46:16.937189 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.937166    2557 scope.go:117] "RemoveContainer" containerID="0bca5238222f3057e9b3474663456d10cca69f18c10f3f0572b1a4b54faeac70"
Jul 20 12:46:16.937470 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:46:16.937445    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bca5238222f3057e9b3474663456d10cca69f18c10f3f0572b1a4b54faeac70\": container with ID starting with 0bca5238222f3057e9b3474663456d10cca69f18c10f3f0572b1a4b54faeac70 not found: ID does not exist" containerID="0bca5238222f3057e9b3474663456d10cca69f18c10f3f0572b1a4b54faeac70"
Jul 20 12:46:16.937567 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.937482    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bca5238222f3057e9b3474663456d10cca69f18c10f3f0572b1a4b54faeac70"} err="failed to get container status \"0bca5238222f3057e9b3474663456d10cca69f18c10f3f0572b1a4b54faeac70\": rpc error: code = NotFound desc = could not find container \"0bca5238222f3057e9b3474663456d10cca69f18c10f3f0572b1a4b54faeac70\": container with ID starting with 0bca5238222f3057e9b3474663456d10cca69f18c10f3f0572b1a4b54faeac70 not found: ID does not exist"
Jul 20 12:46:16.949290 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.949269    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67fdbc7bc9-k66r4"]
Jul 20 12:46:16.952494 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:16.952472    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67fdbc7bc9-k66r4"]
Jul 20 12:46:17.379697 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:17.379664    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c1b8953-bf93-46e6-9442-fd38a3d9412c" path="/var/lib/kubelet/pods/0c1b8953-bf93-46e6-9442-fd38a3d9412c/volumes"
Jul 20 12:46:20.950468 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:20.950432    2557 generic.go:356] "Generic (PLEG): container finished" podID="18ee5454-ba9f-4e21-b351-e76d4a48143d" containerID="a5624cc754f8c94abb0727eff83530e9dc34aa68229c5ef9e8aa21a0fc2cd352" exitCode=0
Jul 20 12:46:20.950928 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:20.950509    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc" event={"ID":"18ee5454-ba9f-4e21-b351-e76d4a48143d","Type":"ContainerDied","Data":"a5624cc754f8c94abb0727eff83530e9dc34aa68229c5ef9e8aa21a0fc2cd352"}
Jul 20 12:46:20.950928 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:20.950845    2557 scope.go:117] "RemoveContainer" containerID="a5624cc754f8c94abb0727eff83530e9dc34aa68229c5ef9e8aa21a0fc2cd352"
Jul 20 12:46:21.955338 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:21.955300    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-4rwhc" event={"ID":"18ee5454-ba9f-4e21-b351-e76d4a48143d","Type":"ContainerStarted","Data":"2e246acbd2fa450e1bd25909d511ace79e51e9f75e0c3389572e857c0422f4ce"}
Jul 20 12:46:25.968977 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:25.968937    2557 generic.go:356] "Generic (PLEG): container finished" podID="9c829d12-c2b9-4335-bc78-65693d34da89" containerID="fef5fdb3f5d3b7c3a5fd31be49318b5e51eca3fef911d304e0c0b079ab1ddadb" exitCode=0
Jul 20 12:46:25.969376 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:25.969011    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-pflw4" event={"ID":"9c829d12-c2b9-4335-bc78-65693d34da89","Type":"ContainerDied","Data":"fef5fdb3f5d3b7c3a5fd31be49318b5e51eca3fef911d304e0c0b079ab1ddadb"}
Jul 20 12:46:25.969376 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:25.969341    2557 scope.go:117] "RemoveContainer" containerID="fef5fdb3f5d3b7c3a5fd31be49318b5e51eca3fef911d304e0c0b079ab1ddadb"
Jul 20 12:46:26.975060 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:46:26.975027    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-pflw4" event={"ID":"9c829d12-c2b9-4335-bc78-65693d34da89","Type":"ContainerStarted","Data":"0c5692f8e0442a19317395e19dc39d7ec40ebe15bb9d3b0eb75fc190a055b1ce"}
Jul 20 12:48:59.254917 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.254886    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wzl2g"]
Jul 20 12:48:59.255322 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.255123    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c1b8953-bf93-46e6-9442-fd38a3d9412c" containerName="registry"
Jul 20 12:48:59.255322 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.255134    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1b8953-bf93-46e6-9442-fd38a3d9412c" containerName="registry"
Jul 20 12:48:59.255322 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.255197    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c1b8953-bf93-46e6-9442-fd38a3d9412c" containerName="registry"
Jul 20 12:48:59.257907 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.257890    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wzl2g"
Jul 20 12:48:59.260274 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.260250    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 12:48:59.260408 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.260320    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 12:48:59.260887 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.260871    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-cp4bn\""
Jul 20 12:48:59.268526 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.268501    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wzl2g"]
Jul 20 12:48:59.380658 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.379316    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cea8c889-5353-4a2b-8ccf-0ae5f6620779-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wzl2g\" (UID: \"cea8c889-5353-4a2b-8ccf-0ae5f6620779\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wzl2g"
Jul 20 12:48:59.380658 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.379401    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4j95\" (UniqueName: \"kubernetes.io/projected/cea8c889-5353-4a2b-8ccf-0ae5f6620779-kube-api-access-c4j95\") pod \"openshift-lws-operator-fd8ccff4c-wzl2g\" (UID: \"cea8c889-5353-4a2b-8ccf-0ae5f6620779\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wzl2g"
Jul 20 12:48:59.480028 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.479984    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4j95\" (UniqueName: \"kubernetes.io/projected/cea8c889-5353-4a2b-8ccf-0ae5f6620779-kube-api-access-c4j95\") pod \"openshift-lws-operator-fd8ccff4c-wzl2g\" (UID: \"cea8c889-5353-4a2b-8ccf-0ae5f6620779\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wzl2g"
Jul 20 12:48:59.480209 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.480068    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cea8c889-5353-4a2b-8ccf-0ae5f6620779-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wzl2g\" (UID: \"cea8c889-5353-4a2b-8ccf-0ae5f6620779\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wzl2g"
Jul 20 12:48:59.480497 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.480477    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cea8c889-5353-4a2b-8ccf-0ae5f6620779-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wzl2g\" (UID: \"cea8c889-5353-4a2b-8ccf-0ae5f6620779\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wzl2g"
Jul 20 12:48:59.488792 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.488769    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4j95\" (UniqueName: \"kubernetes.io/projected/cea8c889-5353-4a2b-8ccf-0ae5f6620779-kube-api-access-c4j95\") pod \"openshift-lws-operator-fd8ccff4c-wzl2g\" (UID: \"cea8c889-5353-4a2b-8ccf-0ae5f6620779\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wzl2g"
Jul 20 12:48:59.567155 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.567131    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wzl2g"
Jul 20 12:48:59.692894 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:48:59.692863    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wzl2g"]
Jul 20 12:48:59.696201 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:48:59.696175    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcea8c889_5353_4a2b_8ccf_0ae5f6620779.slice/crio-60a0ebf331c995f3032221e10e7db2e320417f70e378132822a4d78a76463f29 WatchSource:0}: Error finding container 60a0ebf331c995f3032221e10e7db2e320417f70e378132822a4d78a76463f29: Status 404 returned error can't find the container with id 60a0ebf331c995f3032221e10e7db2e320417f70e378132822a4d78a76463f29
Jul 20 12:49:00.495713 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:00.495680    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wzl2g" event={"ID":"cea8c889-5353-4a2b-8ccf-0ae5f6620779","Type":"ContainerStarted","Data":"60a0ebf331c995f3032221e10e7db2e320417f70e378132822a4d78a76463f29"}
Jul 20 12:49:02.504049 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:02.504009    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wzl2g" event={"ID":"cea8c889-5353-4a2b-8ccf-0ae5f6620779","Type":"ContainerStarted","Data":"5aff6efe0322e7c645bc8733951da82c2073df9c42f46d2d1bc0489c15ff4bf3"}
Jul 20 12:49:02.520552 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:02.520498    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wzl2g" podStartSLOduration=1.290781046 podStartE2EDuration="3.520482094s" totalImagesPullingTime="2.229701048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:48:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:49:02.519102108 +0000 UTC m=+287.652085209" watchObservedRunningTime="2026-07-20 12:49:02.520482094 +0000 UTC m=+287.653465194"
Jul 20 12:49:15.310401 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:15.310369    2557 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 12:49:24.095926 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.095883    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"]
Jul 20 12:49:24.098948 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.098932    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.101051 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.101031    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 12:49:24.101164 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.101034    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 12:49:24.101164 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.101069    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 12:49:24.101554 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.101538    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 12:49:24.103079 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.103063    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5cnmf\""
Jul 20 12:49:24.122313 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.122291    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"]
Jul 20 12:49:24.164611 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.164587    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-tmp\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.164718 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.164615    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.164718 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.164655    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-webhook-cert\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.164718 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.164699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-manifests\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.164847 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.164720    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shd5l\" (UniqueName: \"kubernetes.io/projected/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-kube-api-access-shd5l\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.265910 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.265885    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-tmp\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.266018 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.265914    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.266018 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.265937    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-webhook-cert\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.266131 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.266058    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-manifests\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.266131 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.266097    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shd5l\" (UniqueName: \"kubernetes.io/projected/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-kube-api-access-shd5l\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.266452 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.266426    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-manifests\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.268117 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.268091    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-tmp\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.268392 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.268370    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-webhook-cert\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.268485 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.268374    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.277032 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.277014    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shd5l\" (UniqueName: \"kubernetes.io/projected/aa6a26f2-75fb-4239-81f8-d9d43ef6f52e-kube-api-access-shd5l\") pod \"opendatahub-operator-controller-manager-749978ccd7-smgrf\" (UID: \"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e\") " pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.409241 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.409167    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:24.547031 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.546909    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"]
Jul 20 12:49:24.549829 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:49:24.549801    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6a26f2_75fb_4239_81f8_d9d43ef6f52e.slice/crio-5c2531b4f1f276f068a00122c40354cb8f7fb3fc9982327da788b5e91fc6bb21 WatchSource:0}: Error finding container 5c2531b4f1f276f068a00122c40354cb8f7fb3fc9982327da788b5e91fc6bb21: Status 404 returned error can't find the container with id 5c2531b4f1f276f068a00122c40354cb8f7fb3fc9982327da788b5e91fc6bb21
Jul 20 12:49:24.551472 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.551452    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 12:49:24.583037 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:24.583007    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf" event={"ID":"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e","Type":"ContainerStarted","Data":"5c2531b4f1f276f068a00122c40354cb8f7fb3fc9982327da788b5e91fc6bb21"}
Jul 20 12:49:27.596901 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:27.596860    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf" event={"ID":"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e","Type":"ContainerStarted","Data":"cb4d0ee23a6011c395a39aeaef5d3412b03a63d818e195fda3b802b426de590c"}
Jul 20 12:49:28.601969 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:28.601939    2557 generic.go:356] "Generic (PLEG): container finished" podID="aa6a26f2-75fb-4239-81f8-d9d43ef6f52e" containerID="cb4d0ee23a6011c395a39aeaef5d3412b03a63d818e195fda3b802b426de590c" exitCode=0
Jul 20 12:49:28.602316 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:28.602013    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf" event={"ID":"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e","Type":"ContainerDied","Data":"cb4d0ee23a6011c395a39aeaef5d3412b03a63d818e195fda3b802b426de590c"}
Jul 20 12:49:29.607041 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:29.607007    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf" event={"ID":"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e","Type":"ContainerStarted","Data":"2a420b23f5cf1340722d39c9aa4e75f829cd0300638c7a974753cd4f20ce75c5"}
Jul 20 12:49:29.607406 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:29.607139    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:29.629501 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:29.629443    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf" podStartSLOduration=1.298967072 podStartE2EDuration="5.629423828s" totalImagesPullingTime="3.327202161s" totalInitContainerRuntime="1.003254595s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:49:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:49:29.627474444 +0000 UTC m=+314.760457546" watchObservedRunningTime="2026-07-20 12:49:29.629423828 +0000 UTC m=+314.762406929"
Jul 20 12:49:40.612417 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:40.612387    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 12:49:43.509964 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:43.509929    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vqntk"]
Jul 20 12:49:43.513213 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:43.513197    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vqntk"
Jul 20 12:49:43.516068 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:43.516047    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lcrgs\""
Jul 20 12:49:43.516823 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:43.516801    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 20 12:49:43.531884 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:43.531864    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vqntk"]
Jul 20 12:49:43.602530 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:43.602493    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2-cert\") pod \"odh-model-controller-7998c67dc4-vqntk\" (UID: \"c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vqntk"
Jul 20 12:49:43.602530 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:43.602531    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7jld\" (UniqueName: \"kubernetes.io/projected/c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2-kube-api-access-n7jld\") pod \"odh-model-controller-7998c67dc4-vqntk\" (UID: \"c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vqntk"
Jul 20 12:49:43.703986 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:43.703957    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2-cert\") pod \"odh-model-controller-7998c67dc4-vqntk\" (UID: \"c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vqntk"
Jul 20 12:49:43.703986 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:43.703988    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7jld\" (UniqueName: \"kubernetes.io/projected/c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2-kube-api-access-n7jld\") pod \"odh-model-controller-7998c67dc4-vqntk\" (UID: \"c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vqntk"
Jul 20 12:49:43.704192 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:49:43.704099    2557 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 20 12:49:43.704192 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:49:43.704162    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2-cert podName:c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2 nodeName:}" failed. No retries permitted until 2026-07-20 12:49:44.204147931 +0000 UTC m=+329.337131009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2-cert") pod "odh-model-controller-7998c67dc4-vqntk" (UID: "c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2") : secret "odh-model-controller-webhook-cert" not found
Jul 20 12:49:43.712110 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:43.712084    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7jld\" (UniqueName: \"kubernetes.io/projected/c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2-kube-api-access-n7jld\") pod \"odh-model-controller-7998c67dc4-vqntk\" (UID: \"c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vqntk"
Jul 20 12:49:44.177294 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.177256    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-59vzh"]
Jul 20 12:49:44.180574 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.180557    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-59vzh"
Jul 20 12:49:44.182565 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.182542    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 20 12:49:44.182699 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.182552    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-f5lhb\""
Jul 20 12:49:44.188183 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.188163    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-59vzh"]
Jul 20 12:49:44.208753 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.208732    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pr2g\" (UniqueName: \"kubernetes.io/projected/fba8ebc1-3f12-41f6-b5b1-1253d30137c5-kube-api-access-4pr2g\") pod \"model-serving-api-54d89bd5fc-59vzh\" (UID: \"fba8ebc1-3f12-41f6-b5b1-1253d30137c5\") " pod="opendatahub/model-serving-api-54d89bd5fc-59vzh"
Jul 20 12:49:44.208858 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.208817    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2-cert\") pod \"odh-model-controller-7998c67dc4-vqntk\" (UID: \"c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vqntk"
Jul 20 12:49:44.208918 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.208870    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fba8ebc1-3f12-41f6-b5b1-1253d30137c5-tls-certs\") pod \"model-serving-api-54d89bd5fc-59vzh\" (UID: \"fba8ebc1-3f12-41f6-b5b1-1253d30137c5\") " pod="opendatahub/model-serving-api-54d89bd5fc-59vzh"
Jul 20 12:49:44.211128 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.211109    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2-cert\") pod \"odh-model-controller-7998c67dc4-vqntk\" (UID: \"c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vqntk"
Jul 20 12:49:44.309934 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.309894    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fba8ebc1-3f12-41f6-b5b1-1253d30137c5-tls-certs\") pod \"model-serving-api-54d89bd5fc-59vzh\" (UID: \"fba8ebc1-3f12-41f6-b5b1-1253d30137c5\") " pod="opendatahub/model-serving-api-54d89bd5fc-59vzh"
Jul 20 12:49:44.310103 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.309952    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pr2g\" (UniqueName: \"kubernetes.io/projected/fba8ebc1-3f12-41f6-b5b1-1253d30137c5-kube-api-access-4pr2g\") pod \"model-serving-api-54d89bd5fc-59vzh\" (UID: \"fba8ebc1-3f12-41f6-b5b1-1253d30137c5\") " pod="opendatahub/model-serving-api-54d89bd5fc-59vzh"
Jul 20 12:49:44.312164 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.312146    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fba8ebc1-3f12-41f6-b5b1-1253d30137c5-tls-certs\") pod \"model-serving-api-54d89bd5fc-59vzh\" (UID: \"fba8ebc1-3f12-41f6-b5b1-1253d30137c5\") " pod="opendatahub/model-serving-api-54d89bd5fc-59vzh"
Jul 20 12:49:44.320577 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.320548    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pr2g\" (UniqueName: \"kubernetes.io/projected/fba8ebc1-3f12-41f6-b5b1-1253d30137c5-kube-api-access-4pr2g\") pod \"model-serving-api-54d89bd5fc-59vzh\" (UID: \"fba8ebc1-3f12-41f6-b5b1-1253d30137c5\") " pod="opendatahub/model-serving-api-54d89bd5fc-59vzh"
Jul 20 12:49:44.422683 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.422642    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vqntk"
Jul 20 12:49:44.491990 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.491526    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-59vzh"
Jul 20 12:49:44.567047 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.567019    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vqntk"]
Jul 20 12:49:44.571235 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:49:44.571205    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc03ab8ba_3e60_4d48_a9bd_c981d02e9ea2.slice/crio-4e075068505ac4e944a531884678493633b6516b44365a3db20da7ee4bee10dd WatchSource:0}: Error finding container 4e075068505ac4e944a531884678493633b6516b44365a3db20da7ee4bee10dd: Status 404 returned error can't find the container with id 4e075068505ac4e944a531884678493633b6516b44365a3db20da7ee4bee10dd
Jul 20 12:49:44.634934 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.634902    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-59vzh"]
Jul 20 12:49:44.638645 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:49:44.638586    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba8ebc1_3f12_41f6_b5b1_1253d30137c5.slice/crio-4f597cf5e7dbd528c2cebb454a7cc3ff1dca703a72cdd29e5441c7d605c2b593 WatchSource:0}: Error finding container 4f597cf5e7dbd528c2cebb454a7cc3ff1dca703a72cdd29e5441c7d605c2b593: Status 404 returned error can't find the container with id 4f597cf5e7dbd528c2cebb454a7cc3ff1dca703a72cdd29e5441c7d605c2b593
Jul 20 12:49:44.664354 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.664320    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-59vzh" event={"ID":"fba8ebc1-3f12-41f6-b5b1-1253d30137c5","Type":"ContainerStarted","Data":"4f597cf5e7dbd528c2cebb454a7cc3ff1dca703a72cdd29e5441c7d605c2b593"}
Jul 20 12:49:44.665549 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:44.665514    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vqntk" event={"ID":"c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2","Type":"ContainerStarted","Data":"4e075068505ac4e944a531884678493633b6516b44365a3db20da7ee4bee10dd"}
Jul 20 12:49:48.688133 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:48.688092    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vqntk" event={"ID":"c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2","Type":"ContainerStarted","Data":"61957172588e1434988ea03eb48510415996f22fba83e90e47b851a742415b14"}
Jul 20 12:49:48.688635 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:48.688161    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-vqntk"
Jul 20 12:49:48.689356 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:48.689333    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-59vzh" event={"ID":"fba8ebc1-3f12-41f6-b5b1-1253d30137c5","Type":"ContainerStarted","Data":"9071a64e2ba8a061cfa25393a185685c3c1658611d8eabbe853d1fda2e7d732e"}
Jul 20 12:49:48.689474 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:48.689463    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-59vzh"
Jul 20 12:49:48.703540 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:48.703490    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-vqntk" podStartSLOduration=2.545909629 podStartE2EDuration="5.703471123s" totalImagesPullingTime="3.157561494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:49:48.702998111 +0000 UTC m=+333.835981212" watchObservedRunningTime="2026-07-20 12:49:48.703471123 +0000 UTC m=+333.836454222"
Jul 20 12:49:48.720285 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:48.720224    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-59vzh" podStartSLOduration=2.9185063639999997 podStartE2EDuration="4.720209008s" totalImagesPullingTime="1.801702644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:49:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:49:48.719990627 +0000 UTC m=+333.852973729" watchObservedRunningTime="2026-07-20 12:49:48.720209008 +0000 UTC m=+333.853192109"
Jul 20 12:49:53.966153 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:53.966118    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc"]
Jul 20 12:49:53.969243 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:53.969218    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc"
Jul 20 12:49:53.973858 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:53.973839    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 12:49:53.983109 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:53.983084    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 12:49:53.983109 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:53.983100    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 12:49:53.983287 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:53.983242    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b2k7c\""
Jul 20 12:49:53.983643 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:53.983603    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 12:49:53.985159 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:53.985137    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc"]
Jul 20 12:49:54.085724 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.085696    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34281c51-746a-4e62-b808-8a1e2ec2a4c3-tmp\") pod \"kube-auth-proxy-7f7c7fb896-w2jxc\" (UID: \"34281c51-746a-4e62-b808-8a1e2ec2a4c3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc"
Jul 20 12:49:54.085881 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.085747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34281c51-746a-4e62-b808-8a1e2ec2a4c3-tls-certs\") pod \"kube-auth-proxy-7f7c7fb896-w2jxc\" (UID: \"34281c51-746a-4e62-b808-8a1e2ec2a4c3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc"
Jul 20 12:49:54.085881 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.085812    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2954q\" (UniqueName: \"kubernetes.io/projected/34281c51-746a-4e62-b808-8a1e2ec2a4c3-kube-api-access-2954q\") pod \"kube-auth-proxy-7f7c7fb896-w2jxc\" (UID: \"34281c51-746a-4e62-b808-8a1e2ec2a4c3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc"
Jul 20 12:49:54.111293 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.111264    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-48rs8"]
Jul 20 12:49:54.114798 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.114777    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh"]
Jul 20 12:49:54.114914 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.114900    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-48rs8"
Jul 20 12:49:54.117842 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.117822    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh"
Jul 20 12:49:54.120417 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.120399    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5gczt\""
Jul 20 12:49:54.120582 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.120565    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 20 12:49:54.120659 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.120571    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-b4zlk\""
Jul 20 12:49:54.120835 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.120822    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 20 12:49:54.133001 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.132959    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh"]
Jul 20 12:49:54.134118 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.134100    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-48rs8"]
Jul 20 12:49:54.186505 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.186479    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/beea95a7-65c3-4c05-a20e-7bed244f671f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zgqxh\" (UID: \"beea95a7-65c3-4c05-a20e-7bed244f671f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh"
Jul 20 12:49:54.186664 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.186520    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2954q\" (UniqueName: \"kubernetes.io/projected/34281c51-746a-4e62-b808-8a1e2ec2a4c3-kube-api-access-2954q\") pod \"kube-auth-proxy-7f7c7fb896-w2jxc\" (UID: \"34281c51-746a-4e62-b808-8a1e2ec2a4c3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc"
Jul 20 12:49:54.186664 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.186545    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f076bd39-a163-4e47-85c4-dad2317a81f4-cert\") pod \"kserve-controller-manager-d6f4b65b8-48rs8\" (UID: \"f076bd39-a163-4e47-85c4-dad2317a81f4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-48rs8"
Jul 20 12:49:54.186664 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.186600    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34281c51-746a-4e62-b808-8a1e2ec2a4c3-tmp\") pod \"kube-auth-proxy-7f7c7fb896-w2jxc\" (UID: \"34281c51-746a-4e62-b808-8a1e2ec2a4c3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc"
Jul 20 12:49:54.186789 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.186665    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34281c51-746a-4e62-b808-8a1e2ec2a4c3-tls-certs\") pod \"kube-auth-proxy-7f7c7fb896-w2jxc\" (UID: \"34281c51-746a-4e62-b808-8a1e2ec2a4c3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc"
Jul 20 12:49:54.186789 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.186698    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ksqw\" (UniqueName: \"kubernetes.io/projected/f076bd39-a163-4e47-85c4-dad2317a81f4-kube-api-access-8ksqw\") pod \"kserve-controller-manager-d6f4b65b8-48rs8\" (UID: \"f076bd39-a163-4e47-85c4-dad2317a81f4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-48rs8"
Jul 20 12:49:54.186789 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.186722    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds5cb\" (UniqueName: \"kubernetes.io/projected/beea95a7-65c3-4c05-a20e-7bed244f671f-kube-api-access-ds5cb\") pod \"llmisvc-controller-manager-777c6bd7d5-zgqxh\" (UID: \"beea95a7-65c3-4c05-a20e-7bed244f671f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh"
Jul 20 12:49:54.188930 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.188909    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34281c51-746a-4e62-b808-8a1e2ec2a4c3-tmp\") pod \"kube-auth-proxy-7f7c7fb896-w2jxc\" (UID: \"34281c51-746a-4e62-b808-8a1e2ec2a4c3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc"
Jul 20 12:49:54.189125 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.189109    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34281c51-746a-4e62-b808-8a1e2ec2a4c3-tls-certs\") pod \"kube-auth-proxy-7f7c7fb896-w2jxc\" (UID: \"34281c51-746a-4e62-b808-8a1e2ec2a4c3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc"
Jul 20 12:49:54.194916 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.194885    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2954q\" (UniqueName: \"kubernetes.io/projected/34281c51-746a-4e62-b808-8a1e2ec2a4c3-kube-api-access-2954q\") pod \"kube-auth-proxy-7f7c7fb896-w2jxc\" (UID: \"34281c51-746a-4e62-b808-8a1e2ec2a4c3\") " pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc"
Jul 20 12:49:54.280881 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.280859    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc"
Jul 20 12:49:54.287086 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.287055    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ksqw\" (UniqueName: \"kubernetes.io/projected/f076bd39-a163-4e47-85c4-dad2317a81f4-kube-api-access-8ksqw\") pod \"kserve-controller-manager-d6f4b65b8-48rs8\" (UID: \"f076bd39-a163-4e47-85c4-dad2317a81f4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-48rs8"
Jul 20 12:49:54.287195 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.287095    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds5cb\" (UniqueName: \"kubernetes.io/projected/beea95a7-65c3-4c05-a20e-7bed244f671f-kube-api-access-ds5cb\") pod \"llmisvc-controller-manager-777c6bd7d5-zgqxh\" (UID: \"beea95a7-65c3-4c05-a20e-7bed244f671f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh"
Jul 20 12:49:54.287195 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.287116    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/beea95a7-65c3-4c05-a20e-7bed244f671f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zgqxh\" (UID: \"beea95a7-65c3-4c05-a20e-7bed244f671f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh"
Jul 20 12:49:54.287195 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.287138    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f076bd39-a163-4e47-85c4-dad2317a81f4-cert\") pod \"kserve-controller-manager-d6f4b65b8-48rs8\" (UID: \"f076bd39-a163-4e47-85c4-dad2317a81f4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-48rs8"
Jul 20 12:49:54.287344 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:49:54.287225    2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 20 12:49:54.287344 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:49:54.287242    2557 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 20 12:49:54.287344 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:49:54.287275    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f076bd39-a163-4e47-85c4-dad2317a81f4-cert podName:f076bd39-a163-4e47-85c4-dad2317a81f4 nodeName:}" failed. No retries permitted until 2026-07-20 12:49:54.787260727 +0000 UTC m=+339.920243806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f076bd39-a163-4e47-85c4-dad2317a81f4-cert") pod "kserve-controller-manager-d6f4b65b8-48rs8" (UID: "f076bd39-a163-4e47-85c4-dad2317a81f4") : secret "kserve-webhook-server-cert" not found
Jul 20 12:49:54.287344 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:49:54.287300    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beea95a7-65c3-4c05-a20e-7bed244f671f-cert podName:beea95a7-65c3-4c05-a20e-7bed244f671f nodeName:}" failed. No retries permitted until 2026-07-20 12:49:54.787282043 +0000 UTC m=+339.920265123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/beea95a7-65c3-4c05-a20e-7bed244f671f-cert") pod "llmisvc-controller-manager-777c6bd7d5-zgqxh" (UID: "beea95a7-65c3-4c05-a20e-7bed244f671f") : secret "llmisvc-webhook-server-cert" not found
Jul 20 12:49:54.308330 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.308298    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds5cb\" (UniqueName: \"kubernetes.io/projected/beea95a7-65c3-4c05-a20e-7bed244f671f-kube-api-access-ds5cb\") pod \"llmisvc-controller-manager-777c6bd7d5-zgqxh\" (UID: \"beea95a7-65c3-4c05-a20e-7bed244f671f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh"
Jul 20 12:49:54.309195 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.309170    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ksqw\" (UniqueName: \"kubernetes.io/projected/f076bd39-a163-4e47-85c4-dad2317a81f4-kube-api-access-8ksqw\") pod \"kserve-controller-manager-d6f4b65b8-48rs8\" (UID: \"f076bd39-a163-4e47-85c4-dad2317a81f4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-48rs8"
Jul 20 12:49:54.418173 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.418133    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc"]
Jul 20 12:49:54.421738 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:49:54.421715    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34281c51_746a_4e62_b808_8a1e2ec2a4c3.slice/crio-143a8eb0300b204584a9122700d654b31c4a7196c617645bd1bcc0a2868fd820 WatchSource:0}: Error finding container 143a8eb0300b204584a9122700d654b31c4a7196c617645bd1bcc0a2868fd820: Status 404 returned error can't find the container with id 143a8eb0300b204584a9122700d654b31c4a7196c617645bd1bcc0a2868fd820
Jul 20 12:49:54.713701 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.713662    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc" event={"ID":"34281c51-746a-4e62-b808-8a1e2ec2a4c3","Type":"ContainerStarted","Data":"143a8eb0300b204584a9122700d654b31c4a7196c617645bd1bcc0a2868fd820"}
Jul 20 12:49:54.791473 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.791438    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/beea95a7-65c3-4c05-a20e-7bed244f671f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zgqxh\" (UID: \"beea95a7-65c3-4c05-a20e-7bed244f671f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh"
Jul 20 12:49:54.791673 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.791481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f076bd39-a163-4e47-85c4-dad2317a81f4-cert\") pod \"kserve-controller-manager-d6f4b65b8-48rs8\" (UID: \"f076bd39-a163-4e47-85c4-dad2317a81f4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-48rs8"
Jul 20 12:49:54.793906 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.793882    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/beea95a7-65c3-4c05-a20e-7bed244f671f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zgqxh\" (UID: \"beea95a7-65c3-4c05-a20e-7bed244f671f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh"
Jul 20 12:49:54.794001 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:54.793929    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f076bd39-a163-4e47-85c4-dad2317a81f4-cert\") pod \"kserve-controller-manager-d6f4b65b8-48rs8\" (UID: \"f076bd39-a163-4e47-85c4-dad2317a81f4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-48rs8"
Jul 20 12:49:55.025982 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.025891    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-48rs8"
Jul 20 12:49:55.031041 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.031013    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh"
Jul 20 12:49:55.181714 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:49:55.181681    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf076bd39_a163_4e47_85c4_dad2317a81f4.slice/crio-bcf38b85229c960d0de9a1ea881fd4dd67ff77068fbe490fd549805dde20900e WatchSource:0}: Error finding container bcf38b85229c960d0de9a1ea881fd4dd67ff77068fbe490fd549805dde20900e: Status 404 returned error can't find the container with id bcf38b85229c960d0de9a1ea881fd4dd67ff77068fbe490fd549805dde20900e
Jul 20 12:49:55.182252 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.182175    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-48rs8"]
Jul 20 12:49:55.199823 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.199719    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh"]
Jul 20 12:49:55.202993 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:49:55.202962    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbeea95a7_65c3_4c05_a20e_7bed244f671f.slice/crio-02a474c405ae3717e6381e00d1d8b822be7a82eca3a9720f009ca5b7aa649805 WatchSource:0}: Error finding container 02a474c405ae3717e6381e00d1d8b822be7a82eca3a9720f009ca5b7aa649805: Status 404 returned error can't find the container with id 02a474c405ae3717e6381e00d1d8b822be7a82eca3a9720f009ca5b7aa649805
Jul 20 12:49:55.602367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.602334    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"]
Jul 20 12:49:55.605708 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.605690    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.612941 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.612759    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 20 12:49:55.618835 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.618814    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 20 12:49:55.619673 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.619656    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lxjzq\""
Jul 20 12:49:55.620146 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.620119    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 12:49:55.620276 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.620258    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 20 12:49:55.632244 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.632217    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"]
Jul 20 12:49:55.700841 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.700804    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5623e02d-26a5-4950-82d7-5586e6cd70f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.701004 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.700860    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5623e02d-26a5-4950-82d7-5586e6cd70f2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.701004 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.700891    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5623e02d-26a5-4950-82d7-5586e6cd70f2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.701004 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.700937    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5623e02d-26a5-4950-82d7-5586e6cd70f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.701004 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.700958    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5rsr\" (UniqueName: \"kubernetes.io/projected/5623e02d-26a5-4950-82d7-5586e6cd70f2-kube-api-access-b5rsr\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.701004 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.700978    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5623e02d-26a5-4950-82d7-5586e6cd70f2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.701254 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.701097    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5623e02d-26a5-4950-82d7-5586e6cd70f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.725457 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.725154    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-48rs8" event={"ID":"f076bd39-a163-4e47-85c4-dad2317a81f4","Type":"ContainerStarted","Data":"bcf38b85229c960d0de9a1ea881fd4dd67ff77068fbe490fd549805dde20900e"}
Jul 20 12:49:55.726648 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.726578    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh" event={"ID":"beea95a7-65c3-4c05-a20e-7bed244f671f","Type":"ContainerStarted","Data":"02a474c405ae3717e6381e00d1d8b822be7a82eca3a9720f009ca5b7aa649805"}
Jul 20 12:49:55.802374 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.801792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5623e02d-26a5-4950-82d7-5586e6cd70f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.802374 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.801849    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5623e02d-26a5-4950-82d7-5586e6cd70f2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.802374 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.801882    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5623e02d-26a5-4950-82d7-5586e6cd70f2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.802374 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.801931    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5623e02d-26a5-4950-82d7-5586e6cd70f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.802374 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.801957    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5rsr\" (UniqueName: \"kubernetes.io/projected/5623e02d-26a5-4950-82d7-5586e6cd70f2-kube-api-access-b5rsr\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.802374 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.801986    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5623e02d-26a5-4950-82d7-5586e6cd70f2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.802374 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.802049    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5623e02d-26a5-4950-82d7-5586e6cd70f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.803405 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.803056    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5623e02d-26a5-4950-82d7-5586e6cd70f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.805143 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.805114    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5623e02d-26a5-4950-82d7-5586e6cd70f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.805254 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.805114    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5623e02d-26a5-4950-82d7-5586e6cd70f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.805488 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.805465    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5623e02d-26a5-4950-82d7-5586e6cd70f2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.807362 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.807338    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5623e02d-26a5-4950-82d7-5586e6cd70f2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.814749 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.814719    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5623e02d-26a5-4950-82d7-5586e6cd70f2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.815488 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.815463    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5rsr\" (UniqueName: \"kubernetes.io/projected/5623e02d-26a5-4950-82d7-5586e6cd70f2-kube-api-access-b5rsr\") pod \"istiod-openshift-gateway-94bb8fbfd-5kdg5\" (UID: \"5623e02d-26a5-4950-82d7-5586e6cd70f2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:55.917951 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:55.917863    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:49:56.242593 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:56.242560    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"]
Jul 20 12:49:56.891152 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:49:56.891119    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5623e02d_26a5_4950_82d7_5586e6cd70f2.slice/crio-1629bb479755d5427ae5b68240c29949319702954719cafd4da15c2cf1b7d578 WatchSource:0}: Error finding container 1629bb479755d5427ae5b68240c29949319702954719cafd4da15c2cf1b7d578: Status 404 returned error can't find the container with id 1629bb479755d5427ae5b68240c29949319702954719cafd4da15c2cf1b7d578
Jul 20 12:49:57.737069 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:57.737029    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5" event={"ID":"5623e02d-26a5-4950-82d7-5586e6cd70f2","Type":"ContainerStarted","Data":"1629bb479755d5427ae5b68240c29949319702954719cafd4da15c2cf1b7d578"}
Jul 20 12:49:59.696467 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:59.696430    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-vqntk"
Jul 20 12:49:59.698798 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:59.698765    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-59vzh"
Jul 20 12:49:59.754274 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:59.754241    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-48rs8" event={"ID":"f076bd39-a163-4e47-85c4-dad2317a81f4","Type":"ContainerStarted","Data":"62fc2e55c6d963c12d7abac4d80d7c73ec2bad8e515f9ef6f639b21108a2594d"}
Jul 20 12:49:59.754448 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:59.754336    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-48rs8"
Jul 20 12:49:59.756300 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:59.756274    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh" event={"ID":"beea95a7-65c3-4c05-a20e-7bed244f671f","Type":"ContainerStarted","Data":"27019882b9eb9d81f77b25900b258e02aa89e99d055efcf3881dc984d49f67df"}
Jul 20 12:49:59.756768 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:59.756750    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh"
Jul 20 12:49:59.759127 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:59.758724    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc" event={"ID":"34281c51-746a-4e62-b808-8a1e2ec2a4c3","Type":"ContainerStarted","Data":"de6f90b4055488676cdaa5f2cefeb4def9f3dc31cb7e6e58c145f223bfbd6be2"}
Jul 20 12:49:59.773870 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:59.773823    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-48rs8" podStartSLOduration=2.6946280590000002 podStartE2EDuration="5.773809718s" totalImagesPullingTime="3.079181659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:49:59.772454939 +0000 UTC m=+344.905438060" watchObservedRunningTime="2026-07-20 12:49:59.773809718 +0000 UTC m=+344.906792818"
Jul 20 12:49:59.791019 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:59.790972    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f7c7fb896-w2jxc" podStartSLOduration=3.441387793 podStartE2EDuration="6.790955492s" totalImagesPullingTime="3.349567699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:49:59.789853797 +0000 UTC m=+344.922836897" watchObservedRunningTime="2026-07-20 12:49:59.790955492 +0000 UTC m=+344.923938591"
Jul 20 12:49:59.805218 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:49:59.805142    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh" podStartSLOduration=1.784237509 podStartE2EDuration="5.805121689s" totalImagesPullingTime="4.02088418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:49:59.803889146 +0000 UTC m=+344.936872247" watchObservedRunningTime="2026-07-20 12:49:59.805121689 +0000 UTC m=+344.938104790"
Jul 20 12:50:00.252989 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:50:00.252950    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 12:50:00.253059 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:50:00.253030    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 12:50:00.768829 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:50:00.767890    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5" event={"ID":"5623e02d-26a5-4950-82d7-5586e6cd70f2","Type":"ContainerStarted","Data":"4cd863f41869684ed9cc541fb324d86c4c95e4a3028527ce18734313c68ea228"}
Jul 20 12:50:00.768829 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:50:00.768774    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:50:00.789716 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:50:00.789649    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5" podStartSLOduration=2.429993391 podStartE2EDuration="5.789631775s" totalImagesPullingTime="3.359638384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:50:00.787220329 +0000 UTC m=+345.920203443" watchObservedRunningTime="2026-07-20 12:50:00.789631775 +0000 UTC m=+345.922614868"
Jul 20 12:50:01.772295 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:50:01.772268    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-5kdg5"
Jul 20 12:50:30.772802 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:50:30.772723    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-48rs8"
Jul 20 12:50:31.773144 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:50:31.773115    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zgqxh"
Jul 20 12:51:24.485437 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:24.485401    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"]
Jul 20 12:51:24.487646 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:24.487613    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"
Jul 20 12:51:24.493339 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:24.493314    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8wmk9\""
Jul 20 12:51:24.493482 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:24.493363    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 12:51:24.493836 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:24.493811    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 12:51:24.512246 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:24.512217    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"]
Jul 20 12:51:24.632181 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:24.632151    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjz2r\" (UniqueName: \"kubernetes.io/projected/69dc4d84-5d60-4974-b959-0e6d672040b2-kube-api-access-fjz2r\") pod \"limitador-operator-controller-manager-859d7b78bd-g5hcr\" (UID: \"69dc4d84-5d60-4974-b959-0e6d672040b2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"
Jul 20 12:51:24.732942 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:24.732912    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjz2r\" (UniqueName: \"kubernetes.io/projected/69dc4d84-5d60-4974-b959-0e6d672040b2-kube-api-access-fjz2r\") pod \"limitador-operator-controller-manager-859d7b78bd-g5hcr\" (UID: \"69dc4d84-5d60-4974-b959-0e6d672040b2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"
Jul 20 12:51:24.746773 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:24.746710    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjz2r\" (UniqueName: \"kubernetes.io/projected/69dc4d84-5d60-4974-b959-0e6d672040b2-kube-api-access-fjz2r\") pod \"limitador-operator-controller-manager-859d7b78bd-g5hcr\" (UID: \"69dc4d84-5d60-4974-b959-0e6d672040b2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"
Jul 20 12:51:24.798657 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:24.798631    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"
Jul 20 12:51:24.965385 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:24.965363    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"]
Jul 20 12:51:24.967903 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:51:24.967877    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69dc4d84_5d60_4974_b959_0e6d672040b2.slice/crio-aa78742962f47bfbfbe19c67e65db9a1df90d2c84839441d148700e660d914bd WatchSource:0}: Error finding container aa78742962f47bfbfbe19c67e65db9a1df90d2c84839441d148700e660d914bd: Status 404 returned error can't find the container with id aa78742962f47bfbfbe19c67e65db9a1df90d2c84839441d148700e660d914bd
Jul 20 12:51:25.115245 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:25.115213    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr" event={"ID":"69dc4d84-5d60-4974-b959-0e6d672040b2","Type":"ContainerStarted","Data":"aa78742962f47bfbfbe19c67e65db9a1df90d2c84839441d148700e660d914bd"}
Jul 20 12:51:27.125903 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:27.125867    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr" event={"ID":"69dc4d84-5d60-4974-b959-0e6d672040b2","Type":"ContainerStarted","Data":"fe0e2c4ad3641be7644355c8f762c9cebb55e29d4cdf02ef54aedc8bcff20709"}
Jul 20 12:51:27.126291 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:27.126051    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"
Jul 20 12:51:27.161189 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:27.161147    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr" podStartSLOduration=1.40345121 podStartE2EDuration="3.161133885s" totalImagesPullingTime="1.757682675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:51:27.155486157 +0000 UTC m=+432.288469258" watchObservedRunningTime="2026-07-20 12:51:27.161133885 +0000 UTC m=+432.294116985"
Jul 20 12:51:38.131790 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:38.131713    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"
Jul 20 12:51:51.012061 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.012022    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"]
Jul 20 12:51:51.012461 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.012282    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr" podUID="69dc4d84-5d60-4974-b959-0e6d672040b2" containerName="manager" containerID="cri-o://fe0e2c4ad3641be7644355c8f762c9cebb55e29d4cdf02ef54aedc8bcff20709" gracePeriod=2
Jul 20 12:51:51.019515 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.019490    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"]
Jul 20 12:51:51.046320 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.046289    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"]
Jul 20 12:51:51.046652 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.046638    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69dc4d84-5d60-4974-b959-0e6d672040b2" containerName="manager"
Jul 20 12:51:51.046652 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.046654    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="69dc4d84-5d60-4974-b959-0e6d672040b2" containerName="manager"
Jul 20 12:51:51.046744 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.046712    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="69dc4d84-5d60-4974-b959-0e6d672040b2" containerName="manager"
Jul 20 12:51:51.049502 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.049483    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"
Jul 20 12:51:51.052005 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.051986    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-krktl\""
Jul 20 12:51:51.065212 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.065184    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"]
Jul 20 12:51:51.090594 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:51:51.090549    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g5hcr\" is forbidden: User \"system:node:ip-10-0-141-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-54.ec2.internal' and this object" podUID="69dc4d84-5d60-4974-b959-0e6d672040b2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"
Jul 20 12:51:51.142401 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.142372    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2c7a27b-fa82-4be8-bcb3-5bcfa6821369-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d97sq\" (UID: \"c2c7a27b-fa82-4be8-bcb3-5bcfa6821369\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"
Jul 20 12:51:51.142504 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.142412    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tssdz\" (UniqueName: \"kubernetes.io/projected/c2c7a27b-fa82-4be8-bcb3-5bcfa6821369-kube-api-access-tssdz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d97sq\" (UID: \"c2c7a27b-fa82-4be8-bcb3-5bcfa6821369\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"
Jul 20 12:51:51.227105 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.227076    2557 generic.go:356] "Generic (PLEG): container finished" podID="69dc4d84-5d60-4974-b959-0e6d672040b2" containerID="fe0e2c4ad3641be7644355c8f762c9cebb55e29d4cdf02ef54aedc8bcff20709" exitCode=0
Jul 20 12:51:51.243423 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.243395    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2c7a27b-fa82-4be8-bcb3-5bcfa6821369-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d97sq\" (UID: \"c2c7a27b-fa82-4be8-bcb3-5bcfa6821369\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"
Jul 20 12:51:51.243555 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.243452    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tssdz\" (UniqueName: \"kubernetes.io/projected/c2c7a27b-fa82-4be8-bcb3-5bcfa6821369-kube-api-access-tssdz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d97sq\" (UID: \"c2c7a27b-fa82-4be8-bcb3-5bcfa6821369\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"
Jul 20 12:51:51.243809 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.243788    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2c7a27b-fa82-4be8-bcb3-5bcfa6821369-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d97sq\" (UID: \"c2c7a27b-fa82-4be8-bcb3-5bcfa6821369\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"
Jul 20 12:51:51.247314 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.247296    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"
Jul 20 12:51:51.249242 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:51:51.249218    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-g5hcr\" is forbidden: User \"system:node:ip-10-0-141-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-54.ec2.internal' and this object" podUID="69dc4d84-5d60-4974-b959-0e6d672040b2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"
Jul 20 12:51:51.254782 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.254761    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tssdz\" (UniqueName: \"kubernetes.io/projected/c2c7a27b-fa82-4be8-bcb3-5bcfa6821369-kube-api-access-tssdz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d97sq\" (UID: \"c2c7a27b-fa82-4be8-bcb3-5bcfa6821369\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"
Jul 20 12:51:51.344439 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.344409    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjz2r\" (UniqueName: \"kubernetes.io/projected/69dc4d84-5d60-4974-b959-0e6d672040b2-kube-api-access-fjz2r\") pod \"69dc4d84-5d60-4974-b959-0e6d672040b2\" (UID: \"69dc4d84-5d60-4974-b959-0e6d672040b2\") "
Jul 20 12:51:51.346501 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.346471    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69dc4d84-5d60-4974-b959-0e6d672040b2-kube-api-access-fjz2r" (OuterVolumeSpecName: "kube-api-access-fjz2r") pod "69dc4d84-5d60-4974-b959-0e6d672040b2" (UID: "69dc4d84-5d60-4974-b959-0e6d672040b2"). InnerVolumeSpecName "kube-api-access-fjz2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:51:51.379690 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.379660    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69dc4d84-5d60-4974-b959-0e6d672040b2" path="/var/lib/kubelet/pods/69dc4d84-5d60-4974-b959-0e6d672040b2/volumes"
Jul 20 12:51:51.394063 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.394041    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"
Jul 20 12:51:51.445839 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.445801    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjz2r\" (UniqueName: \"kubernetes.io/projected/69dc4d84-5d60-4974-b959-0e6d672040b2-kube-api-access-fjz2r\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:51:51.542337 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:51.542306    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"]
Jul 20 12:51:51.545579 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:51:51.545552    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2c7a27b_fa82_4be8_bcb3_5bcfa6821369.slice/crio-375d453936e6500d430a5d17a86e03874bf5b8fe3440f4da0db1c6da68bfd724 WatchSource:0}: Error finding container 375d453936e6500d430a5d17a86e03874bf5b8fe3440f4da0db1c6da68bfd724: Status 404 returned error can't find the container with id 375d453936e6500d430a5d17a86e03874bf5b8fe3440f4da0db1c6da68bfd724
Jul 20 12:51:52.234876 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:52.234676    2557 scope.go:117] "RemoveContainer" containerID="fe0e2c4ad3641be7644355c8f762c9cebb55e29d4cdf02ef54aedc8bcff20709"
Jul 20 12:51:52.234876 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:52.234681    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-g5hcr"
Jul 20 12:51:52.236492 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:52.236464    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq" event={"ID":"c2c7a27b-fa82-4be8-bcb3-5bcfa6821369","Type":"ContainerStarted","Data":"375d453936e6500d430a5d17a86e03874bf5b8fe3440f4da0db1c6da68bfd724"}
Jul 20 12:51:55.254271 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:55.254238    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq" event={"ID":"c2c7a27b-fa82-4be8-bcb3-5bcfa6821369","Type":"ContainerStarted","Data":"c7c5fd434f432402c17f6a32d5dc701cdad19271390aac687f9c2e3e07be655a"}
Jul 20 12:51:55.254703 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:55.254346    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"
Jul 20 12:51:55.283201 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:51:55.283157    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq" podStartSLOduration=0.710064747 podStartE2EDuration="4.283141552s" totalImagesPullingTime="3.573076805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:51:55.281202628 +0000 UTC m=+460.414185730" watchObservedRunningTime="2026-07-20 12:51:55.283141552 +0000 UTC m=+460.416124654"
Jul 20 12:52:06.260278 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:06.260245    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"
Jul 20 12:52:17.700966 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:17.700142    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"]
Jul 20 12:52:17.700966 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:17.700464    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq" podUID="c2c7a27b-fa82-4be8-bcb3-5bcfa6821369" containerName="manager" containerID="cri-o://c7c5fd434f432402c17f6a32d5dc701cdad19271390aac687f9c2e3e07be655a" gracePeriod=10
Jul 20 12:52:17.950767 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:17.950745    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"
Jul 20 12:52:18.073480 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.073448    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tssdz\" (UniqueName: \"kubernetes.io/projected/c2c7a27b-fa82-4be8-bcb3-5bcfa6821369-kube-api-access-tssdz\") pod \"c2c7a27b-fa82-4be8-bcb3-5bcfa6821369\" (UID: \"c2c7a27b-fa82-4be8-bcb3-5bcfa6821369\") "
Jul 20 12:52:18.073480 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.073492    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2c7a27b-fa82-4be8-bcb3-5bcfa6821369-extensions-socket-volume\") pod \"c2c7a27b-fa82-4be8-bcb3-5bcfa6821369\" (UID: \"c2c7a27b-fa82-4be8-bcb3-5bcfa6821369\") "
Jul 20 12:52:18.073885 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.073850    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2c7a27b-fa82-4be8-bcb3-5bcfa6821369-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c2c7a27b-fa82-4be8-bcb3-5bcfa6821369" (UID: "c2c7a27b-fa82-4be8-bcb3-5bcfa6821369"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 12:52:18.075552 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.075529    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2c7a27b-fa82-4be8-bcb3-5bcfa6821369-kube-api-access-tssdz" (OuterVolumeSpecName: "kube-api-access-tssdz") pod "c2c7a27b-fa82-4be8-bcb3-5bcfa6821369" (UID: "c2c7a27b-fa82-4be8-bcb3-5bcfa6821369"). InnerVolumeSpecName "kube-api-access-tssdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:52:18.174341 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.174305    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tssdz\" (UniqueName: \"kubernetes.io/projected/c2c7a27b-fa82-4be8-bcb3-5bcfa6821369-kube-api-access-tssdz\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:52:18.174341 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.174340    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2c7a27b-fa82-4be8-bcb3-5bcfa6821369-extensions-socket-volume\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:52:18.362861 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.362768    2557 generic.go:356] "Generic (PLEG): container finished" podID="c2c7a27b-fa82-4be8-bcb3-5bcfa6821369" containerID="c7c5fd434f432402c17f6a32d5dc701cdad19271390aac687f9c2e3e07be655a" exitCode=0
Jul 20 12:52:18.362861 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.362823    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"
Jul 20 12:52:18.362861 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.362846    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq" event={"ID":"c2c7a27b-fa82-4be8-bcb3-5bcfa6821369","Type":"ContainerDied","Data":"c7c5fd434f432402c17f6a32d5dc701cdad19271390aac687f9c2e3e07be655a"}
Jul 20 12:52:18.363122 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.362915    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq" event={"ID":"c2c7a27b-fa82-4be8-bcb3-5bcfa6821369","Type":"ContainerDied","Data":"375d453936e6500d430a5d17a86e03874bf5b8fe3440f4da0db1c6da68bfd724"}
Jul 20 12:52:18.363122 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.362937    2557 scope.go:117] "RemoveContainer" containerID="c7c5fd434f432402c17f6a32d5dc701cdad19271390aac687f9c2e3e07be655a"
Jul 20 12:52:18.371422 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.371407    2557 scope.go:117] "RemoveContainer" containerID="c7c5fd434f432402c17f6a32d5dc701cdad19271390aac687f9c2e3e07be655a"
Jul 20 12:52:18.371677 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:52:18.371659    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7c5fd434f432402c17f6a32d5dc701cdad19271390aac687f9c2e3e07be655a\": container with ID starting with c7c5fd434f432402c17f6a32d5dc701cdad19271390aac687f9c2e3e07be655a not found: ID does not exist" containerID="c7c5fd434f432402c17f6a32d5dc701cdad19271390aac687f9c2e3e07be655a"
Jul 20 12:52:18.371736 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.371685    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c5fd434f432402c17f6a32d5dc701cdad19271390aac687f9c2e3e07be655a"} err="failed to get container status \"c7c5fd434f432402c17f6a32d5dc701cdad19271390aac687f9c2e3e07be655a\": rpc error: code = NotFound desc = could not find container \"c7c5fd434f432402c17f6a32d5dc701cdad19271390aac687f9c2e3e07be655a\": container with ID starting with c7c5fd434f432402c17f6a32d5dc701cdad19271390aac687f9c2e3e07be655a not found: ID does not exist"
Jul 20 12:52:18.391069 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.391044    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"]
Jul 20 12:52:18.397046 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:18.397024    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d97sq"]
Jul 20 12:52:19.379356 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:19.379322    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2c7a27b-fa82-4be8-bcb3-5bcfa6821369" path="/var/lib/kubelet/pods/c2c7a27b-fa82-4be8-bcb3-5bcfa6821369/volumes"
Jul 20 12:52:34.094882 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.094848    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"]
Jul 20 12:52:34.095252 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.095153    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2c7a27b-fa82-4be8-bcb3-5bcfa6821369" containerName="manager"
Jul 20 12:52:34.095252 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.095168    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2c7a27b-fa82-4be8-bcb3-5bcfa6821369" containerName="manager"
Jul 20 12:52:34.095252 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.095239    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2c7a27b-fa82-4be8-bcb3-5bcfa6821369" containerName="manager"
Jul 20 12:52:34.098231 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.098211    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.100913 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.100890    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kdqx5\""
Jul 20 12:52:34.111925 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.111903    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"]
Jul 20 12:52:34.197824 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.197790    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.197977 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.197838    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b87714f9-0043-473e-a7e5-12230a85f5d7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.197977 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.197857    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b87714f9-0043-473e-a7e5-12230a85f5d7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.197977 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.197879    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.197977 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.197907    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28hsv\" (UniqueName: \"kubernetes.io/projected/b87714f9-0043-473e-a7e5-12230a85f5d7-kube-api-access-28hsv\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.197977 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.197923    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.198137 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.198015    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b87714f9-0043-473e-a7e5-12230a85f5d7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.198137 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.198046    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.198137 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.198063    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.299355 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.299324    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b87714f9-0043-473e-a7e5-12230a85f5d7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.299355 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.299365    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b87714f9-0043-473e-a7e5-12230a85f5d7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.299591 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.299396    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.299591 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.299421    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28hsv\" (UniqueName: \"kubernetes.io/projected/b87714f9-0043-473e-a7e5-12230a85f5d7-kube-api-access-28hsv\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.299591 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.299445    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.299591 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.299522    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b87714f9-0043-473e-a7e5-12230a85f5d7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.299591 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.299550    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.299591 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.299575    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.299919 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.299612    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.300106 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.300078    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.300209 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.300100    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.300209 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.300144    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.300318 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.300206    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.300634 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.300592    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b87714f9-0043-473e-a7e5-12230a85f5d7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.301690 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.301669    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b87714f9-0043-473e-a7e5-12230a85f5d7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.301958 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.301938    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b87714f9-0043-473e-a7e5-12230a85f5d7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.310080 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.310053    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28hsv\" (UniqueName: \"kubernetes.io/projected/b87714f9-0043-473e-a7e5-12230a85f5d7-kube-api-access-28hsv\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.311100 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.311082    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b87714f9-0043-473e-a7e5-12230a85f5d7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gjvc4\" (UID: \"b87714f9-0043-473e-a7e5-12230a85f5d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.407562 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.407466    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:34.540784 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:34.540751    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"]
Jul 20 12:52:34.544127 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:52:34.544104    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87714f9_0043_473e_a7e5_12230a85f5d7.slice/crio-13d9181ae178f113065cc973ffa57fcd386f3721e77ef96b9824ac98fb5b80c8 WatchSource:0}: Error finding container 13d9181ae178f113065cc973ffa57fcd386f3721e77ef96b9824ac98fb5b80c8: Status 404 returned error can't find the container with id 13d9181ae178f113065cc973ffa57fcd386f3721e77ef96b9824ac98fb5b80c8
Jul 20 12:52:35.435961 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:35.435923    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4" event={"ID":"b87714f9-0043-473e-a7e5-12230a85f5d7","Type":"ContainerStarted","Data":"13d9181ae178f113065cc973ffa57fcd386f3721e77ef96b9824ac98fb5b80c8"}
Jul 20 12:52:36.989686 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:36.989650    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 12:52:36.989976 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:36.989735    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 12:52:36.989976 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:36.989771    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 12:52:37.446654 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:37.446607    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4" event={"ID":"b87714f9-0043-473e-a7e5-12230a85f5d7","Type":"ContainerStarted","Data":"5246d5ea3550a092c134c747537eaab583a1d9190d40023806825acaa8572adc"}
Jul 20 12:52:37.469052 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:37.468976    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4" podStartSLOduration=1.025615947 podStartE2EDuration="3.468956721s" totalImagesPullingTime="2.443340774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:52:37.468586813 +0000 UTC m=+502.601569939" watchObservedRunningTime="2026-07-20 12:52:37.468956721 +0000 UTC m=+502.601939822"
Jul 20 12:52:38.407797 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.407758    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:38.409189 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.409165    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gjvc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 20 12:52:38.409295 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.409219    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4" podUID="b87714f9-0043-473e-a7e5-12230a85f5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 20 12:52:38.451321 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.451291    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"]
Jul 20 12:52:38.453707 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.453685    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"
Jul 20 12:52:38.456288 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.456266    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 20 12:52:38.456425 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.456319    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5htl2\""
Jul 20 12:52:38.456690 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.456673    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 12:52:38.457023 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.457009    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 12:52:38.465209 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.465187    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"]
Jul 20 12:52:38.532268 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.532235    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnt5l\" (UniqueName: \"kubernetes.io/projected/aef3e810-3ec7-4144-8b55-733aadb86ef5-kube-api-access-pnt5l\") pod \"limitador-limitador-64c94fd64f-qr4zm\" (UID: \"aef3e810-3ec7-4144-8b55-733aadb86ef5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"
Jul 20 12:52:38.532468 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.532322    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aef3e810-3ec7-4144-8b55-733aadb86ef5-config-file\") pod \"limitador-limitador-64c94fd64f-qr4zm\" (UID: \"aef3e810-3ec7-4144-8b55-733aadb86ef5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"
Jul 20 12:52:38.552271 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.552241    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"]
Jul 20 12:52:38.633711 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.633670    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aef3e810-3ec7-4144-8b55-733aadb86ef5-config-file\") pod \"limitador-limitador-64c94fd64f-qr4zm\" (UID: \"aef3e810-3ec7-4144-8b55-733aadb86ef5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"
Jul 20 12:52:38.633896 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.633756    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnt5l\" (UniqueName: \"kubernetes.io/projected/aef3e810-3ec7-4144-8b55-733aadb86ef5-kube-api-access-pnt5l\") pod \"limitador-limitador-64c94fd64f-qr4zm\" (UID: \"aef3e810-3ec7-4144-8b55-733aadb86ef5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"
Jul 20 12:52:38.634501 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.634471    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aef3e810-3ec7-4144-8b55-733aadb86ef5-config-file\") pod \"limitador-limitador-64c94fd64f-qr4zm\" (UID: \"aef3e810-3ec7-4144-8b55-733aadb86ef5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"
Jul 20 12:52:38.642938 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.642912    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnt5l\" (UniqueName: \"kubernetes.io/projected/aef3e810-3ec7-4144-8b55-733aadb86ef5-kube-api-access-pnt5l\") pod \"limitador-limitador-64c94fd64f-qr4zm\" (UID: \"aef3e810-3ec7-4144-8b55-733aadb86ef5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"
Jul 20 12:52:38.766413 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.766319    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"
Jul 20 12:52:38.900248 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:38.900215    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"]
Jul 20 12:52:38.903197 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:52:38.903167    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef3e810_3ec7_4144_8b55_733aadb86ef5.slice/crio-2902b6a60578df5c19c340b062c7b733e5ede29c5002e64ed283c08d9ca5d61a WatchSource:0}: Error finding container 2902b6a60578df5c19c340b062c7b733e5ede29c5002e64ed283c08d9ca5d61a: Status 404 returned error can't find the container with id 2902b6a60578df5c19c340b062c7b733e5ede29c5002e64ed283c08d9ca5d61a
Jul 20 12:52:39.411703 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:39.411674    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:39.456073 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:39.456039    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm" event={"ID":"aef3e810-3ec7-4144-8b55-733aadb86ef5","Type":"ContainerStarted","Data":"2902b6a60578df5c19c340b062c7b733e5ede29c5002e64ed283c08d9ca5d61a"}
Jul 20 12:52:39.456260 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:39.456213    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:39.457307 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:39.457286    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:52:42.476582 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:42.476545    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm" event={"ID":"aef3e810-3ec7-4144-8b55-733aadb86ef5","Type":"ContainerStarted","Data":"e97cfb44eba961907e42ed02388c4b71b120548d2abe878dcb51cae8b2fa44f3"}
Jul 20 12:52:42.477058 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:42.476795    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"
Jul 20 12:52:42.492462 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:42.492415    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm" podStartSLOduration=1.846913628 podStartE2EDuration="4.49240216s" totalImagesPullingTime="2.645488532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:52:42.491157107 +0000 UTC m=+507.624140206" watchObservedRunningTime="2026-07-20 12:52:42.49240216 +0000 UTC m=+507.625385678"
Jul 20 12:52:53.482513 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:53.482478    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"
Jul 20 12:52:53.859454 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:53.859420    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"]
Jul 20 12:52:53.859671 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:53.859646    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm" podUID="aef3e810-3ec7-4144-8b55-733aadb86ef5" containerName="limitador" containerID="cri-o://e97cfb44eba961907e42ed02388c4b71b120548d2abe878dcb51cae8b2fa44f3" gracePeriod=30
Jul 20 12:52:54.416525 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.416500    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"
Jul 20 12:52:54.477334 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.477252    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnt5l\" (UniqueName: \"kubernetes.io/projected/aef3e810-3ec7-4144-8b55-733aadb86ef5-kube-api-access-pnt5l\") pod \"aef3e810-3ec7-4144-8b55-733aadb86ef5\" (UID: \"aef3e810-3ec7-4144-8b55-733aadb86ef5\") "
Jul 20 12:52:54.477334 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.477300    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aef3e810-3ec7-4144-8b55-733aadb86ef5-config-file\") pod \"aef3e810-3ec7-4144-8b55-733aadb86ef5\" (UID: \"aef3e810-3ec7-4144-8b55-733aadb86ef5\") "
Jul 20 12:52:54.477721 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.477698    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aef3e810-3ec7-4144-8b55-733aadb86ef5-config-file" (OuterVolumeSpecName: "config-file") pod "aef3e810-3ec7-4144-8b55-733aadb86ef5" (UID: "aef3e810-3ec7-4144-8b55-733aadb86ef5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 12:52:54.479310 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.479286    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aef3e810-3ec7-4144-8b55-733aadb86ef5-kube-api-access-pnt5l" (OuterVolumeSpecName: "kube-api-access-pnt5l") pod "aef3e810-3ec7-4144-8b55-733aadb86ef5" (UID: "aef3e810-3ec7-4144-8b55-733aadb86ef5"). InnerVolumeSpecName "kube-api-access-pnt5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:52:54.527072 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.527032    2557 generic.go:356] "Generic (PLEG): container finished" podID="aef3e810-3ec7-4144-8b55-733aadb86ef5" containerID="e97cfb44eba961907e42ed02388c4b71b120548d2abe878dcb51cae8b2fa44f3" exitCode=0
Jul 20 12:52:54.527522 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.527080    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"
Jul 20 12:52:54.527522 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.527111    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm" event={"ID":"aef3e810-3ec7-4144-8b55-733aadb86ef5","Type":"ContainerDied","Data":"e97cfb44eba961907e42ed02388c4b71b120548d2abe878dcb51cae8b2fa44f3"}
Jul 20 12:52:54.527522 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.527154    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qr4zm" event={"ID":"aef3e810-3ec7-4144-8b55-733aadb86ef5","Type":"ContainerDied","Data":"2902b6a60578df5c19c340b062c7b733e5ede29c5002e64ed283c08d9ca5d61a"}
Jul 20 12:52:54.527522 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.527175    2557 scope.go:117] "RemoveContainer" containerID="e97cfb44eba961907e42ed02388c4b71b120548d2abe878dcb51cae8b2fa44f3"
Jul 20 12:52:54.536437 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.536419    2557 scope.go:117] "RemoveContainer" containerID="e97cfb44eba961907e42ed02388c4b71b120548d2abe878dcb51cae8b2fa44f3"
Jul 20 12:52:54.536730 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:52:54.536709    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e97cfb44eba961907e42ed02388c4b71b120548d2abe878dcb51cae8b2fa44f3\": container with ID starting with e97cfb44eba961907e42ed02388c4b71b120548d2abe878dcb51cae8b2fa44f3 not found: ID does not exist" containerID="e97cfb44eba961907e42ed02388c4b71b120548d2abe878dcb51cae8b2fa44f3"
Jul 20 12:52:54.536788 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.536740    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e97cfb44eba961907e42ed02388c4b71b120548d2abe878dcb51cae8b2fa44f3"} err="failed to get container status \"e97cfb44eba961907e42ed02388c4b71b120548d2abe878dcb51cae8b2fa44f3\": rpc error: code = NotFound desc = could not find container \"e97cfb44eba961907e42ed02388c4b71b120548d2abe878dcb51cae8b2fa44f3\": container with ID starting with e97cfb44eba961907e42ed02388c4b71b120548d2abe878dcb51cae8b2fa44f3 not found: ID does not exist"
Jul 20 12:52:54.548273 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.548241    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"]
Jul 20 12:52:54.550372 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.550349    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qr4zm"]
Jul 20 12:52:54.577991 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.577963    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnt5l\" (UniqueName: \"kubernetes.io/projected/aef3e810-3ec7-4144-8b55-733aadb86ef5-kube-api-access-pnt5l\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:52:54.577991 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:54.577991    2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aef3e810-3ec7-4144-8b55-733aadb86ef5-config-file\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:52:55.379488 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:52:55.379456    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aef3e810-3ec7-4144-8b55-733aadb86ef5" path="/var/lib/kubelet/pods/aef3e810-3ec7-4144-8b55-733aadb86ef5/volumes"
Jul 20 12:53:00.176445 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.176413    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x"]
Jul 20 12:53:00.176840 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.176742    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aef3e810-3ec7-4144-8b55-733aadb86ef5" containerName="limitador"
Jul 20 12:53:00.176840 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.176755    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="aef3e810-3ec7-4144-8b55-733aadb86ef5" containerName="limitador"
Jul 20 12:53:00.176840 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.176811    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="aef3e810-3ec7-4144-8b55-733aadb86ef5" containerName="limitador"
Jul 20 12:53:00.181048 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.181022    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x"
Jul 20 12:53:00.183290 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.183261    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rkw6n\""
Jul 20 12:53:00.183528 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.183505    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 12:53:00.183705 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.183685    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 12:53:00.183848 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.183830    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 20 12:53:00.187522 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.187496    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x"]
Jul 20 12:53:00.325712 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.325679    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0ee5126d-6d33-4730-afef-65171dcc61c2-data\") pod \"postgres-69fb4594cf-6xv8x\" (UID: \"0ee5126d-6d33-4730-afef-65171dcc61c2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x"
Jul 20 12:53:00.325878 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.325732    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdv4v\" (UniqueName: \"kubernetes.io/projected/0ee5126d-6d33-4730-afef-65171dcc61c2-kube-api-access-wdv4v\") pod \"postgres-69fb4594cf-6xv8x\" (UID: \"0ee5126d-6d33-4730-afef-65171dcc61c2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x"
Jul 20 12:53:00.427005 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.426921    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdv4v\" (UniqueName: \"kubernetes.io/projected/0ee5126d-6d33-4730-afef-65171dcc61c2-kube-api-access-wdv4v\") pod \"postgres-69fb4594cf-6xv8x\" (UID: \"0ee5126d-6d33-4730-afef-65171dcc61c2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x"
Jul 20 12:53:00.427144 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.427059    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0ee5126d-6d33-4730-afef-65171dcc61c2-data\") pod \"postgres-69fb4594cf-6xv8x\" (UID: \"0ee5126d-6d33-4730-afef-65171dcc61c2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x"
Jul 20 12:53:00.427367 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.427351    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0ee5126d-6d33-4730-afef-65171dcc61c2-data\") pod \"postgres-69fb4594cf-6xv8x\" (UID: \"0ee5126d-6d33-4730-afef-65171dcc61c2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x"
Jul 20 12:53:00.437593 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.437569    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdv4v\" (UniqueName: \"kubernetes.io/projected/0ee5126d-6d33-4730-afef-65171dcc61c2-kube-api-access-wdv4v\") pod \"postgres-69fb4594cf-6xv8x\" (UID: \"0ee5126d-6d33-4730-afef-65171dcc61c2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x"
Jul 20 12:53:00.491787 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.491761    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x"
Jul 20 12:53:00.620844 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:00.620813    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x"]
Jul 20 12:53:00.625573 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:53:00.625549    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee5126d_6d33_4730_afef_65171dcc61c2.slice/crio-0b0f11d6d55d387b16ad9884001b309ee68c1d0ec119591a21118097eec46595 WatchSource:0}: Error finding container 0b0f11d6d55d387b16ad9884001b309ee68c1d0ec119591a21118097eec46595: Status 404 returned error can't find the container with id 0b0f11d6d55d387b16ad9884001b309ee68c1d0ec119591a21118097eec46595
Jul 20 12:53:01.559788 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:01.559754    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x" event={"ID":"0ee5126d-6d33-4730-afef-65171dcc61c2","Type":"ContainerStarted","Data":"0b0f11d6d55d387b16ad9884001b309ee68c1d0ec119591a21118097eec46595"}
Jul 20 12:53:06.586607 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:06.586573    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x" event={"ID":"0ee5126d-6d33-4730-afef-65171dcc61c2","Type":"ContainerStarted","Data":"3145fba65ea3538e485043982bc4daa6d80ea9aa03fd5b720b81d1797bd07d24"}
Jul 20 12:53:06.587041 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:06.586646    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x"
Jul 20 12:53:06.603392 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:06.603350    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x" podStartSLOduration=1.624742923 podStartE2EDuration="6.603335034s" totalImagesPullingTime="4.978592111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:53:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:53:06.6023244 +0000 UTC m=+531.735307503" watchObservedRunningTime="2026-07-20 12:53:06.603335034 +0000 UTC m=+531.736318133"
Jul 20 12:53:12.620073 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:12.620002    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6xv8x"
Jul 20 12:53:20.290397 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.290363    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7449dbc6c6-zcn4h"]
Jul 20 12:53:20.295733 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.295708    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7449dbc6c6-zcn4h"
Jul 20 12:53:20.298162 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.298130    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 12:53:20.298425 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.298402    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 12:53:20.298763 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.298746    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j6czz\""
Jul 20 12:53:20.305670 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.305646    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7449dbc6c6-zcn4h"]
Jul 20 12:53:20.387857 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.387827    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-webhook-cert\") pod \"maas-controller-7449dbc6c6-zcn4h\" (UID: \"bc6aea75-3ea7-45bb-a377-0213d7d6b43a\") " pod="opendatahub/maas-controller-7449dbc6c6-zcn4h"
Jul 20 12:53:20.387857 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.387867    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nn85\" (UniqueName: \"kubernetes.io/projected/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-kube-api-access-6nn85\") pod \"maas-controller-7449dbc6c6-zcn4h\" (UID: \"bc6aea75-3ea7-45bb-a377-0213d7d6b43a\") " pod="opendatahub/maas-controller-7449dbc6c6-zcn4h"
Jul 20 12:53:20.449172 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.449144    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5767485bdf-b6r9p"]
Jul 20 12:53:20.451402 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.451381    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5767485bdf-b6r9p"
Jul 20 12:53:20.463458 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.463432    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5767485bdf-b6r9p"]
Jul 20 12:53:20.488813 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.488788    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nn85\" (UniqueName: \"kubernetes.io/projected/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-kube-api-access-6nn85\") pod \"maas-controller-7449dbc6c6-zcn4h\" (UID: \"bc6aea75-3ea7-45bb-a377-0213d7d6b43a\") " pod="opendatahub/maas-controller-7449dbc6c6-zcn4h"
Jul 20 12:53:20.488911 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.488852    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e0a86e8-7063-4625-8698-02c37c503f2d-webhook-cert\") pod \"maas-controller-5767485bdf-b6r9p\" (UID: \"0e0a86e8-7063-4625-8698-02c37c503f2d\") " pod="opendatahub/maas-controller-5767485bdf-b6r9p"
Jul 20 12:53:20.488911 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.488870    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts26n\" (UniqueName: \"kubernetes.io/projected/0e0a86e8-7063-4625-8698-02c37c503f2d-kube-api-access-ts26n\") pod \"maas-controller-5767485bdf-b6r9p\" (UID: \"0e0a86e8-7063-4625-8698-02c37c503f2d\") " pod="opendatahub/maas-controller-5767485bdf-b6r9p"
Jul 20 12:53:20.488911 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.488903    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-webhook-cert\") pod \"maas-controller-7449dbc6c6-zcn4h\" (UID: \"bc6aea75-3ea7-45bb-a377-0213d7d6b43a\") " pod="opendatahub/maas-controller-7449dbc6c6-zcn4h"
Jul 20 12:53:20.489029 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:53:20.489011    2557 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 20 12:53:20.489086 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:53:20.489076    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-webhook-cert podName:bc6aea75-3ea7-45bb-a377-0213d7d6b43a nodeName:}" failed. No retries permitted until 2026-07-20 12:53:20.989061858 +0000 UTC m=+546.122044935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-webhook-cert") pod "maas-controller-7449dbc6c6-zcn4h" (UID: "bc6aea75-3ea7-45bb-a377-0213d7d6b43a") : secret "maas-controller-webhook-cert" not found
Jul 20 12:53:20.497599 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.497575    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nn85\" (UniqueName: \"kubernetes.io/projected/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-kube-api-access-6nn85\") pod \"maas-controller-7449dbc6c6-zcn4h\" (UID: \"bc6aea75-3ea7-45bb-a377-0213d7d6b43a\") " pod="opendatahub/maas-controller-7449dbc6c6-zcn4h"
Jul 20 12:53:20.589700 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.589665    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e0a86e8-7063-4625-8698-02c37c503f2d-webhook-cert\") pod \"maas-controller-5767485bdf-b6r9p\" (UID: \"0e0a86e8-7063-4625-8698-02c37c503f2d\") " pod="opendatahub/maas-controller-5767485bdf-b6r9p"
Jul 20 12:53:20.589855 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.589707    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts26n\" (UniqueName: \"kubernetes.io/projected/0e0a86e8-7063-4625-8698-02c37c503f2d-kube-api-access-ts26n\") pod \"maas-controller-5767485bdf-b6r9p\" (UID: \"0e0a86e8-7063-4625-8698-02c37c503f2d\") " pod="opendatahub/maas-controller-5767485bdf-b6r9p"
Jul 20 12:53:20.589855 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:53:20.589802    2557 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 20 12:53:20.589855 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:53:20.589856    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e0a86e8-7063-4625-8698-02c37c503f2d-webhook-cert podName:0e0a86e8-7063-4625-8698-02c37c503f2d nodeName:}" failed. No retries permitted until 2026-07-20 12:53:21.089841664 +0000 UTC m=+546.222824742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0e0a86e8-7063-4625-8698-02c37c503f2d-webhook-cert") pod "maas-controller-5767485bdf-b6r9p" (UID: "0e0a86e8-7063-4625-8698-02c37c503f2d") : secret "maas-controller-webhook-cert" not found
Jul 20 12:53:20.598222 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.598199    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts26n\" (UniqueName: \"kubernetes.io/projected/0e0a86e8-7063-4625-8698-02c37c503f2d-kube-api-access-ts26n\") pod \"maas-controller-5767485bdf-b6r9p\" (UID: \"0e0a86e8-7063-4625-8698-02c37c503f2d\") " pod="opendatahub/maas-controller-5767485bdf-b6r9p"
Jul 20 12:53:20.993467 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.993384    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-webhook-cert\") pod \"maas-controller-7449dbc6c6-zcn4h\" (UID: \"bc6aea75-3ea7-45bb-a377-0213d7d6b43a\") " pod="opendatahub/maas-controller-7449dbc6c6-zcn4h"
Jul 20 12:53:20.995844 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:20.995816    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-webhook-cert\") pod \"maas-controller-7449dbc6c6-zcn4h\" (UID: \"bc6aea75-3ea7-45bb-a377-0213d7d6b43a\") " pod="opendatahub/maas-controller-7449dbc6c6-zcn4h"
Jul 20 12:53:21.094846 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:21.094813    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e0a86e8-7063-4625-8698-02c37c503f2d-webhook-cert\") pod \"maas-controller-5767485bdf-b6r9p\" (UID: \"0e0a86e8-7063-4625-8698-02c37c503f2d\") " pod="opendatahub/maas-controller-5767485bdf-b6r9p"
Jul 20 12:53:21.097135 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:21.097115    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e0a86e8-7063-4625-8698-02c37c503f2d-webhook-cert\") pod \"maas-controller-5767485bdf-b6r9p\" (UID: \"0e0a86e8-7063-4625-8698-02c37c503f2d\") " pod="opendatahub/maas-controller-5767485bdf-b6r9p"
Jul 20 12:53:21.207341 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:21.207300    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7449dbc6c6-zcn4h"
Jul 20 12:53:21.331992 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:21.331854    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7449dbc6c6-zcn4h"]
Jul 20 12:53:21.334415 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:53:21.334391    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6aea75_3ea7_45bb_a377_0213d7d6b43a.slice/crio-02e3b92bc9cb20dd5addeed978eec4b46098489d9bee3ac061c8bd9e7c4346d6 WatchSource:0}: Error finding container 02e3b92bc9cb20dd5addeed978eec4b46098489d9bee3ac061c8bd9e7c4346d6: Status 404 returned error can't find the container with id 02e3b92bc9cb20dd5addeed978eec4b46098489d9bee3ac061c8bd9e7c4346d6
Jul 20 12:53:21.362322 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:21.362296    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5767485bdf-b6r9p"
Jul 20 12:53:21.486965 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:21.486933    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5767485bdf-b6r9p"]
Jul 20 12:53:21.489583 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:53:21.489558    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0a86e8_7063_4625_8698_02c37c503f2d.slice/crio-b5ea125686a548e78cca5fbb6e2bb9427f597eff03d8262a370a3f2ab2c93d13 WatchSource:0}: Error finding container b5ea125686a548e78cca5fbb6e2bb9427f597eff03d8262a370a3f2ab2c93d13: Status 404 returned error can't find the container with id b5ea125686a548e78cca5fbb6e2bb9427f597eff03d8262a370a3f2ab2c93d13
Jul 20 12:53:21.654804 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:21.654765    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5767485bdf-b6r9p" event={"ID":"0e0a86e8-7063-4625-8698-02c37c503f2d","Type":"ContainerStarted","Data":"b5ea125686a548e78cca5fbb6e2bb9427f597eff03d8262a370a3f2ab2c93d13"}
Jul 20 12:53:21.655861 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:21.655840    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7449dbc6c6-zcn4h" event={"ID":"bc6aea75-3ea7-45bb-a377-0213d7d6b43a","Type":"ContainerStarted","Data":"02e3b92bc9cb20dd5addeed978eec4b46098489d9bee3ac061c8bd9e7c4346d6"}
Jul 20 12:53:24.674047 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:24.674007    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5767485bdf-b6r9p" event={"ID":"0e0a86e8-7063-4625-8698-02c37c503f2d","Type":"ContainerStarted","Data":"f9a7e50633a425dcf70019f784afc4ed10fee6ad0c3dbc8dc91fa359d5701b3f"}
Jul 20 12:53:24.674521 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:24.674178    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5767485bdf-b6r9p"
Jul 20 12:53:24.675503 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:24.675482    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7449dbc6c6-zcn4h" event={"ID":"bc6aea75-3ea7-45bb-a377-0213d7d6b43a","Type":"ContainerStarted","Data":"9a884289a0f4b2b66d738c671c7faa11cdeced9cdeaf712ef626e191130c4b18"}
Jul 20 12:53:24.675573 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:24.675526    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7449dbc6c6-zcn4h"
Jul 20 12:53:24.714483 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:24.714437    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5767485bdf-b6r9p" podStartSLOduration=2.3310817679999998 podStartE2EDuration="4.714422932s" totalImagesPullingTime="2.383341164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:53:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:53:24.706429414 +0000 UTC m=+549.839412515" watchObservedRunningTime="2026-07-20 12:53:24.714422932 +0000 UTC m=+549.847406031"
Jul 20 12:53:35.681856 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:35.681821    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7449dbc6c6-zcn4h"
Jul 20 12:53:35.682308 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:35.681994    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5767485bdf-b6r9p"
Jul 20 12:53:35.702092 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:35.702042    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7449dbc6c6-zcn4h" podStartSLOduration=13.154823171 podStartE2EDuration="15.702028907s" totalImagesPullingTime="2.547205736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:53:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:53:24.729743066 +0000 UTC m=+549.862726168" watchObservedRunningTime="2026-07-20 12:53:35.702028907 +0000 UTC m=+560.835012007"
Jul 20 12:53:35.742964 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:35.742930    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7449dbc6c6-zcn4h"]
Jul 20 12:53:35.743138 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:35.743114    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7449dbc6c6-zcn4h" podUID="bc6aea75-3ea7-45bb-a377-0213d7d6b43a" containerName="manager" containerID="cri-o://9a884289a0f4b2b66d738c671c7faa11cdeced9cdeaf712ef626e191130c4b18" gracePeriod=30
Jul 20 12:53:35.980348 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:35.980325    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7449dbc6c6-zcn4h"
Jul 20 12:53:36.018408 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.018380    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-webhook-cert\") pod \"bc6aea75-3ea7-45bb-a377-0213d7d6b43a\" (UID: \"bc6aea75-3ea7-45bb-a377-0213d7d6b43a\") "
Jul 20 12:53:36.018585 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.018568    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nn85\" (UniqueName: \"kubernetes.io/projected/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-kube-api-access-6nn85\") pod \"bc6aea75-3ea7-45bb-a377-0213d7d6b43a\" (UID: \"bc6aea75-3ea7-45bb-a377-0213d7d6b43a\") "
Jul 20 12:53:36.020567 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.020533    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-kube-api-access-6nn85" (OuterVolumeSpecName: "kube-api-access-6nn85") pod "bc6aea75-3ea7-45bb-a377-0213d7d6b43a" (UID: "bc6aea75-3ea7-45bb-a377-0213d7d6b43a"). InnerVolumeSpecName "kube-api-access-6nn85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:53:36.020567 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.020552    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bc6aea75-3ea7-45bb-a377-0213d7d6b43a" (UID: "bc6aea75-3ea7-45bb-a377-0213d7d6b43a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:53:36.119804 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.119765    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nn85\" (UniqueName: \"kubernetes.io/projected/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-kube-api-access-6nn85\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:53:36.119804 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.119800    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc6aea75-3ea7-45bb-a377-0213d7d6b43a-webhook-cert\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:53:36.732243 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.732212    2557 generic.go:356] "Generic (PLEG): container finished" podID="bc6aea75-3ea7-45bb-a377-0213d7d6b43a" containerID="9a884289a0f4b2b66d738c671c7faa11cdeced9cdeaf712ef626e191130c4b18" exitCode=0
Jul 20 12:53:36.732668 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.732256    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7449dbc6c6-zcn4h"
Jul 20 12:53:36.732668 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.732305    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7449dbc6c6-zcn4h" event={"ID":"bc6aea75-3ea7-45bb-a377-0213d7d6b43a","Type":"ContainerDied","Data":"9a884289a0f4b2b66d738c671c7faa11cdeced9cdeaf712ef626e191130c4b18"}
Jul 20 12:53:36.732668 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.732361    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7449dbc6c6-zcn4h" event={"ID":"bc6aea75-3ea7-45bb-a377-0213d7d6b43a","Type":"ContainerDied","Data":"02e3b92bc9cb20dd5addeed978eec4b46098489d9bee3ac061c8bd9e7c4346d6"}
Jul 20 12:53:36.732668 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.732384    2557 scope.go:117] "RemoveContainer" containerID="9a884289a0f4b2b66d738c671c7faa11cdeced9cdeaf712ef626e191130c4b18"
Jul 20 12:53:36.744809 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.744542    2557 scope.go:117] "RemoveContainer" containerID="9a884289a0f4b2b66d738c671c7faa11cdeced9cdeaf712ef626e191130c4b18"
Jul 20 12:53:36.744916 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:53:36.744894    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a884289a0f4b2b66d738c671c7faa11cdeced9cdeaf712ef626e191130c4b18\": container with ID starting with 9a884289a0f4b2b66d738c671c7faa11cdeced9cdeaf712ef626e191130c4b18 not found: ID does not exist" containerID="9a884289a0f4b2b66d738c671c7faa11cdeced9cdeaf712ef626e191130c4b18"
Jul 20 12:53:36.744959 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.744919    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a884289a0f4b2b66d738c671c7faa11cdeced9cdeaf712ef626e191130c4b18"} err="failed to get container status \"9a884289a0f4b2b66d738c671c7faa11cdeced9cdeaf712ef626e191130c4b18\": rpc error: code = NotFound desc = could not find container \"9a884289a0f4b2b66d738c671c7faa11cdeced9cdeaf712ef626e191130c4b18\": container with ID starting with 9a884289a0f4b2b66d738c671c7faa11cdeced9cdeaf712ef626e191130c4b18 not found: ID does not exist"
Jul 20 12:53:36.757447 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.757418    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7449dbc6c6-zcn4h"]
Jul 20 12:53:36.761714 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:36.761677    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7449dbc6c6-zcn4h"]
Jul 20 12:53:37.379765 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:37.379732    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc6aea75-3ea7-45bb-a377-0213d7d6b43a" path="/var/lib/kubelet/pods/bc6aea75-3ea7-45bb-a377-0213d7d6b43a/volumes"
Jul 20 12:53:56.483498 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.483463    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"]
Jul 20 12:53:56.483972 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.483852    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc6aea75-3ea7-45bb-a377-0213d7d6b43a" containerName="manager"
Jul 20 12:53:56.483972 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.483866    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc6aea75-3ea7-45bb-a377-0213d7d6b43a" containerName="manager"
Jul 20 12:53:56.483972 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.483929    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc6aea75-3ea7-45bb-a377-0213d7d6b43a" containerName="manager"
Jul 20 12:53:56.490505 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.490485    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"
Jul 20 12:53:56.492837 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.492819    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 20 12:53:56.493843 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.493826    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ts9xh\""
Jul 20 12:53:56.508832 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.508808    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"]
Jul 20 12:53:56.590870 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.590837    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e5fcb3c-3274-40e6-914a-4f2854c1faae-openshift-service-ca\") pod \"maas-api-d4b798dcb-r2cnd\" (UID: \"1e5fcb3c-3274-40e6-914a-4f2854c1faae\") " pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"
Jul 20 12:53:56.591059 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.590966    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e5fcb3c-3274-40e6-914a-4f2854c1faae-maas-api-tls\") pod \"maas-api-d4b798dcb-r2cnd\" (UID: \"1e5fcb3c-3274-40e6-914a-4f2854c1faae\") " pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"
Jul 20 12:53:56.591059 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.590994    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg7xm\" (UniqueName: \"kubernetes.io/projected/1e5fcb3c-3274-40e6-914a-4f2854c1faae-kube-api-access-mg7xm\") pod \"maas-api-d4b798dcb-r2cnd\" (UID: \"1e5fcb3c-3274-40e6-914a-4f2854c1faae\") " pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"
Jul 20 12:53:56.691403 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.691368    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e5fcb3c-3274-40e6-914a-4f2854c1faae-maas-api-tls\") pod \"maas-api-d4b798dcb-r2cnd\" (UID: \"1e5fcb3c-3274-40e6-914a-4f2854c1faae\") " pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"
Jul 20 12:53:56.691403 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.691404    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg7xm\" (UniqueName: \"kubernetes.io/projected/1e5fcb3c-3274-40e6-914a-4f2854c1faae-kube-api-access-mg7xm\") pod \"maas-api-d4b798dcb-r2cnd\" (UID: \"1e5fcb3c-3274-40e6-914a-4f2854c1faae\") " pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"
Jul 20 12:53:56.691678 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.691447    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e5fcb3c-3274-40e6-914a-4f2854c1faae-openshift-service-ca\") pod \"maas-api-d4b798dcb-r2cnd\" (UID: \"1e5fcb3c-3274-40e6-914a-4f2854c1faae\") " pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"
Jul 20 12:53:56.691678 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:53:56.691524    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 20 12:53:56.691678 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:53:56.691603    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e5fcb3c-3274-40e6-914a-4f2854c1faae-maas-api-tls podName:1e5fcb3c-3274-40e6-914a-4f2854c1faae nodeName:}" failed. No retries permitted until 2026-07-20 12:53:57.191585724 +0000 UTC m=+582.324568811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1e5fcb3c-3274-40e6-914a-4f2854c1faae-maas-api-tls") pod "maas-api-d4b798dcb-r2cnd" (UID: "1e5fcb3c-3274-40e6-914a-4f2854c1faae") : secret "maas-api-serving-cert" not found
Jul 20 12:53:56.692046 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.692029    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e5fcb3c-3274-40e6-914a-4f2854c1faae-openshift-service-ca\") pod \"maas-api-d4b798dcb-r2cnd\" (UID: \"1e5fcb3c-3274-40e6-914a-4f2854c1faae\") " pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"
Jul 20 12:53:56.702101 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:56.702079    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg7xm\" (UniqueName: \"kubernetes.io/projected/1e5fcb3c-3274-40e6-914a-4f2854c1faae-kube-api-access-mg7xm\") pod \"maas-api-d4b798dcb-r2cnd\" (UID: \"1e5fcb3c-3274-40e6-914a-4f2854c1faae\") " pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"
Jul 20 12:53:57.194978 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.194941    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e5fcb3c-3274-40e6-914a-4f2854c1faae-maas-api-tls\") pod \"maas-api-d4b798dcb-r2cnd\" (UID: \"1e5fcb3c-3274-40e6-914a-4f2854c1faae\") " pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"
Jul 20 12:53:57.197716 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.197676    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e5fcb3c-3274-40e6-914a-4f2854c1faae-maas-api-tls\") pod \"maas-api-d4b798dcb-r2cnd\" (UID: \"1e5fcb3c-3274-40e6-914a-4f2854c1faae\") " pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"
Jul 20 12:53:57.199171 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.199146    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-97llz"]
Jul 20 12:53:57.202655 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.202637    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-97llz"
Jul 20 12:53:57.206841 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.206825    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 20 12:53:57.208517 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.208502    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-579rf\""
Jul 20 12:53:57.218745 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.218727    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-97llz"]
Jul 20 12:53:57.296216 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.296183    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsv67\" (UniqueName: \"kubernetes.io/projected/b1fd95ca-3edf-4e50-8c02-79917a7d57f9-kube-api-access-wsv67\") pod \"payload-pre-processing-7677b774bb-97llz\" (UID: \"b1fd95ca-3edf-4e50-8c02-79917a7d57f9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97llz"
Jul 20 12:53:57.296345 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.296233    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1fd95ca-3edf-4e50-8c02-79917a7d57f9-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-97llz\" (UID: \"b1fd95ca-3edf-4e50-8c02-79917a7d57f9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97llz"
Jul 20 12:53:57.300917 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.300890    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-kwknk"]
Jul 20 12:53:57.304342 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.304314    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-kwknk"
Jul 20 12:53:57.316356 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.316319    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-kwknk"]
Jul 20 12:53:57.397327 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.397299    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v9b2\" (UniqueName: \"kubernetes.io/projected/ff75f022-61d8-4556-b419-3d97c3f8f4fd-kube-api-access-8v9b2\") pod \"payload-processing-5bf47cd988-kwknk\" (UID: \"ff75f022-61d8-4556-b419-3d97c3f8f4fd\") " pod="openshift-ingress/payload-processing-5bf47cd988-kwknk"
Jul 20 12:53:57.397486 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.397365    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsv67\" (UniqueName: \"kubernetes.io/projected/b1fd95ca-3edf-4e50-8c02-79917a7d57f9-kube-api-access-wsv67\") pod \"payload-pre-processing-7677b774bb-97llz\" (UID: \"b1fd95ca-3edf-4e50-8c02-79917a7d57f9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97llz"
Jul 20 12:53:57.397486 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.397401    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1fd95ca-3edf-4e50-8c02-79917a7d57f9-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-97llz\" (UID: \"b1fd95ca-3edf-4e50-8c02-79917a7d57f9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97llz"
Jul 20 12:53:57.397486 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.397425    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff75f022-61d8-4556-b419-3d97c3f8f4fd-plugins-config-volume\") pod \"payload-processing-5bf47cd988-kwknk\" (UID: \"ff75f022-61d8-4556-b419-3d97c3f8f4fd\") " pod="openshift-ingress/payload-processing-5bf47cd988-kwknk"
Jul 20 12:53:57.398078 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.398060    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1fd95ca-3edf-4e50-8c02-79917a7d57f9-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-97llz\" (UID: \"b1fd95ca-3edf-4e50-8c02-79917a7d57f9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97llz"
Jul 20 12:53:57.401257 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.401236    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"
Jul 20 12:53:57.407556 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.407526    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsv67\" (UniqueName: \"kubernetes.io/projected/b1fd95ca-3edf-4e50-8c02-79917a7d57f9-kube-api-access-wsv67\") pod \"payload-pre-processing-7677b774bb-97llz\" (UID: \"b1fd95ca-3edf-4e50-8c02-79917a7d57f9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97llz"
Jul 20 12:53:57.498160 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.498125    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff75f022-61d8-4556-b419-3d97c3f8f4fd-plugins-config-volume\") pod \"payload-processing-5bf47cd988-kwknk\" (UID: \"ff75f022-61d8-4556-b419-3d97c3f8f4fd\") " pod="openshift-ingress/payload-processing-5bf47cd988-kwknk"
Jul 20 12:53:57.498592 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.498210    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v9b2\" (UniqueName: \"kubernetes.io/projected/ff75f022-61d8-4556-b419-3d97c3f8f4fd-kube-api-access-8v9b2\") pod \"payload-processing-5bf47cd988-kwknk\" (UID: \"ff75f022-61d8-4556-b419-3d97c3f8f4fd\") " pod="openshift-ingress/payload-processing-5bf47cd988-kwknk"
Jul 20 12:53:57.499216 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.499184    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff75f022-61d8-4556-b419-3d97c3f8f4fd-plugins-config-volume\") pod \"payload-processing-5bf47cd988-kwknk\" (UID: \"ff75f022-61d8-4556-b419-3d97c3f8f4fd\") " pod="openshift-ingress/payload-processing-5bf47cd988-kwknk"
Jul 20 12:53:57.508794 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.508761    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v9b2\" (UniqueName: \"kubernetes.io/projected/ff75f022-61d8-4556-b419-3d97c3f8f4fd-kube-api-access-8v9b2\") pod \"payload-processing-5bf47cd988-kwknk\" (UID: \"ff75f022-61d8-4556-b419-3d97c3f8f4fd\") " pod="openshift-ingress/payload-processing-5bf47cd988-kwknk"
Jul 20 12:53:57.513575 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.513549    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-97llz"
Jul 20 12:53:57.540545 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.540514    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"]
Jul 20 12:53:57.543827 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:53:57.543794    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5fcb3c_3274_40e6_914a_4f2854c1faae.slice/crio-9f67eb3aa43803444e038997d53e0e96c7bc104f1950204f1b3def037014f179 WatchSource:0}: Error finding container 9f67eb3aa43803444e038997d53e0e96c7bc104f1950204f1b3def037014f179: Status 404 returned error can't find the container with id 9f67eb3aa43803444e038997d53e0e96c7bc104f1950204f1b3def037014f179
Jul 20 12:53:57.615539 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.615505    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-kwknk"
Jul 20 12:53:57.660452 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.660416    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-97llz"]
Jul 20 12:53:57.663808 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:53:57.663770    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1fd95ca_3edf_4e50_8c02_79917a7d57f9.slice/crio-934086fa947f4ce8636ae7bcad3ea187d4684a31ee6515a9efbd8aaa57159b2f WatchSource:0}: Error finding container 934086fa947f4ce8636ae7bcad3ea187d4684a31ee6515a9efbd8aaa57159b2f: Status 404 returned error can't find the container with id 934086fa947f4ce8636ae7bcad3ea187d4684a31ee6515a9efbd8aaa57159b2f
Jul 20 12:53:57.762645 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.761141    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-kwknk"]
Jul 20 12:53:57.768874 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:53:57.768816    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff75f022_61d8_4556_b419_3d97c3f8f4fd.slice/crio-ac7eafb5c767e42933d207004d1499b1e5c722a10b0683343fa53f10650076ca WatchSource:0}: Error finding container ac7eafb5c767e42933d207004d1499b1e5c722a10b0683343fa53f10650076ca: Status 404 returned error can't find the container with id ac7eafb5c767e42933d207004d1499b1e5c722a10b0683343fa53f10650076ca
Jul 20 12:53:57.839431 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.839371    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-kwknk" event={"ID":"ff75f022-61d8-4556-b419-3d97c3f8f4fd","Type":"ContainerStarted","Data":"ac7eafb5c767e42933d207004d1499b1e5c722a10b0683343fa53f10650076ca"}
Jul 20 12:53:57.842399 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.842093    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd" event={"ID":"1e5fcb3c-3274-40e6-914a-4f2854c1faae","Type":"ContainerStarted","Data":"9f67eb3aa43803444e038997d53e0e96c7bc104f1950204f1b3def037014f179"}
Jul 20 12:53:57.843633 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:53:57.843591    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-97llz" event={"ID":"b1fd95ca-3edf-4e50-8c02-79917a7d57f9","Type":"ContainerStarted","Data":"934086fa947f4ce8636ae7bcad3ea187d4684a31ee6515a9efbd8aaa57159b2f"}
Jul 20 12:54:01.869899 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:01.869865    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-kwknk" event={"ID":"ff75f022-61d8-4556-b419-3d97c3f8f4fd","Type":"ContainerStarted","Data":"a24e75fe74c6ee12866cf454b9912e447b7dbd8899c45b303f40b9d8342958e9"}
Jul 20 12:54:01.870355 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:01.869944    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-kwknk"
Jul 20 12:54:01.871604 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:01.871579    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd" event={"ID":"1e5fcb3c-3274-40e6-914a-4f2854c1faae","Type":"ContainerStarted","Data":"462c5aa34baa903c5b1e7a5f581d97a3ff41479d3881f2867edb5d9490b9ac05"}
Jul 20 12:54:01.871696 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:01.871675    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"
Jul 20 12:54:01.873344 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:01.873316    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-97llz" event={"ID":"b1fd95ca-3edf-4e50-8c02-79917a7d57f9","Type":"ContainerStarted","Data":"5423a3bd7d25fb09d43722d44e29251ff24f932e8c603114910b5cd1170fd98a"}
Jul 20 12:54:01.873610 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:01.873588    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-97llz"
Jul 20 12:54:01.889584 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:01.889542    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-kwknk" podStartSLOduration=1.5634554 podStartE2EDuration="4.889530201s" totalImagesPullingTime="3.326074801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:54:01.887360962 +0000 UTC m=+587.020344061" watchObservedRunningTime="2026-07-20 12:54:01.889530201 +0000 UTC m=+587.022513279"
Jul 20 12:54:01.905791 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:01.905745    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-97llz" podStartSLOduration=1.481009486 podStartE2EDuration="4.905732375s" totalImagesPullingTime="3.424722889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:54:01.904376187 +0000 UTC m=+587.037359291" watchObservedRunningTime="2026-07-20 12:54:01.905732375 +0000 UTC m=+587.038715475"
Jul 20 12:54:01.934243 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:01.934201    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd" podStartSLOduration=2.465796837 podStartE2EDuration="5.934187603s" totalImagesPullingTime="3.468390766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:53:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:54:01.933784568 +0000 UTC m=+587.066767669" watchObservedRunningTime="2026-07-20 12:54:01.934187603 +0000 UTC m=+587.067170700"
Jul 20 12:54:04.752336 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:54:04.752304    2557 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87714f9_0043_473e_a7e5_12230a85f5d7.slice/crio-5246d5ea3550a092c134c747537eaab583a1d9190d40023806825acaa8572adc.scope\": RecentStats: unable to find data in memory cache]"
Jul 20 12:54:04.890552 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:04.890457    2557 generic.go:356] "Generic (PLEG): container finished" podID="b87714f9-0043-473e-a7e5-12230a85f5d7" containerID="5246d5ea3550a092c134c747537eaab583a1d9190d40023806825acaa8572adc" exitCode=0
Jul 20 12:54:04.890552 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:04.890530    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4" event={"ID":"b87714f9-0043-473e-a7e5-12230a85f5d7","Type":"ContainerDied","Data":"5246d5ea3550a092c134c747537eaab583a1d9190d40023806825acaa8572adc"}
Jul 20 12:54:04.890994 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:04.890975    2557 scope.go:117] "RemoveContainer" containerID="5246d5ea3550a092c134c747537eaab583a1d9190d40023806825acaa8572adc"
Jul 20 12:54:04.891985 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:04.891960    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 12:54:04.892040 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:04.892027    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 12:54:04.892073 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:04.892059    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 12:54:05.896748 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:05.896711    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4" event={"ID":"b87714f9-0043-473e-a7e5-12230a85f5d7","Type":"ContainerStarted","Data":"7cf97c5750cd1892c9d6092ab23eb0321439853be709d66428501f279dd786e1"}
Jul 20 12:54:06.408251 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:06.408208    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:54:06.409341 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:06.409318    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gjvc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 20 12:54:06.409398 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:06.409369    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4" podUID="b87714f9-0043-473e-a7e5-12230a85f5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 20 12:54:07.408180 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:07.408142    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gjvc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 20 12:54:07.408585 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:07.408196    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4" podUID="b87714f9-0043-473e-a7e5-12230a85f5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 20 12:54:07.885123 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:07.885095    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-d4b798dcb-r2cnd"
Jul 20 12:54:08.408022 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:08.407988    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gjvc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 20 12:54:08.408191 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:08.408044    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4" podUID="b87714f9-0043-473e-a7e5-12230a85f5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 20 12:54:09.408869 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:09.408827    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-gjvc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Jul 20 12:54:09.409355 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:09.408889    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4" podUID="b87714f9-0043-473e-a7e5-12230a85f5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Jul 20 12:54:09.456480 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:09.456433    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:54:10.411815 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:10.411781    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:54:10.412803 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:10.412776    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gjvc4"
Jul 20 12:54:12.882485 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:12.882454    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-kwknk"
Jul 20 12:54:12.882989 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:12.882534    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-97llz"
Jul 20 12:54:20.697194 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.697158    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"]
Jul 20 12:54:20.702267 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.702248    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.708975 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.708948    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 12:54:20.710583 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.710535    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 12:54:20.710716 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.710556    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7sf77\""
Jul 20 12:54:20.710716 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.710565    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 20 12:54:20.720651 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.720606    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"]
Jul 20 12:54:20.836271 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.836241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fe48a04-a75c-4a2f-a266-7a1723fbc874-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.836271 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.836272    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe48a04-a75c-4a2f-a266-7a1723fbc874-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.836460 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.836290    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fe48a04-a75c-4a2f-a266-7a1723fbc874-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.836460 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.836336    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb87q\" (UniqueName: \"kubernetes.io/projected/0fe48a04-a75c-4a2f-a266-7a1723fbc874-kube-api-access-nb87q\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.836460 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.836422    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fe48a04-a75c-4a2f-a266-7a1723fbc874-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.836555 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.836505    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fe48a04-a75c-4a2f-a266-7a1723fbc874-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.936933 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.936902    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fe48a04-a75c-4a2f-a266-7a1723fbc874-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.937076 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.936939    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fe48a04-a75c-4a2f-a266-7a1723fbc874-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.937076 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.936956    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe48a04-a75c-4a2f-a266-7a1723fbc874-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.937147 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.937083    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fe48a04-a75c-4a2f-a266-7a1723fbc874-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.937185 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.937137    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb87q\" (UniqueName: \"kubernetes.io/projected/0fe48a04-a75c-4a2f-a266-7a1723fbc874-kube-api-access-nb87q\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.937249 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.937222    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fe48a04-a75c-4a2f-a266-7a1723fbc874-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.937322 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.937290    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe48a04-a75c-4a2f-a266-7a1723fbc874-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.937380 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.937328    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fe48a04-a75c-4a2f-a266-7a1723fbc874-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.937516 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.937496    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fe48a04-a75c-4a2f-a266-7a1723fbc874-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.939249 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.939228    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fe48a04-a75c-4a2f-a266-7a1723fbc874-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.939594 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.939574    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fe48a04-a75c-4a2f-a266-7a1723fbc874-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:20.947280 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:20.947214    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb87q\" (UniqueName: \"kubernetes.io/projected/0fe48a04-a75c-4a2f-a266-7a1723fbc874-kube-api-access-nb87q\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf\" (UID: \"0fe48a04-a75c-4a2f-a266-7a1723fbc874\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:21.012085 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:21.012060    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:21.162894 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:21.162861    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"]
Jul 20 12:54:21.163684 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:54:21.163659    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe48a04_a75c_4a2f_a266_7a1723fbc874.slice/crio-c2e674b7c6307ab8e19d433e03ded519e42c203312a946d3074113960bce66d7 WatchSource:0}: Error finding container c2e674b7c6307ab8e19d433e03ded519e42c203312a946d3074113960bce66d7: Status 404 returned error can't find the container with id c2e674b7c6307ab8e19d433e03ded519e42c203312a946d3074113960bce66d7
Jul 20 12:54:21.970231 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:21.970194    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf" event={"ID":"0fe48a04-a75c-4a2f-a266-7a1723fbc874","Type":"ContainerStarted","Data":"c2e674b7c6307ab8e19d433e03ded519e42c203312a946d3074113960bce66d7"}
Jul 20 12:54:22.976933 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:22.976896    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf" event={"ID":"0fe48a04-a75c-4a2f-a266-7a1723fbc874","Type":"ContainerStarted","Data":"d3f22ff0d9692299da4a303b4c1b08161c494a041d8dbd75bc621e45c8726c95"}
Jul 20 12:54:23.002747 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:23.002697    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf" podStartSLOduration=1.8286011599999998 podStartE2EDuration="3.002680058s" totalImagesPullingTime="1.174078898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:54:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:54:23.001703075 +0000 UTC m=+608.134686176" watchObservedRunningTime="2026-07-20 12:54:23.002680058 +0000 UTC m=+608.135663158"
Jul 20 12:54:31.012667 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:31.012632    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:31.013163 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:31.012687    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:31.025717 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:31.025693    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:32.028981 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:32.028948    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf"
Jul 20 12:54:43.062027 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.061946    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"]
Jul 20 12:54:43.065358 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.065336    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.067735 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.067714    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 20 12:54:43.081325 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.081304    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"]
Jul 20 12:54:43.228349 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.228308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b31696d-66a6-471f-af3d-d99fffd9ac27-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.228349 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.228354    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b31696d-66a6-471f-af3d-d99fffd9ac27-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.228542 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.228381    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b31696d-66a6-471f-af3d-d99fffd9ac27-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.228542 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.228419    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b31696d-66a6-471f-af3d-d99fffd9ac27-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.228542 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.228497    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b31696d-66a6-471f-af3d-d99fffd9ac27-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.228542 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.228536    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l9pz\" (UniqueName: \"kubernetes.io/projected/2b31696d-66a6-471f-af3d-d99fffd9ac27-kube-api-access-8l9pz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.329853 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.329775    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b31696d-66a6-471f-af3d-d99fffd9ac27-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.329853 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.329829    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b31696d-66a6-471f-af3d-d99fffd9ac27-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.330040 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.329865    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b31696d-66a6-471f-af3d-d99fffd9ac27-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.330040 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.329886    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b31696d-66a6-471f-af3d-d99fffd9ac27-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.330040 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.329940    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b31696d-66a6-471f-af3d-d99fffd9ac27-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.330198 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.330067    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l9pz\" (UniqueName: \"kubernetes.io/projected/2b31696d-66a6-471f-af3d-d99fffd9ac27-kube-api-access-8l9pz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.330269 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.330249    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b31696d-66a6-471f-af3d-d99fffd9ac27-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.330349 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.330325    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b31696d-66a6-471f-af3d-d99fffd9ac27-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.330408 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.330373    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b31696d-66a6-471f-af3d-d99fffd9ac27-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.332163 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.332138    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b31696d-66a6-471f-af3d-d99fffd9ac27-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.332344 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.332327    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b31696d-66a6-471f-af3d-d99fffd9ac27-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.338611 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.338576    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l9pz\" (UniqueName: \"kubernetes.io/projected/2b31696d-66a6-471f-af3d-d99fffd9ac27-kube-api-access-8l9pz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8svvs\" (UID: \"2b31696d-66a6-471f-af3d-d99fffd9ac27\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.376218 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.376194    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:43.506901 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.506871    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"]
Jul 20 12:54:43.509747 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:54:43.509721    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b31696d_66a6_471f_af3d_d99fffd9ac27.slice/crio-6b2c7563c4bb8c36b88bf3d2947252817b20da13195b532a8dd660713f8d91fe WatchSource:0}: Error finding container 6b2c7563c4bb8c36b88bf3d2947252817b20da13195b532a8dd660713f8d91fe: Status 404 returned error can't find the container with id 6b2c7563c4bb8c36b88bf3d2947252817b20da13195b532a8dd660713f8d91fe
Jul 20 12:54:43.511195 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:43.511175    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 12:54:44.075963 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:44.075931    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs" event={"ID":"2b31696d-66a6-471f-af3d-d99fffd9ac27","Type":"ContainerStarted","Data":"7f325209e91cddd476e490146646e6221605d19df40c6ed86b883cd5be2ec6a3"}
Jul 20 12:54:44.076346 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:44.075986    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs" event={"ID":"2b31696d-66a6-471f-af3d-d99fffd9ac27","Type":"ContainerStarted","Data":"6b2c7563c4bb8c36b88bf3d2947252817b20da13195b532a8dd660713f8d91fe"}
Jul 20 12:54:44.101658 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:44.101576    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs" podStartSLOduration=0.928431372 podStartE2EDuration="1.101561822s" totalImagesPullingTime="173.13045ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:54:44.099841271 +0000 UTC m=+629.232824383" watchObservedRunningTime="2026-07-20 12:54:44.101561822 +0000 UTC m=+629.234544922"
Jul 20 12:54:53.380317 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:53.380288    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:53.380877 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:53.380340    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:53.389781 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:53.389757    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:54:54.133997 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:54:54.133968    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8svvs"
Jul 20 12:55:00.981786 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:00.981733    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"]
Jul 20 12:55:00.987945 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:00.987918    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:00.990236 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:00.990217    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 20 12:55:00.996204 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:00.996183    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"]
Jul 20 12:55:01.082121 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.082091    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15dd190e-b543-4639-b857-cd44c57d90ac-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.082121 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.082133    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15dd190e-b543-4639-b857-cd44c57d90ac-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.082354 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.082152    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15dd190e-b543-4639-b857-cd44c57d90ac-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.082354 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.082216    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9djnc\" (UniqueName: \"kubernetes.io/projected/15dd190e-b543-4639-b857-cd44c57d90ac-kube-api-access-9djnc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.082354 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.082280    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15dd190e-b543-4639-b857-cd44c57d90ac-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.082354 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.082343    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15dd190e-b543-4639-b857-cd44c57d90ac-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.182809 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.182777    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15dd190e-b543-4639-b857-cd44c57d90ac-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.182809 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.182809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15dd190e-b543-4639-b857-cd44c57d90ac-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.183048 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.182841    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9djnc\" (UniqueName: \"kubernetes.io/projected/15dd190e-b543-4639-b857-cd44c57d90ac-kube-api-access-9djnc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.183048 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.182889    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15dd190e-b543-4639-b857-cd44c57d90ac-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.183048 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.182959    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15dd190e-b543-4639-b857-cd44c57d90ac-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.183048 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.183018    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15dd190e-b543-4639-b857-cd44c57d90ac-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.183334 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.183314    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15dd190e-b543-4639-b857-cd44c57d90ac-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.183425 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.183407    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15dd190e-b543-4639-b857-cd44c57d90ac-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.183493 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.183474    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15dd190e-b543-4639-b857-cd44c57d90ac-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.185187 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.185162    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15dd190e-b543-4639-b857-cd44c57d90ac-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.186130 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.186111    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15dd190e-b543-4639-b857-cd44c57d90ac-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.191787 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.191737    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9djnc\" (UniqueName: \"kubernetes.io/projected/15dd190e-b543-4639-b857-cd44c57d90ac-kube-api-access-9djnc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qfl7d\" (UID: \"15dd190e-b543-4639-b857-cd44c57d90ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.299685 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.299583    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:01.432985 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:01.432959    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"]
Jul 20 12:55:01.436387 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:55:01.436356    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15dd190e_b543_4639_b857_cd44c57d90ac.slice/crio-3e724d6ce9797b136c9a242355f1e33d250c266a3ec423a0bf03b39839c7add1 WatchSource:0}: Error finding container 3e724d6ce9797b136c9a242355f1e33d250c266a3ec423a0bf03b39839c7add1: Status 404 returned error can't find the container with id 3e724d6ce9797b136c9a242355f1e33d250c266a3ec423a0bf03b39839c7add1
Jul 20 12:55:02.163931 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:02.163892    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d" event={"ID":"15dd190e-b543-4639-b857-cd44c57d90ac","Type":"ContainerStarted","Data":"e3dd36742e1b125a703bf65276e024818db0c3872ecf731cfbb1ee6d3d928b27"}
Jul 20 12:55:02.164335 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:02.163945    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d" event={"ID":"15dd190e-b543-4639-b857-cd44c57d90ac","Type":"ContainerStarted","Data":"3e724d6ce9797b136c9a242355f1e33d250c266a3ec423a0bf03b39839c7add1"}
Jul 20 12:55:02.181641 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:02.181573    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d" podStartSLOduration=1.989858213 podStartE2EDuration="2.181555731s" totalImagesPullingTime="191.697518ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:55:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:55:02.181051152 +0000 UTC m=+647.314034257" watchObservedRunningTime="2026-07-20 12:55:02.181555731 +0000 UTC m=+647.314538870"
Jul 20 12:55:11.300394 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:11.300356    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:11.301035 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:11.300444    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:11.312462 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:11.312438    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:55:12.221360 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:55:12.221327    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qfl7d"
Jul 20 12:56:27.723761 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:27.723682    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5767485bdf-b6r9p"]
Jul 20 12:56:27.724304 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:27.723970    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5767485bdf-b6r9p" podUID="0e0a86e8-7063-4625-8698-02c37c503f2d" containerName="manager" containerID="cri-o://f9a7e50633a425dcf70019f784afc4ed10fee6ad0c3dbc8dc91fa359d5701b3f" gracePeriod=30
Jul 20 12:56:27.982501 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:27.982442    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5767485bdf-b6r9p"
Jul 20 12:56:28.042028 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.041991    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts26n\" (UniqueName: \"kubernetes.io/projected/0e0a86e8-7063-4625-8698-02c37c503f2d-kube-api-access-ts26n\") pod \"0e0a86e8-7063-4625-8698-02c37c503f2d\" (UID: \"0e0a86e8-7063-4625-8698-02c37c503f2d\") "
Jul 20 12:56:28.042204 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.042070    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e0a86e8-7063-4625-8698-02c37c503f2d-webhook-cert\") pod \"0e0a86e8-7063-4625-8698-02c37c503f2d\" (UID: \"0e0a86e8-7063-4625-8698-02c37c503f2d\") "
Jul 20 12:56:28.044002 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.043972    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e0a86e8-7063-4625-8698-02c37c503f2d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0e0a86e8-7063-4625-8698-02c37c503f2d" (UID: "0e0a86e8-7063-4625-8698-02c37c503f2d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:56:28.044105 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.044002    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e0a86e8-7063-4625-8698-02c37c503f2d-kube-api-access-ts26n" (OuterVolumeSpecName: "kube-api-access-ts26n") pod "0e0a86e8-7063-4625-8698-02c37c503f2d" (UID: "0e0a86e8-7063-4625-8698-02c37c503f2d"). InnerVolumeSpecName "kube-api-access-ts26n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:56:28.142945 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.142893    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e0a86e8-7063-4625-8698-02c37c503f2d-webhook-cert\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:56:28.142945 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.142940    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts26n\" (UniqueName: \"kubernetes.io/projected/0e0a86e8-7063-4625-8698-02c37c503f2d-kube-api-access-ts26n\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:56:28.558683 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.558650    2557 generic.go:356] "Generic (PLEG): container finished" podID="0e0a86e8-7063-4625-8698-02c37c503f2d" containerID="f9a7e50633a425dcf70019f784afc4ed10fee6ad0c3dbc8dc91fa359d5701b3f" exitCode=0
Jul 20 12:56:28.558850 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.558718    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5767485bdf-b6r9p" event={"ID":"0e0a86e8-7063-4625-8698-02c37c503f2d","Type":"ContainerDied","Data":"f9a7e50633a425dcf70019f784afc4ed10fee6ad0c3dbc8dc91fa359d5701b3f"}
Jul 20 12:56:28.558850 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.558744    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5767485bdf-b6r9p"
Jul 20 12:56:28.558850 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.558755    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5767485bdf-b6r9p" event={"ID":"0e0a86e8-7063-4625-8698-02c37c503f2d","Type":"ContainerDied","Data":"b5ea125686a548e78cca5fbb6e2bb9427f597eff03d8262a370a3f2ab2c93d13"}
Jul 20 12:56:28.558850 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.558777    2557 scope.go:117] "RemoveContainer" containerID="f9a7e50633a425dcf70019f784afc4ed10fee6ad0c3dbc8dc91fa359d5701b3f"
Jul 20 12:56:28.570471 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.570447    2557 scope.go:117] "RemoveContainer" containerID="f9a7e50633a425dcf70019f784afc4ed10fee6ad0c3dbc8dc91fa359d5701b3f"
Jul 20 12:56:28.571442 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:56:28.571276    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9a7e50633a425dcf70019f784afc4ed10fee6ad0c3dbc8dc91fa359d5701b3f\": container with ID starting with f9a7e50633a425dcf70019f784afc4ed10fee6ad0c3dbc8dc91fa359d5701b3f not found: ID does not exist" containerID="f9a7e50633a425dcf70019f784afc4ed10fee6ad0c3dbc8dc91fa359d5701b3f"
Jul 20 12:56:28.571744 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.571718    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a7e50633a425dcf70019f784afc4ed10fee6ad0c3dbc8dc91fa359d5701b3f"} err="failed to get container status \"f9a7e50633a425dcf70019f784afc4ed10fee6ad0c3dbc8dc91fa359d5701b3f\": rpc error: code = NotFound desc = could not find container \"f9a7e50633a425dcf70019f784afc4ed10fee6ad0c3dbc8dc91fa359d5701b3f\": container with ID starting with f9a7e50633a425dcf70019f784afc4ed10fee6ad0c3dbc8dc91fa359d5701b3f not found: ID does not exist"
Jul 20 12:56:28.589923 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.589886    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5767485bdf-b6r9p"]
Jul 20 12:56:28.596679 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:28.596655    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5767485bdf-b6r9p"]
Jul 20 12:56:29.382967 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:56:29.382934    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e0a86e8-7063-4625-8698-02c37c503f2d" path="/var/lib/kubelet/pods/0e0a86e8-7063-4625-8698-02c37c503f2d/volumes"
Jul 20 12:57:29.390454 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.390406    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5767485bdf-886ww"]
Jul 20 12:57:29.390929 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.390777    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e0a86e8-7063-4625-8698-02c37c503f2d" containerName="manager"
Jul 20 12:57:29.390929 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.390789    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e0a86e8-7063-4625-8698-02c37c503f2d" containerName="manager"
Jul 20 12:57:29.390929 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.390858    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e0a86e8-7063-4625-8698-02c37c503f2d" containerName="manager"
Jul 20 12:57:29.394903 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.394886    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5767485bdf-886ww"
Jul 20 12:57:29.397551 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.397523    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 12:57:29.397690 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.397574    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 12:57:29.397690 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.397666    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j6czz\""
Jul 20 12:57:29.403237 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.403212    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5767485bdf-886ww"]
Jul 20 12:57:29.454498 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.454471    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc63a3de-8235-4887-9982-ad327ab401c5-webhook-cert\") pod \"maas-controller-5767485bdf-886ww\" (UID: \"cc63a3de-8235-4887-9982-ad327ab401c5\") " pod="opendatahub/maas-controller-5767485bdf-886ww"
Jul 20 12:57:29.454650 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.454513    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnq6v\" (UniqueName: \"kubernetes.io/projected/cc63a3de-8235-4887-9982-ad327ab401c5-kube-api-access-nnq6v\") pod \"maas-controller-5767485bdf-886ww\" (UID: \"cc63a3de-8235-4887-9982-ad327ab401c5\") " pod="opendatahub/maas-controller-5767485bdf-886ww"
Jul 20 12:57:29.554891 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.554862    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc63a3de-8235-4887-9982-ad327ab401c5-webhook-cert\") pod \"maas-controller-5767485bdf-886ww\" (UID: \"cc63a3de-8235-4887-9982-ad327ab401c5\") " pod="opendatahub/maas-controller-5767485bdf-886ww"
Jul 20 12:57:29.555019 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.554904    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnq6v\" (UniqueName: \"kubernetes.io/projected/cc63a3de-8235-4887-9982-ad327ab401c5-kube-api-access-nnq6v\") pod \"maas-controller-5767485bdf-886ww\" (UID: \"cc63a3de-8235-4887-9982-ad327ab401c5\") " pod="opendatahub/maas-controller-5767485bdf-886ww"
Jul 20 12:57:29.557183 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.557154    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc63a3de-8235-4887-9982-ad327ab401c5-webhook-cert\") pod \"maas-controller-5767485bdf-886ww\" (UID: \"cc63a3de-8235-4887-9982-ad327ab401c5\") " pod="opendatahub/maas-controller-5767485bdf-886ww"
Jul 20 12:57:29.562752 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.562731    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnq6v\" (UniqueName: \"kubernetes.io/projected/cc63a3de-8235-4887-9982-ad327ab401c5-kube-api-access-nnq6v\") pod \"maas-controller-5767485bdf-886ww\" (UID: \"cc63a3de-8235-4887-9982-ad327ab401c5\") " pod="opendatahub/maas-controller-5767485bdf-886ww"
Jul 20 12:57:29.705174 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.705111    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5767485bdf-886ww"
Jul 20 12:57:29.838462 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:29.838439    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5767485bdf-886ww"]
Jul 20 12:57:29.841324 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:57:29.841298    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc63a3de_8235_4887_9982_ad327ab401c5.slice/crio-164f428bf90ed6314e03aad9a5387799f9f764d5fa6c1f384771fcc3f76b4cde WatchSource:0}: Error finding container 164f428bf90ed6314e03aad9a5387799f9f764d5fa6c1f384771fcc3f76b4cde: Status 404 returned error can't find the container with id 164f428bf90ed6314e03aad9a5387799f9f764d5fa6c1f384771fcc3f76b4cde
Jul 20 12:57:30.836065 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:30.836030    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5767485bdf-886ww" event={"ID":"cc63a3de-8235-4887-9982-ad327ab401c5","Type":"ContainerStarted","Data":"af988452b830bb53d49799c49912097bfe74149c35cc3a2cc2ef3d85a98c4881"}
Jul 20 12:57:30.836486 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:30.836083    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5767485bdf-886ww" event={"ID":"cc63a3de-8235-4887-9982-ad327ab401c5","Type":"ContainerStarted","Data":"164f428bf90ed6314e03aad9a5387799f9f764d5fa6c1f384771fcc3f76b4cde"}
Jul 20 12:57:30.836486 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:30.836160    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5767485bdf-886ww"
Jul 20 12:57:30.852407 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:30.852350    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5767485bdf-886ww" podStartSLOduration=1.4432547900000001 podStartE2EDuration="1.852331874s" totalImagesPullingTime="409.077084ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:57:30.850642797 +0000 UTC m=+795.983625888" watchObservedRunningTime="2026-07-20 12:57:30.852331874 +0000 UTC m=+795.985314975"
Jul 20 12:57:41.842464 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:41.842378    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5767485bdf-886ww"
Jul 20 12:57:46.466003 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.465970    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5767485bdf-886ww"]
Jul 20 12:57:46.466412 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.466134    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5767485bdf-886ww" podUID="cc63a3de-8235-4887-9982-ad327ab401c5" containerName="manager" containerID="cri-o://af988452b830bb53d49799c49912097bfe74149c35cc3a2cc2ef3d85a98c4881" gracePeriod=30
Jul 20 12:57:46.707877 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.706942    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5767485bdf-886ww"
Jul 20 12:57:46.799467 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.799397    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnq6v\" (UniqueName: \"kubernetes.io/projected/cc63a3de-8235-4887-9982-ad327ab401c5-kube-api-access-nnq6v\") pod \"cc63a3de-8235-4887-9982-ad327ab401c5\" (UID: \"cc63a3de-8235-4887-9982-ad327ab401c5\") "
Jul 20 12:57:46.799589 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.799469    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc63a3de-8235-4887-9982-ad327ab401c5-webhook-cert\") pod \"cc63a3de-8235-4887-9982-ad327ab401c5\" (UID: \"cc63a3de-8235-4887-9982-ad327ab401c5\") "
Jul 20 12:57:46.801378 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.801352    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc63a3de-8235-4887-9982-ad327ab401c5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cc63a3de-8235-4887-9982-ad327ab401c5" (UID: "cc63a3de-8235-4887-9982-ad327ab401c5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 12:57:46.801485 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.801394    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc63a3de-8235-4887-9982-ad327ab401c5-kube-api-access-nnq6v" (OuterVolumeSpecName: "kube-api-access-nnq6v") pod "cc63a3de-8235-4887-9982-ad327ab401c5" (UID: "cc63a3de-8235-4887-9982-ad327ab401c5"). InnerVolumeSpecName "kube-api-access-nnq6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 12:57:46.900153 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.900125    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnq6v\" (UniqueName: \"kubernetes.io/projected/cc63a3de-8235-4887-9982-ad327ab401c5-kube-api-access-nnq6v\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:57:46.900153 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.900150    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc63a3de-8235-4887-9982-ad327ab401c5-webhook-cert\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 12:57:46.911989 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.911963    2557 generic.go:356] "Generic (PLEG): container finished" podID="cc63a3de-8235-4887-9982-ad327ab401c5" containerID="af988452b830bb53d49799c49912097bfe74149c35cc3a2cc2ef3d85a98c4881" exitCode=0
Jul 20 12:57:46.912094 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.912008    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5767485bdf-886ww"
Jul 20 12:57:46.912094 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.912041    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5767485bdf-886ww" event={"ID":"cc63a3de-8235-4887-9982-ad327ab401c5","Type":"ContainerDied","Data":"af988452b830bb53d49799c49912097bfe74149c35cc3a2cc2ef3d85a98c4881"}
Jul 20 12:57:46.912169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.912110    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5767485bdf-886ww" event={"ID":"cc63a3de-8235-4887-9982-ad327ab401c5","Type":"ContainerDied","Data":"164f428bf90ed6314e03aad9a5387799f9f764d5fa6c1f384771fcc3f76b4cde"}
Jul 20 12:57:46.912169 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.912132    2557 scope.go:117] "RemoveContainer" containerID="af988452b830bb53d49799c49912097bfe74149c35cc3a2cc2ef3d85a98c4881"
Jul 20 12:57:46.920344 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.920330    2557 scope.go:117] "RemoveContainer" containerID="af988452b830bb53d49799c49912097bfe74149c35cc3a2cc2ef3d85a98c4881"
Jul 20 12:57:46.920570 ip-10-0-141-54 kubenswrapper[2557]: E0720 12:57:46.920553    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af988452b830bb53d49799c49912097bfe74149c35cc3a2cc2ef3d85a98c4881\": container with ID starting with af988452b830bb53d49799c49912097bfe74149c35cc3a2cc2ef3d85a98c4881 not found: ID does not exist" containerID="af988452b830bb53d49799c49912097bfe74149c35cc3a2cc2ef3d85a98c4881"
Jul 20 12:57:46.920634 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.920576    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af988452b830bb53d49799c49912097bfe74149c35cc3a2cc2ef3d85a98c4881"} err="failed to get container status \"af988452b830bb53d49799c49912097bfe74149c35cc3a2cc2ef3d85a98c4881\": rpc error: code = NotFound desc = could not find container \"af988452b830bb53d49799c49912097bfe74149c35cc3a2cc2ef3d85a98c4881\": container with ID starting with af988452b830bb53d49799c49912097bfe74149c35cc3a2cc2ef3d85a98c4881 not found: ID does not exist"
Jul 20 12:57:46.932315 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.932293    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5767485bdf-886ww"]
Jul 20 12:57:46.938567 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:46.938547    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5767485bdf-886ww"]
Jul 20 12:57:47.380292 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.380258    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc63a3de-8235-4887-9982-ad327ab401c5" path="/var/lib/kubelet/pods/cc63a3de-8235-4887-9982-ad327ab401c5/volumes"
Jul 20 12:57:47.733718 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.733645    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5767485bdf-zn8bz"]
Jul 20 12:57:47.734041 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.733980    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc63a3de-8235-4887-9982-ad327ab401c5" containerName="manager"
Jul 20 12:57:47.734041 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.733991    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc63a3de-8235-4887-9982-ad327ab401c5" containerName="manager"
Jul 20 12:57:47.734108 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.734059    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc63a3de-8235-4887-9982-ad327ab401c5" containerName="manager"
Jul 20 12:57:47.738134 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.738114    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5767485bdf-zn8bz"
Jul 20 12:57:47.740457 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.740440    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-j6czz\""
Jul 20 12:57:47.740457 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.740449    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 12:57:47.740607 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.740458    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 12:57:47.746756 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.746731    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5767485bdf-zn8bz"]
Jul 20 12:57:47.807579 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.807556    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc93167b-3ad7-44ea-a0ba-51311bf7813b-webhook-cert\") pod \"maas-controller-5767485bdf-zn8bz\" (UID: \"cc93167b-3ad7-44ea-a0ba-51311bf7813b\") " pod="opendatahub/maas-controller-5767485bdf-zn8bz"
Jul 20 12:57:47.807712 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.807594    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9z4w\" (UniqueName: \"kubernetes.io/projected/cc93167b-3ad7-44ea-a0ba-51311bf7813b-kube-api-access-g9z4w\") pod \"maas-controller-5767485bdf-zn8bz\" (UID: \"cc93167b-3ad7-44ea-a0ba-51311bf7813b\") " pod="opendatahub/maas-controller-5767485bdf-zn8bz"
Jul 20 12:57:47.908382 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.908361    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc93167b-3ad7-44ea-a0ba-51311bf7813b-webhook-cert\") pod \"maas-controller-5767485bdf-zn8bz\" (UID: \"cc93167b-3ad7-44ea-a0ba-51311bf7813b\") " pod="opendatahub/maas-controller-5767485bdf-zn8bz"
Jul 20 12:57:47.908483 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.908396    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9z4w\" (UniqueName: \"kubernetes.io/projected/cc93167b-3ad7-44ea-a0ba-51311bf7813b-kube-api-access-g9z4w\") pod \"maas-controller-5767485bdf-zn8bz\" (UID: \"cc93167b-3ad7-44ea-a0ba-51311bf7813b\") " pod="opendatahub/maas-controller-5767485bdf-zn8bz"
Jul 20 12:57:47.910665 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.910642    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc93167b-3ad7-44ea-a0ba-51311bf7813b-webhook-cert\") pod \"maas-controller-5767485bdf-zn8bz\" (UID: \"cc93167b-3ad7-44ea-a0ba-51311bf7813b\") " pod="opendatahub/maas-controller-5767485bdf-zn8bz"
Jul 20 12:57:47.917545 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:47.917515    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9z4w\" (UniqueName: \"kubernetes.io/projected/cc93167b-3ad7-44ea-a0ba-51311bf7813b-kube-api-access-g9z4w\") pod \"maas-controller-5767485bdf-zn8bz\" (UID: \"cc93167b-3ad7-44ea-a0ba-51311bf7813b\") " pod="opendatahub/maas-controller-5767485bdf-zn8bz"
Jul 20 12:57:48.049113 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:48.049061    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5767485bdf-zn8bz"
Jul 20 12:57:48.182198 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:48.182092    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5767485bdf-zn8bz"]
Jul 20 12:57:48.184753 ip-10-0-141-54 kubenswrapper[2557]: W0720 12:57:48.184725    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc93167b_3ad7_44ea_a0ba_51311bf7813b.slice/crio-5fea9aa90c2b8d9362930e2a86e77057782272c0056a1392293da3cf3e504ffe WatchSource:0}: Error finding container 5fea9aa90c2b8d9362930e2a86e77057782272c0056a1392293da3cf3e504ffe: Status 404 returned error can't find the container with id 5fea9aa90c2b8d9362930e2a86e77057782272c0056a1392293da3cf3e504ffe
Jul 20 12:57:48.924028 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:48.923993    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5767485bdf-zn8bz" event={"ID":"cc93167b-3ad7-44ea-a0ba-51311bf7813b","Type":"ContainerStarted","Data":"53ce0137a5d87e8a781f7be2a840375df1b87a7df1bdc5995345fefd435e1da1"}
Jul 20 12:57:48.924372 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:48.924051    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5767485bdf-zn8bz" event={"ID":"cc93167b-3ad7-44ea-a0ba-51311bf7813b","Type":"ContainerStarted","Data":"5fea9aa90c2b8d9362930e2a86e77057782272c0056a1392293da3cf3e504ffe"}
Jul 20 12:57:48.924372 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:48.924108    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5767485bdf-zn8bz"
Jul 20 12:57:48.940604 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:48.940560    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5767485bdf-zn8bz" podStartSLOduration=1.5867243260000001 podStartE2EDuration="1.940544696s" totalImagesPullingTime="353.82037ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 12:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 12:57:48.94024816 +0000 UTC m=+814.073231260" watchObservedRunningTime="2026-07-20 12:57:48.940544696 +0000 UTC m=+814.073527797"
Jul 20 12:57:59.930875 ip-10-0-141-54 kubenswrapper[2557]: I0720 12:57:59.930838    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5767485bdf-zn8bz"
Jul 20 13:10:12.223287 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.223255    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"]
Jul 20 13:10:12.226705 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.226687    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.229308 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.229284    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-fc7eef60-openshift-default-dockercfg-nd7rz\""
Jul 20 13:10:12.270156 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.270118    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"]
Jul 20 13:10:12.293237 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.293186    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-credential-socket\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.293423 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.293272    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6gcb\" (UniqueName: \"kubernetes.io/projected/eb280836-0d77-4419-8485-7c51e1bfd383-kube-api-access-x6gcb\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.293423 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.293344    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-istio-data\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.293565 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.293469    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb280836-0d77-4419-8485-7c51e1bfd383-istio-podinfo\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.293565 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.293538    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-workload-certs\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.293712 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.293576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-workload-socket\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.293905 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.293874    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-istio-envoy\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.294053 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.293917    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb280836-0d77-4419-8485-7c51e1bfd383-istio-token\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.294053 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.293939    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb280836-0d77-4419-8485-7c51e1bfd383-istiod-ca-cert\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.395475 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.395432    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb280836-0d77-4419-8485-7c51e1bfd383-istio-podinfo\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.395694 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.395482    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-workload-certs\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.395694 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.395518    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-workload-socket\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.395694 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.395573    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-istio-envoy\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.395694 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.395602    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb280836-0d77-4419-8485-7c51e1bfd383-istio-token\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.395694 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.395652    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb280836-0d77-4419-8485-7c51e1bfd383-istiod-ca-cert\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.395957 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.395716    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-credential-socket\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.395957 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.395741    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6gcb\" (UniqueName: \"kubernetes.io/projected/eb280836-0d77-4419-8485-7c51e1bfd383-kube-api-access-x6gcb\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.395957 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.395766    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-istio-data\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.396122 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.396023    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-workload-socket\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.396122 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.396086    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-workload-certs\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.396227 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.396164    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-credential-socket\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.396346 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.396323    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-istio-data\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.396742 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.396720    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb280836-0d77-4419-8485-7c51e1bfd383-istiod-ca-cert\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.397834 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.397816    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-istio-envoy\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.398100 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.398080    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb280836-0d77-4419-8485-7c51e1bfd383-istio-podinfo\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.417761 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.417725    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6gcb\" (UniqueName: \"kubernetes.io/projected/eb280836-0d77-4419-8485-7c51e1bfd383-kube-api-access-x6gcb\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.417926 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.417744    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb280836-0d77-4419-8485-7c51e1bfd383-istio-token\") pod \"e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") " pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.537358 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.537276    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:12.688185 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.688155    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"]
Jul 20 13:10:12.690581 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:10:12.690549    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb280836_0d77_4419_8485_7c51e1bfd383.slice/crio-d17fc5c6365f7d0ac61fe4fd53d38c331e2fc28ce39a0371cca07f9df52d8bc3 WatchSource:0}: Error finding container d17fc5c6365f7d0ac61fe4fd53d38c331e2fc28ce39a0371cca07f9df52d8bc3: Status 404 returned error can't find the container with id d17fc5c6365f7d0ac61fe4fd53d38c331e2fc28ce39a0371cca07f9df52d8bc3
Jul 20 13:10:12.692686 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.692654    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:10:12.692749 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.692734    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:10:12.692784 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:12.692765    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:10:13.370975 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:13.370941    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8" event={"ID":"eb280836-0d77-4419-8485-7c51e1bfd383","Type":"ContainerStarted","Data":"c8a87388ecb08c21593e9a07f618dc5496091b1dfca2d7802ed69f3406357e4c"}
Jul 20 13:10:13.371354 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:13.370993    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8" event={"ID":"eb280836-0d77-4419-8485-7c51e1bfd383","Type":"ContainerStarted","Data":"d17fc5c6365f7d0ac61fe4fd53d38c331e2fc28ce39a0371cca07f9df52d8bc3"}
Jul 20 13:10:13.424474 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:13.424425    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8" podStartSLOduration=1.424409714 podStartE2EDuration="1.424409714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:10:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:10:13.421178799 +0000 UTC m=+1558.554161898" watchObservedRunningTime="2026-07-20 13:10:13.424409714 +0000 UTC m=+1558.557392815"
Jul 20 13:10:13.538286 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:13.538253    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:13.543150 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:13.543130    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:14.375192 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:14.375156    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:14.376154 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:14.376137    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:14.928708 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:14.928675    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"]
Jul 20 13:10:14.932326 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:14.932303    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:14.934436 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:14.934407    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-fc7eef60-serving-cert\""
Jul 20 13:10:14.946304 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:14.946280    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"]
Jul 20 13:10:15.022046 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:15.022012    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-openshift-service-ca\") pod \"maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc\" (UID: \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:15.022219 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:15.022083    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-maas-api-tls\") pod \"maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc\" (UID: \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:15.022219 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:15.022122    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cgr5\" (UniqueName: \"kubernetes.io/projected/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-kube-api-access-9cgr5\") pod \"maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc\" (UID: \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:15.122901 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:15.122854    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cgr5\" (UniqueName: \"kubernetes.io/projected/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-kube-api-access-9cgr5\") pod \"maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc\" (UID: \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:15.123121 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:15.122972    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-openshift-service-ca\") pod \"maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc\" (UID: \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:15.123121 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:15.123030    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-maas-api-tls\") pod \"maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc\" (UID: \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:15.123247 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:10:15.123164    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-serving-cert: secret "maas-api-e2e-ait-fc7eef60-serving-cert" not found
Jul 20 13:10:15.123247 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:10:15.123246    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-maas-api-tls podName:c06ecc3f-92f4-40cc-a17d-439dacafc4cb nodeName:}" failed. No retries permitted until 2026-07-20 13:10:15.62322404 +0000 UTC m=+1560.756207124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-maas-api-tls") pod "maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc" (UID: "c06ecc3f-92f4-40cc-a17d-439dacafc4cb") : secret "maas-api-e2e-ait-fc7eef60-serving-cert" not found
Jul 20 13:10:15.124044 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:15.124021    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-openshift-service-ca\") pod \"maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc\" (UID: \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:15.134197 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:15.134166    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cgr5\" (UniqueName: \"kubernetes.io/projected/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-kube-api-access-9cgr5\") pod \"maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc\" (UID: \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:15.627557 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:15.627527    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-maas-api-tls\") pod \"maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc\" (UID: \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:15.629994 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:15.629972    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-maas-api-tls\") pod \"maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc\" (UID: \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:15.843772 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:15.843742    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:15.989487 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:15.989453    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"]
Jul 20 13:10:15.992770 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:10:15.992736    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06ecc3f_92f4_40cc_a17d_439dacafc4cb.slice/crio-d541ed205ce24f2bfb4ec84b1061dfada2c59f846d81ab290d84a27229b58ce3 WatchSource:0}: Error finding container d541ed205ce24f2bfb4ec84b1061dfada2c59f846d81ab290d84a27229b58ce3: Status 404 returned error can't find the container with id d541ed205ce24f2bfb4ec84b1061dfada2c59f846d81ab290d84a27229b58ce3
Jul 20 13:10:15.994261 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:15.994244    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:10:16.395040 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:16.395002    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc" event={"ID":"c06ecc3f-92f4-40cc-a17d-439dacafc4cb","Type":"ContainerStarted","Data":"d541ed205ce24f2bfb4ec84b1061dfada2c59f846d81ab290d84a27229b58ce3"}
Jul 20 13:10:17.400659 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:17.400612    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc" event={"ID":"c06ecc3f-92f4-40cc-a17d-439dacafc4cb","Type":"ContainerStarted","Data":"b3925e271ea46210dc0a73642132c56d53337aaa618a1729f2cbb55fe0b3a6b2"}
Jul 20 13:10:17.401078 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:17.400744    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:23.411311 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:23.411279    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:23.433238 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:23.433172    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc" podStartSLOduration=8.888064734 podStartE2EDuration="9.43315155s" totalImagesPullingTime="545.086816ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:10:17.431844127 +0000 UTC m=+1562.564827228" watchObservedRunningTime="2026-07-20 13:10:23.43315155 +0000 UTC m=+1568.566134653"
Jul 20 13:10:29.376769 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:29.376730    2557 patch_prober.go:28] interesting pod/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 20 13:10:29.377346 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:29.376784    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8" podUID="eb280836-0d77-4419-8485-7c51e1bfd383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 20 13:10:29.471040 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:29.471008    2557 generic.go:356] "Generic (PLEG): container finished" podID="eb280836-0d77-4419-8485-7c51e1bfd383" containerID="c8a87388ecb08c21593e9a07f618dc5496091b1dfca2d7802ed69f3406357e4c" exitCode=0
Jul 20 13:10:29.471201 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:29.471083    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8" event={"ID":"eb280836-0d77-4419-8485-7c51e1bfd383","Type":"ContainerDied","Data":"c8a87388ecb08c21593e9a07f618dc5496091b1dfca2d7802ed69f3406357e4c"}
Jul 20 13:10:29.471474 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:29.471459    2557 scope.go:117] "RemoveContainer" containerID="c8a87388ecb08c21593e9a07f618dc5496091b1dfca2d7802ed69f3406357e4c"
Jul 20 13:10:29.472492 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:29.472463    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:10:29.472593 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:29.472548    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:10:29.472690 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:29.472599    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:10:30.477767 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:30.477734    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8" event={"ID":"eb280836-0d77-4419-8485-7c51e1bfd383","Type":"ContainerStarted","Data":"08ddbde0c053e63f7cb83eb949d2bdaaf18080ebaac30fed28ab0514a37d5d12"}
Jul 20 13:10:30.537801 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:30.537764    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:30.538334 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:30.538301    2557 patch_prober.go:28] interesting pod/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 20 13:10:30.538453 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:30.538378    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8" podUID="eb280836-0d77-4419-8485-7c51e1bfd383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 20 13:10:31.538193 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:31.538148    2557 patch_prober.go:28] interesting pod/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 20 13:10:31.538709 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:31.538218    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8" podUID="eb280836-0d77-4419-8485-7c51e1bfd383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 20 13:10:32.537758 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:32.537711    2557 patch_prober.go:28] interesting pod/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 20 13:10:32.537977 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:32.537797    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8" podUID="eb280836-0d77-4419-8485-7c51e1bfd383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 20 13:10:33.538597 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:33.538560    2557 patch_prober.go:28] interesting pod/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 20 13:10:33.539208 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:33.539171    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8" podUID="eb280836-0d77-4419-8485-7c51e1bfd383" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 20 13:10:34.542273 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:34.542247    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:34.542717 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:34.542494    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:34.543249 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:34.543234    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:10:50.868922 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:50.868881    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"]
Jul 20 13:10:50.869451 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:50.869229    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc" podUID="c06ecc3f-92f4-40cc-a17d-439dacafc4cb" containerName="maas-api" containerID="cri-o://b3925e271ea46210dc0a73642132c56d53337aaa618a1729f2cbb55fe0b3a6b2" gracePeriod=30
Jul 20 13:10:51.120916 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.120852    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:51.131698 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.131664    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cgr5\" (UniqueName: \"kubernetes.io/projected/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-kube-api-access-9cgr5\") pod \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\" (UID: \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\") "
Jul 20 13:10:51.131839 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.131749    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-maas-api-tls\") pod \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\" (UID: \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\") "
Jul 20 13:10:51.131839 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.131812    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-openshift-service-ca\") pod \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\" (UID: \"c06ecc3f-92f4-40cc-a17d-439dacafc4cb\") "
Jul 20 13:10:51.132164 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.132135    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c06ecc3f-92f4-40cc-a17d-439dacafc4cb" (UID: "c06ecc3f-92f4-40cc-a17d-439dacafc4cb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:10:51.133790 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.133765    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c06ecc3f-92f4-40cc-a17d-439dacafc4cb" (UID: "c06ecc3f-92f4-40cc-a17d-439dacafc4cb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:10:51.133866 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.133775    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-kube-api-access-9cgr5" (OuterVolumeSpecName: "kube-api-access-9cgr5") pod "c06ecc3f-92f4-40cc-a17d-439dacafc4cb" (UID: "c06ecc3f-92f4-40cc-a17d-439dacafc4cb"). InnerVolumeSpecName "kube-api-access-9cgr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:10:51.232878 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.232828    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cgr5\" (UniqueName: \"kubernetes.io/projected/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-kube-api-access-9cgr5\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:10:51.232878 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.232872    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-maas-api-tls\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:10:51.232878 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.232886    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c06ecc3f-92f4-40cc-a17d-439dacafc4cb-openshift-service-ca\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:10:51.575966 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.575931    2557 generic.go:356] "Generic (PLEG): container finished" podID="c06ecc3f-92f4-40cc-a17d-439dacafc4cb" containerID="b3925e271ea46210dc0a73642132c56d53337aaa618a1729f2cbb55fe0b3a6b2" exitCode=0
Jul 20 13:10:51.576131 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.575973    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"
Jul 20 13:10:51.576131 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.575998    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc" event={"ID":"c06ecc3f-92f4-40cc-a17d-439dacafc4cb","Type":"ContainerDied","Data":"b3925e271ea46210dc0a73642132c56d53337aaa618a1729f2cbb55fe0b3a6b2"}
Jul 20 13:10:51.576131 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.576041    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc" event={"ID":"c06ecc3f-92f4-40cc-a17d-439dacafc4cb","Type":"ContainerDied","Data":"d541ed205ce24f2bfb4ec84b1061dfada2c59f846d81ab290d84a27229b58ce3"}
Jul 20 13:10:51.576131 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.576064    2557 scope.go:117] "RemoveContainer" containerID="b3925e271ea46210dc0a73642132c56d53337aaa618a1729f2cbb55fe0b3a6b2"
Jul 20 13:10:51.584904 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.584886    2557 scope.go:117] "RemoveContainer" containerID="b3925e271ea46210dc0a73642132c56d53337aaa618a1729f2cbb55fe0b3a6b2"
Jul 20 13:10:51.585137 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:10:51.585118    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3925e271ea46210dc0a73642132c56d53337aaa618a1729f2cbb55fe0b3a6b2\": container with ID starting with b3925e271ea46210dc0a73642132c56d53337aaa618a1729f2cbb55fe0b3a6b2 not found: ID does not exist" containerID="b3925e271ea46210dc0a73642132c56d53337aaa618a1729f2cbb55fe0b3a6b2"
Jul 20 13:10:51.585190 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.585143    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3925e271ea46210dc0a73642132c56d53337aaa618a1729f2cbb55fe0b3a6b2"} err="failed to get container status \"b3925e271ea46210dc0a73642132c56d53337aaa618a1729f2cbb55fe0b3a6b2\": rpc error: code = NotFound desc = could not find container \"b3925e271ea46210dc0a73642132c56d53337aaa618a1729f2cbb55fe0b3a6b2\": container with ID starting with b3925e271ea46210dc0a73642132c56d53337aaa618a1729f2cbb55fe0b3a6b2 not found: ID does not exist"
Jul 20 13:10:51.592909 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.592878    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"]
Jul 20 13:10:51.596472 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:51.596445    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc7eef60-74cb8f96b9-7brjc"]
Jul 20 13:10:53.380473 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:53.380442    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c06ecc3f-92f4-40cc-a17d-439dacafc4cb" path="/var/lib/kubelet/pods/c06ecc3f-92f4-40cc-a17d-439dacafc4cb/volumes"
Jul 20 13:10:55.602629 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:55.602585    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"]
Jul 20 13:10:55.603105 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:55.602797    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8" podUID="eb280836-0d77-4419-8485-7c51e1bfd383" containerName="istio-proxy" containerID="cri-o://08ddbde0c053e63f7cb83eb949d2bdaaf18080ebaac30fed28ab0514a37d5d12" gracePeriod=30
Jul 20 13:10:56.661390 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.661353    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"]
Jul 20 13:10:56.661924 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.661908    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c06ecc3f-92f4-40cc-a17d-439dacafc4cb" containerName="maas-api"
Jul 20 13:10:56.661969 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.661927    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c06ecc3f-92f4-40cc-a17d-439dacafc4cb" containerName="maas-api"
Jul 20 13:10:56.662021 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.662010    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c06ecc3f-92f4-40cc-a17d-439dacafc4cb" containerName="maas-api"
Jul 20 13:10:56.665201 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.665180    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.667216 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.667199    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-7257abbc-gw-openshift-default-dockercfg-724bt\""
Jul 20 13:10:56.677893 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.677867    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"]
Jul 20 13:10:56.781632 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.781589    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-credential-socket\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.781808 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.781662    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-workload-certs\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.781808 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.781735    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-envoy\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.781808 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.781768    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txjql\" (UniqueName: \"kubernetes.io/projected/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-kube-api-access-txjql\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.781808 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.781789    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-data\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.781943 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.781832    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-workload-socket\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.781943 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.781881    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-podinfo\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.781943 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.781903    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-token\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.781943 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.781931    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istiod-ca-cert\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.883056 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.883017    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-token\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.883233 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.883064    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istiod-ca-cert\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.883233 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.883103    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-credential-socket\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.883233 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.883128    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-workload-certs\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.883233 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.883190    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-envoy\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.883233 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.883217    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txjql\" (UniqueName: \"kubernetes.io/projected/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-kube-api-access-txjql\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.883493 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.883244    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-data\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.883493 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.883272    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-workload-socket\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.883493 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.883336    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-podinfo\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.883645 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.883520    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-credential-socket\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.883733 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.883711    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-workload-certs\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.883888 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.883864    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-data\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.883945 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.883872    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-workload-socket\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.884014 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.883991    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istiod-ca-cert\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.885482 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.885463    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-envoy\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.885911 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.885890    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-podinfo\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.891227 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.891195    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-token\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.892037 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.892016    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txjql\" (UniqueName: \"kubernetes.io/projected/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-kube-api-access-txjql\") pod \"e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") " pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:56.974936 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:56.974878    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:57.118357 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:57.118304    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"]
Jul 20 13:10:57.120643 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:10:57.120600    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c92a8b_79ad_4348_b610_9c2a8d45d46d.slice/crio-0834e3010ae2ec78fce953966fbc518a1a4b9946b45cde6e4ee979892e7ad56a WatchSource:0}: Error finding container 0834e3010ae2ec78fce953966fbc518a1a4b9946b45cde6e4ee979892e7ad56a: Status 404 returned error can't find the container with id 0834e3010ae2ec78fce953966fbc518a1a4b9946b45cde6e4ee979892e7ad56a
Jul 20 13:10:57.122818 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:57.122785    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:10:57.122889 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:57.122855    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:10:57.122889 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:57.122884    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:10:57.607786 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:57.607755    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj" event={"ID":"f4c92a8b-79ad-4348-b610-9c2a8d45d46d","Type":"ContainerStarted","Data":"489ad9d6bc789f32d3d7d432316899edb3f25194d6060ae1dfad7afe1b3255ac"}
Jul 20 13:10:57.607944 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:57.607802    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj" event={"ID":"f4c92a8b-79ad-4348-b610-9c2a8d45d46d","Type":"ContainerStarted","Data":"0834e3010ae2ec78fce953966fbc518a1a4b9946b45cde6e4ee979892e7ad56a"}
Jul 20 13:10:57.627354 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:57.627308    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj" podStartSLOduration=1.6272933790000002 podStartE2EDuration="1.627293379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:10:57.626656827 +0000 UTC m=+1602.759639928" watchObservedRunningTime="2026-07-20 13:10:57.627293379 +0000 UTC m=+1602.760276478"
Jul 20 13:10:57.975205 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:57.975122    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:58.980706 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:58.980675    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:59.617765 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:59.617734    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:10:59.618854 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:10:59.618830    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:11:00.860098 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.860073    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:11:00.921148 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.921069    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-workload-socket\") pod \"eb280836-0d77-4419-8485-7c51e1bfd383\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") "
Jul 20 13:11:00.921148 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.921110    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb280836-0d77-4419-8485-7c51e1bfd383-istio-podinfo\") pod \"eb280836-0d77-4419-8485-7c51e1bfd383\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") "
Jul 20 13:11:00.921353 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.921183    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-istio-envoy\") pod \"eb280836-0d77-4419-8485-7c51e1bfd383\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") "
Jul 20 13:11:00.921353 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.921206    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb280836-0d77-4419-8485-7c51e1bfd383-istio-token\") pod \"eb280836-0d77-4419-8485-7c51e1bfd383\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") "
Jul 20 13:11:00.921353 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.921231    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-workload-certs\") pod \"eb280836-0d77-4419-8485-7c51e1bfd383\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") "
Jul 20 13:11:00.921353 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.921266    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb280836-0d77-4419-8485-7c51e1bfd383-istiod-ca-cert\") pod \"eb280836-0d77-4419-8485-7c51e1bfd383\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") "
Jul 20 13:11:00.921353 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.921310    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-credential-socket\") pod \"eb280836-0d77-4419-8485-7c51e1bfd383\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") "
Jul 20 13:11:00.921590 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.921349    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb280836-0d77-4419-8485-7c51e1bfd383" (UID: "eb280836-0d77-4419-8485-7c51e1bfd383"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:11:00.921590 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.921364    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6gcb\" (UniqueName: \"kubernetes.io/projected/eb280836-0d77-4419-8485-7c51e1bfd383-kube-api-access-x6gcb\") pod \"eb280836-0d77-4419-8485-7c51e1bfd383\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") "
Jul 20 13:11:00.921590 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.921389    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-istio-data\") pod \"eb280836-0d77-4419-8485-7c51e1bfd383\" (UID: \"eb280836-0d77-4419-8485-7c51e1bfd383\") "
Jul 20 13:11:00.921749 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.921727    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-workload-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:00.921804 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.921745    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb280836-0d77-4419-8485-7c51e1bfd383-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb280836-0d77-4419-8485-7c51e1bfd383" (UID: "eb280836-0d77-4419-8485-7c51e1bfd383"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:11:00.921980 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.921954    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb280836-0d77-4419-8485-7c51e1bfd383" (UID: "eb280836-0d77-4419-8485-7c51e1bfd383"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:11:00.922069 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.922055    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb280836-0d77-4419-8485-7c51e1bfd383" (UID: "eb280836-0d77-4419-8485-7c51e1bfd383"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:11:00.922395 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.922375    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb280836-0d77-4419-8485-7c51e1bfd383" (UID: "eb280836-0d77-4419-8485-7c51e1bfd383"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:11:00.923916 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.923883    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb280836-0d77-4419-8485-7c51e1bfd383-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb280836-0d77-4419-8485-7c51e1bfd383" (UID: "eb280836-0d77-4419-8485-7c51e1bfd383"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:11:00.923916 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.923896    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb280836-0d77-4419-8485-7c51e1bfd383-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb280836-0d77-4419-8485-7c51e1bfd383" (UID: "eb280836-0d77-4419-8485-7c51e1bfd383"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:11:00.924065 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.923979    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb280836-0d77-4419-8485-7c51e1bfd383-kube-api-access-x6gcb" (OuterVolumeSpecName: "kube-api-access-x6gcb") pod "eb280836-0d77-4419-8485-7c51e1bfd383" (UID: "eb280836-0d77-4419-8485-7c51e1bfd383"). InnerVolumeSpecName "kube-api-access-x6gcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:11:00.924065 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:00.924016    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb280836-0d77-4419-8485-7c51e1bfd383" (UID: "eb280836-0d77-4419-8485-7c51e1bfd383"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:11:01.022753 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.022723    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-istio-envoy\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:01.022753 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.022749    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb280836-0d77-4419-8485-7c51e1bfd383-istio-token\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:01.022753 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.022759    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-workload-certs\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:01.022977 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.022767    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb280836-0d77-4419-8485-7c51e1bfd383-istiod-ca-cert\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:01.022977 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.022775    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-credential-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:01.022977 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.022784    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6gcb\" (UniqueName: \"kubernetes.io/projected/eb280836-0d77-4419-8485-7c51e1bfd383-kube-api-access-x6gcb\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:01.022977 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.022792    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb280836-0d77-4419-8485-7c51e1bfd383-istio-data\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:01.022977 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.022800    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb280836-0d77-4419-8485-7c51e1bfd383-istio-podinfo\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:01.629157 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.629125    2557 generic.go:356] "Generic (PLEG): container finished" podID="eb280836-0d77-4419-8485-7c51e1bfd383" containerID="08ddbde0c053e63f7cb83eb949d2bdaaf18080ebaac30fed28ab0514a37d5d12" exitCode=0
Jul 20 13:11:01.629302 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.629177    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"
Jul 20 13:11:01.629302 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.629215    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8" event={"ID":"eb280836-0d77-4419-8485-7c51e1bfd383","Type":"ContainerDied","Data":"08ddbde0c053e63f7cb83eb949d2bdaaf18080ebaac30fed28ab0514a37d5d12"}
Jul 20 13:11:01.629302 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.629275    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8" event={"ID":"eb280836-0d77-4419-8485-7c51e1bfd383","Type":"ContainerDied","Data":"d17fc5c6365f7d0ac61fe4fd53d38c331e2fc28ce39a0371cca07f9df52d8bc3"}
Jul 20 13:11:01.629450 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.629306    2557 scope.go:117] "RemoveContainer" containerID="08ddbde0c053e63f7cb83eb949d2bdaaf18080ebaac30fed28ab0514a37d5d12"
Jul 20 13:11:01.638592 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.638568    2557 scope.go:117] "RemoveContainer" containerID="c8a87388ecb08c21593e9a07f618dc5496091b1dfca2d7802ed69f3406357e4c"
Jul 20 13:11:01.648250 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.648196    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"]
Jul 20 13:11:01.650298 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.650274    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-fc7eef60-openshift-default-7894dd4fd7-lvxb8"]
Jul 20 13:11:01.653184 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.653162    2557 scope.go:117] "RemoveContainer" containerID="08ddbde0c053e63f7cb83eb949d2bdaaf18080ebaac30fed28ab0514a37d5d12"
Jul 20 13:11:01.653485 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:11:01.653458    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ddbde0c053e63f7cb83eb949d2bdaaf18080ebaac30fed28ab0514a37d5d12\": container with ID starting with 08ddbde0c053e63f7cb83eb949d2bdaaf18080ebaac30fed28ab0514a37d5d12 not found: ID does not exist" containerID="08ddbde0c053e63f7cb83eb949d2bdaaf18080ebaac30fed28ab0514a37d5d12"
Jul 20 13:11:01.653541 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.653484    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ddbde0c053e63f7cb83eb949d2bdaaf18080ebaac30fed28ab0514a37d5d12"} err="failed to get container status \"08ddbde0c053e63f7cb83eb949d2bdaaf18080ebaac30fed28ab0514a37d5d12\": rpc error: code = NotFound desc = could not find container \"08ddbde0c053e63f7cb83eb949d2bdaaf18080ebaac30fed28ab0514a37d5d12\": container with ID starting with 08ddbde0c053e63f7cb83eb949d2bdaaf18080ebaac30fed28ab0514a37d5d12 not found: ID does not exist"
Jul 20 13:11:01.653541 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.653506    2557 scope.go:117] "RemoveContainer" containerID="c8a87388ecb08c21593e9a07f618dc5496091b1dfca2d7802ed69f3406357e4c"
Jul 20 13:11:01.653792 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:11:01.653772    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8a87388ecb08c21593e9a07f618dc5496091b1dfca2d7802ed69f3406357e4c\": container with ID starting with c8a87388ecb08c21593e9a07f618dc5496091b1dfca2d7802ed69f3406357e4c not found: ID does not exist" containerID="c8a87388ecb08c21593e9a07f618dc5496091b1dfca2d7802ed69f3406357e4c"
Jul 20 13:11:01.653847 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:01.653802    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8a87388ecb08c21593e9a07f618dc5496091b1dfca2d7802ed69f3406357e4c"} err="failed to get container status \"c8a87388ecb08c21593e9a07f618dc5496091b1dfca2d7802ed69f3406357e4c\": rpc error: code = NotFound desc = could not find container \"c8a87388ecb08c21593e9a07f618dc5496091b1dfca2d7802ed69f3406357e4c\": container with ID starting with c8a87388ecb08c21593e9a07f618dc5496091b1dfca2d7802ed69f3406357e4c not found: ID does not exist"
Jul 20 13:11:03.381017 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:03.380984    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb280836-0d77-4419-8485-7c51e1bfd383" path="/var/lib/kubelet/pods/eb280836-0d77-4419-8485-7c51e1bfd383/volumes"
Jul 20 13:11:14.619037 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:14.618953    2557 patch_prober.go:28] interesting pod/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 20 13:11:14.619037 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:14.619020    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj" podUID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 20 13:11:14.695114 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:14.695081    2557 generic.go:356] "Generic (PLEG): container finished" podID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerID="489ad9d6bc789f32d3d7d432316899edb3f25194d6060ae1dfad7afe1b3255ac" exitCode=0
Jul 20 13:11:14.695273 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:14.695151    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj" event={"ID":"f4c92a8b-79ad-4348-b610-9c2a8d45d46d","Type":"ContainerDied","Data":"489ad9d6bc789f32d3d7d432316899edb3f25194d6060ae1dfad7afe1b3255ac"}
Jul 20 13:11:14.695512 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:14.695498    2557 scope.go:117] "RemoveContainer" containerID="489ad9d6bc789f32d3d7d432316899edb3f25194d6060ae1dfad7afe1b3255ac"
Jul 20 13:11:14.696506 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:14.696480    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:11:14.696572 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:14.696547    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:11:14.696609 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:14.696581    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:11:15.701136 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:15.701104    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj" event={"ID":"f4c92a8b-79ad-4348-b610-9c2a8d45d46d","Type":"ContainerStarted","Data":"73e0f4fd666902f6e072657e93d8bc15e47899c1665a7bfeef2cbba901826f81"}
Jul 20 13:11:15.976086 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:15.976043    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:11:15.976343 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:15.976319    2557 patch_prober.go:28] interesting pod/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 20 13:11:15.976442 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:15.976387    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj" podUID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 20 13:11:16.975317 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:16.975281    2557 patch_prober.go:28] interesting pod/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 20 13:11:16.975721 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:16.975332    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj" podUID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 20 13:11:17.975983 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:17.975942    2557 patch_prober.go:28] interesting pod/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 20 13:11:17.976444 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:17.976007    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj" podUID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 20 13:11:18.975797 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:18.975755    2557 patch_prober.go:28] interesting pod/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 20 13:11:18.975971 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:18.975834    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj" podUID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 20 13:11:19.975944 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:19.975899    2557 patch_prober.go:28] interesting pod/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 20 13:11:19.976340 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:19.975991    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj" podUID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 20 13:11:20.979293 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:20.979263    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:11:20.979715 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:20.979547    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:11:20.980263 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:20.980240    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:11:39.335273 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:39.335242    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"]
Jul 20 13:11:39.335806 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:39.335438    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj" podUID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerName="istio-proxy" containerID="cri-o://73e0f4fd666902f6e072657e93d8bc15e47899c1665a7bfeef2cbba901826f81" gracePeriod=30
Jul 20 13:11:44.594310 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.594245    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:11:44.704501 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.704469    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-envoy\") pod \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") "
Jul 20 13:11:44.704501 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.704502    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-token\") pod \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") "
Jul 20 13:11:44.704773 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.704543    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-workload-socket\") pod \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") "
Jul 20 13:11:44.704773 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.704576    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-workload-certs\") pod \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") "
Jul 20 13:11:44.704773 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.704606    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istiod-ca-cert\") pod \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") "
Jul 20 13:11:44.704773 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.704660    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txjql\" (UniqueName: \"kubernetes.io/projected/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-kube-api-access-txjql\") pod \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") "
Jul 20 13:11:44.704773 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.704691    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-data\") pod \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") "
Jul 20 13:11:44.704773 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.704732    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-podinfo\") pod \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") "
Jul 20 13:11:44.704773 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.704757    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-credential-socket\") pod \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\" (UID: \"f4c92a8b-79ad-4348-b610-9c2a8d45d46d\") "
Jul 20 13:11:44.705116 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.704990    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4c92a8b-79ad-4348-b610-9c2a8d45d46d" (UID: "f4c92a8b-79ad-4348-b610-9c2a8d45d46d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:11:44.705116 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.705042    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4c92a8b-79ad-4348-b610-9c2a8d45d46d" (UID: "f4c92a8b-79ad-4348-b610-9c2a8d45d46d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:11:44.705116 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.705082    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4c92a8b-79ad-4348-b610-9c2a8d45d46d" (UID: "f4c92a8b-79ad-4348-b610-9c2a8d45d46d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:11:44.705275 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.705183    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4c92a8b-79ad-4348-b610-9c2a8d45d46d" (UID: "f4c92a8b-79ad-4348-b610-9c2a8d45d46d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:11:44.705575 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.705550    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4c92a8b-79ad-4348-b610-9c2a8d45d46d" (UID: "f4c92a8b-79ad-4348-b610-9c2a8d45d46d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:11:44.706814 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.706790    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4c92a8b-79ad-4348-b610-9c2a8d45d46d" (UID: "f4c92a8b-79ad-4348-b610-9c2a8d45d46d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:11:44.707074 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.707056    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-kube-api-access-txjql" (OuterVolumeSpecName: "kube-api-access-txjql") pod "f4c92a8b-79ad-4348-b610-9c2a8d45d46d" (UID: "f4c92a8b-79ad-4348-b610-9c2a8d45d46d"). InnerVolumeSpecName "kube-api-access-txjql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:11:44.707222 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.707202    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4c92a8b-79ad-4348-b610-9c2a8d45d46d" (UID: "f4c92a8b-79ad-4348-b610-9c2a8d45d46d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:11:44.707222 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.707200    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4c92a8b-79ad-4348-b610-9c2a8d45d46d" (UID: "f4c92a8b-79ad-4348-b610-9c2a8d45d46d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:11:44.805552 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.805530    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-envoy\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:44.805552 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.805551    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-token\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:44.805709 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.805559    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-workload-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:44.805709 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.805568    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-workload-certs\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:44.805709 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.805576    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istiod-ca-cert\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:44.805709 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.805583    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txjql\" (UniqueName: \"kubernetes.io/projected/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-kube-api-access-txjql\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:44.805709 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.805592    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-data\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:44.805709 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.805599    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-istio-podinfo\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:44.805709 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.805607    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4c92a8b-79ad-4348-b610-9c2a8d45d46d-credential-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:11:44.838945 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.838915    2557 generic.go:356] "Generic (PLEG): container finished" podID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerID="73e0f4fd666902f6e072657e93d8bc15e47899c1665a7bfeef2cbba901826f81" exitCode=0
Jul 20 13:11:44.839041 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.838962    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"
Jul 20 13:11:44.839041 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.839000    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj" event={"ID":"f4c92a8b-79ad-4348-b610-9c2a8d45d46d","Type":"ContainerDied","Data":"73e0f4fd666902f6e072657e93d8bc15e47899c1665a7bfeef2cbba901826f81"}
Jul 20 13:11:44.839115 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.839074    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj" event={"ID":"f4c92a8b-79ad-4348-b610-9c2a8d45d46d","Type":"ContainerDied","Data":"0834e3010ae2ec78fce953966fbc518a1a4b9946b45cde6e4ee979892e7ad56a"}
Jul 20 13:11:44.839115 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.839097    2557 scope.go:117] "RemoveContainer" containerID="73e0f4fd666902f6e072657e93d8bc15e47899c1665a7bfeef2cbba901826f81"
Jul 20 13:11:44.848331 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.848317    2557 scope.go:117] "RemoveContainer" containerID="489ad9d6bc789f32d3d7d432316899edb3f25194d6060ae1dfad7afe1b3255ac"
Jul 20 13:11:44.855568 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.855552    2557 scope.go:117] "RemoveContainer" containerID="73e0f4fd666902f6e072657e93d8bc15e47899c1665a7bfeef2cbba901826f81"
Jul 20 13:11:44.855823 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:11:44.855804    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73e0f4fd666902f6e072657e93d8bc15e47899c1665a7bfeef2cbba901826f81\": container with ID starting with 73e0f4fd666902f6e072657e93d8bc15e47899c1665a7bfeef2cbba901826f81 not found: ID does not exist" containerID="73e0f4fd666902f6e072657e93d8bc15e47899c1665a7bfeef2cbba901826f81"
Jul 20 13:11:44.855886 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.855831    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73e0f4fd666902f6e072657e93d8bc15e47899c1665a7bfeef2cbba901826f81"} err="failed to get container status \"73e0f4fd666902f6e072657e93d8bc15e47899c1665a7bfeef2cbba901826f81\": rpc error: code = NotFound desc = could not find container \"73e0f4fd666902f6e072657e93d8bc15e47899c1665a7bfeef2cbba901826f81\": container with ID starting with 73e0f4fd666902f6e072657e93d8bc15e47899c1665a7bfeef2cbba901826f81 not found: ID does not exist"
Jul 20 13:11:44.855886 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.855848    2557 scope.go:117] "RemoveContainer" containerID="489ad9d6bc789f32d3d7d432316899edb3f25194d6060ae1dfad7afe1b3255ac"
Jul 20 13:11:44.856098 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:11:44.856082    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"489ad9d6bc789f32d3d7d432316899edb3f25194d6060ae1dfad7afe1b3255ac\": container with ID starting with 489ad9d6bc789f32d3d7d432316899edb3f25194d6060ae1dfad7afe1b3255ac not found: ID does not exist" containerID="489ad9d6bc789f32d3d7d432316899edb3f25194d6060ae1dfad7afe1b3255ac"
Jul 20 13:11:44.856134 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.856105    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489ad9d6bc789f32d3d7d432316899edb3f25194d6060ae1dfad7afe1b3255ac"} err="failed to get container status \"489ad9d6bc789f32d3d7d432316899edb3f25194d6060ae1dfad7afe1b3255ac\": rpc error: code = NotFound desc = could not find container \"489ad9d6bc789f32d3d7d432316899edb3f25194d6060ae1dfad7afe1b3255ac\": container with ID starting with 489ad9d6bc789f32d3d7d432316899edb3f25194d6060ae1dfad7afe1b3255ac not found: ID does not exist"
Jul 20 13:11:44.861761 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.861741    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"]
Jul 20 13:11:44.868032 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:44.868011    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-7257abbc-gw-openshift-default-5dbbb85895-62fjj"]
Jul 20 13:11:45.380725 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:11:45.380695    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" path="/var/lib/kubelet/pods/f4c92a8b-79ad-4348-b610-9c2a8d45d46d/volumes"
Jul 20 13:12:08.344710 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.344675    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld"]
Jul 20 13:12:08.345106 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.345031    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb280836-0d77-4419-8485-7c51e1bfd383" containerName="istio-proxy"
Jul 20 13:12:08.345106 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.345042    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb280836-0d77-4419-8485-7c51e1bfd383" containerName="istio-proxy"
Jul 20 13:12:08.345106 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.345066    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerName="istio-proxy"
Jul 20 13:12:08.345106 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.345072    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerName="istio-proxy"
Jul 20 13:12:08.345106 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.345080    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerName="istio-proxy"
Jul 20 13:12:08.345106 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.345086    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerName="istio-proxy"
Jul 20 13:12:08.345289 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.345141    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerName="istio-proxy"
Jul 20 13:12:08.345289 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.345150    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb280836-0d77-4419-8485-7c51e1bfd383" containerName="istio-proxy"
Jul 20 13:12:08.345289 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.345156    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb280836-0d77-4419-8485-7c51e1bfd383" containerName="istio-proxy"
Jul 20 13:12:08.347007 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.346983    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld"
Jul 20 13:12:08.349346 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.349321    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4s4l\""
Jul 20 13:12:08.357931 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.357902    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld"]
Jul 20 13:12:08.517421 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.517386    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/effd13e3-0a13-4911-999e-28782fd8c025-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld\" (UID: \"effd13e3-0a13-4911-999e-28782fd8c025\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld"
Jul 20 13:12:08.618936 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.618856    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/effd13e3-0a13-4911-999e-28782fd8c025-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld\" (UID: \"effd13e3-0a13-4911-999e-28782fd8c025\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld"
Jul 20 13:12:08.619467 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.619450    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/effd13e3-0a13-4911-999e-28782fd8c025-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld\" (UID: \"effd13e3-0a13-4911-999e-28782fd8c025\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld"
Jul 20 13:12:08.658236 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.658210    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld"
Jul 20 13:12:08.997573 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:08.997545    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld"]
Jul 20 13:12:08.999890 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:12:08.999863    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeffd13e3_0a13_4911_999e_28782fd8c025.slice/crio-2d6fcc634f32726a6bb7eb5643782d82ef82569d5890d35f423de505b2f279c1 WatchSource:0}: Error finding container 2d6fcc634f32726a6bb7eb5643782d82ef82569d5890d35f423de505b2f279c1: Status 404 returned error can't find the container with id 2d6fcc634f32726a6bb7eb5643782d82ef82569d5890d35f423de505b2f279c1
Jul 20 13:12:09.954572 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:09.954526    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld" event={"ID":"effd13e3-0a13-4911-999e-28782fd8c025","Type":"ContainerStarted","Data":"2d6fcc634f32726a6bb7eb5643782d82ef82569d5890d35f423de505b2f279c1"}
Jul 20 13:12:11.965179 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:11.965142    2557 generic.go:356] "Generic (PLEG): container finished" podID="effd13e3-0a13-4911-999e-28782fd8c025" containerID="90fa1ce5e2219dd7f33590a68320e0eb7723d476074e468454a4a4959abe5b05" exitCode=0
Jul 20 13:12:11.965537 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:11.965220    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld" event={"ID":"effd13e3-0a13-4911-999e-28782fd8c025","Type":"ContainerDied","Data":"90fa1ce5e2219dd7f33590a68320e0eb7723d476074e468454a4a4959abe5b05"}
Jul 20 13:12:13.099854 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:13.099833    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld"
Jul 20 13:12:13.256039 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:13.255956    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/effd13e3-0a13-4911-999e-28782fd8c025-maas-api-service-ca\") pod \"effd13e3-0a13-4911-999e-28782fd8c025\" (UID: \"effd13e3-0a13-4911-999e-28782fd8c025\") "
Jul 20 13:12:13.256349 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:13.256323    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/effd13e3-0a13-4911-999e-28782fd8c025-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "effd13e3-0a13-4911-999e-28782fd8c025" (UID: "effd13e3-0a13-4911-999e-28782fd8c025"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:12:13.356804 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:13.356775    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/effd13e3-0a13-4911-999e-28782fd8c025-maas-api-service-ca\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:12:13.975457 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:13.975421    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld" event={"ID":"effd13e3-0a13-4911-999e-28782fd8c025","Type":"ContainerDied","Data":"2d6fcc634f32726a6bb7eb5643782d82ef82569d5890d35f423de505b2f279c1"}
Jul 20 13:12:13.975457 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:13.975439    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld"
Jul 20 13:12:13.975919 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:13.975475    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d6fcc634f32726a6bb7eb5643782d82ef82569d5890d35f423de505b2f279c1"
Jul 20 13:12:23.433415 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:23.433369    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld"]
Jul 20 13:12:23.435218 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:23.435190    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-de7145c9-9g4ld"]
Jul 20 13:12:25.330772 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.330739    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"]
Jul 20 13:12:25.331128 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.331094    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="effd13e3-0a13-4911-999e-28782fd8c025" containerName="revoke-keys"
Jul 20 13:12:25.331128 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.331105    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="effd13e3-0a13-4911-999e-28782fd8c025" containerName="revoke-keys"
Jul 20 13:12:25.331202 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.331132    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb280836-0d77-4419-8485-7c51e1bfd383" containerName="istio-proxy"
Jul 20 13:12:25.331202 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.331138    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb280836-0d77-4419-8485-7c51e1bfd383" containerName="istio-proxy"
Jul 20 13:12:25.331202 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.331194    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4c92a8b-79ad-4348-b610-9c2a8d45d46d" containerName="istio-proxy"
Jul 20 13:12:25.331202 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.331202    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="effd13e3-0a13-4911-999e-28782fd8c025" containerName="revoke-keys"
Jul 20 13:12:25.333991 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.333974    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.336274 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.336250    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-5545572a-openshift-default-dockercfg-2fm8h\""
Jul 20 13:12:25.346830 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.346806    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"]
Jul 20 13:12:25.358231 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.358208    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-envoy\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.358357 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.358245    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-data\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.358357 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.358271    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-token\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.358357 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.358327    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istiod-ca-cert\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.358517 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.358356    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jbbl\" (UniqueName: \"kubernetes.io/projected/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-kube-api-access-4jbbl\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.358517 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.358425    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-credential-socket\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.358517 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.358476    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-workload-certs\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.358703 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.358515    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-workload-socket\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.358703 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.358603    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-podinfo\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.381201 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.381176    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="effd13e3-0a13-4911-999e-28782fd8c025" path="/var/lib/kubelet/pods/effd13e3-0a13-4911-999e-28782fd8c025/volumes"
Jul 20 13:12:25.459367 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.459338    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istiod-ca-cert\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.459546 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.459372    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jbbl\" (UniqueName: \"kubernetes.io/projected/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-kube-api-access-4jbbl\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.459546 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.459415    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-credential-socket\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.459546 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.459443    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-workload-certs\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.459546 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.459462    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-workload-socket\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.459546 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.459521    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-podinfo\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.459833 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.459647    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-envoy\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.459833 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.459690    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-data\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.459833 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.459712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-token\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.459987 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.459908    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-credential-socket\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.459987 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.459966    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-workload-certs\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.460101 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.460068    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-workload-socket\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.460180 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.460157    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istiod-ca-cert\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.460239 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.460162    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-data\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.461853 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.461831    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-envoy\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.461957 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.461938    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-podinfo\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.467372 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.467349    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-token\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.467780 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.467764    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jbbl\" (UniqueName: \"kubernetes.io/projected/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-kube-api-access-4jbbl\") pod \"e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") " pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.645092 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.645017    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:25.779202 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.779163    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"]
Jul 20 13:12:25.782660 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:12:25.782587    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5daf19_90ef_4b9d_8176_bb0d9780dabe.slice/crio-fb02965edaef2b0d81703ba88208ea3f4690da17678bf702bc037e37aa90f5d7 WatchSource:0}: Error finding container fb02965edaef2b0d81703ba88208ea3f4690da17678bf702bc037e37aa90f5d7: Status 404 returned error can't find the container with id fb02965edaef2b0d81703ba88208ea3f4690da17678bf702bc037e37aa90f5d7
Jul 20 13:12:25.785134 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.785095    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:12:25.785231 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.785178    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:12:25.785231 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:25.785220    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:12:26.034348 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:26.034264    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb" event={"ID":"ff5daf19-90ef-4b9d-8176-bb0d9780dabe","Type":"ContainerStarted","Data":"0e0845cba023d4b874ea70bc37eb5116a108bf7761c4df272854b15ec69563e7"}
Jul 20 13:12:26.034348 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:26.034333    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb" event={"ID":"ff5daf19-90ef-4b9d-8176-bb0d9780dabe","Type":"ContainerStarted","Data":"fb02965edaef2b0d81703ba88208ea3f4690da17678bf702bc037e37aa90f5d7"}
Jul 20 13:12:26.056940 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:26.056885    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb" podStartSLOduration=1.056865559 podStartE2EDuration="1.056865559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:12:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:12:26.054714017 +0000 UTC m=+1691.187697119" watchObservedRunningTime="2026-07-20 13:12:26.056865559 +0000 UTC m=+1691.189848660"
Jul 20 13:12:26.645711 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:26.645671    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:26.650575 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:26.650548    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:27.039344 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:27.039267    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:27.040373 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:27.040354    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:42.558073 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:42.557931    2557 patch_prober.go:28] interesting pod/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": read tcp 10.132.0.2:43498->10.132.0.44:15021: read: connection reset by peer" start-of-body=
Jul 20 13:12:42.558073 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:42.558015    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb" podUID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": read tcp 10.132.0.2:43498->10.132.0.44:15021: read: connection reset by peer"
Jul 20 13:12:43.115055 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:43.115023    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" containerID="0e0845cba023d4b874ea70bc37eb5116a108bf7761c4df272854b15ec69563e7" exitCode=0
Jul 20 13:12:43.115228 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:43.115068    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb" event={"ID":"ff5daf19-90ef-4b9d-8176-bb0d9780dabe","Type":"ContainerDied","Data":"0e0845cba023d4b874ea70bc37eb5116a108bf7761c4df272854b15ec69563e7"}
Jul 20 13:12:43.115448 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:43.115436    2557 scope.go:117] "RemoveContainer" containerID="0e0845cba023d4b874ea70bc37eb5116a108bf7761c4df272854b15ec69563e7"
Jul 20 13:12:43.116424 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:43.116398    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:12:43.116490 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:43.116477    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:12:43.116530 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:43.116509    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:12:44.122359 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:44.122325    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb" event={"ID":"ff5daf19-90ef-4b9d-8176-bb0d9780dabe","Type":"ContainerStarted","Data":"51cfc5504acbd13568d64e150dda272b19b79ecee1c008f917fc24b42983bc0d"}
Jul 20 13:12:44.645604 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:44.645557    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:44.645885 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:44.645860    2557 patch_prober.go:28] interesting pod/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 20 13:12:44.645976 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:44.645917    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb" podUID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 20 13:12:45.645710 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:45.645676    2557 patch_prober.go:28] interesting pod/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 20 13:12:45.646161 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:45.645739    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb" podUID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 20 13:12:46.645916 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:46.645882    2557 patch_prober.go:28] interesting pod/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 20 13:12:46.646299 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:46.645940    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb" podUID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 20 13:12:47.645726 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:47.645689    2557 patch_prober.go:28] interesting pod/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 20 13:12:47.645907 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:47.645740    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb" podUID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 20 13:12:48.649363 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:48.649336    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:48.649789 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:48.649607    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:12:48.650293 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:12:48.650276    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:13:07.478891 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:07.478858    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"]
Jul 20 13:13:07.479363 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:07.479141    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb" podUID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" containerName="istio-proxy" containerID="cri-o://51cfc5504acbd13568d64e150dda272b19b79ecee1c008f917fc24b42983bc0d" gracePeriod=30
Jul 20 13:13:12.743630 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.743560    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:13:12.794993 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.794967    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-data\") pod \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") "
Jul 20 13:13:12.795114 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795013    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-podinfo\") pod \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") "
Jul 20 13:13:12.795114 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795043    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-workload-socket\") pod \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") "
Jul 20 13:13:12.795114 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795070    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istiod-ca-cert\") pod \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") "
Jul 20 13:13:12.795254 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795125    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-envoy\") pod \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") "
Jul 20 13:13:12.795254 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795139    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-workload-certs\") pod \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") "
Jul 20 13:13:12.795367 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795272    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jbbl\" (UniqueName: \"kubernetes.io/projected/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-kube-api-access-4jbbl\") pod \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") "
Jul 20 13:13:12.795367 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795315    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-token\") pod \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") "
Jul 20 13:13:12.795367 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795343    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-credential-socket\") pod \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\" (UID: \"ff5daf19-90ef-4b9d-8176-bb0d9780dabe\") "
Jul 20 13:13:12.795515 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795408    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff5daf19-90ef-4b9d-8176-bb0d9780dabe" (UID: "ff5daf19-90ef-4b9d-8176-bb0d9780dabe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:13:12.795586 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795504    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff5daf19-90ef-4b9d-8176-bb0d9780dabe" (UID: "ff5daf19-90ef-4b9d-8176-bb0d9780dabe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:13:12.795732 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795703    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istiod-ca-cert\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:13:12.795732 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795713    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff5daf19-90ef-4b9d-8176-bb0d9780dabe" (UID: "ff5daf19-90ef-4b9d-8176-bb0d9780dabe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:13:12.795732 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795727    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-workload-certs\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:13:12.795923 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795801    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff5daf19-90ef-4b9d-8176-bb0d9780dabe" (UID: "ff5daf19-90ef-4b9d-8176-bb0d9780dabe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:13:12.795923 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.795858    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff5daf19-90ef-4b9d-8176-bb0d9780dabe" (UID: "ff5daf19-90ef-4b9d-8176-bb0d9780dabe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:13:12.797180 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.797152    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff5daf19-90ef-4b9d-8176-bb0d9780dabe" (UID: "ff5daf19-90ef-4b9d-8176-bb0d9780dabe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:13:12.797384 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.797358    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-kube-api-access-4jbbl" (OuterVolumeSpecName: "kube-api-access-4jbbl") pod "ff5daf19-90ef-4b9d-8176-bb0d9780dabe" (UID: "ff5daf19-90ef-4b9d-8176-bb0d9780dabe"). InnerVolumeSpecName "kube-api-access-4jbbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:13:12.797662 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.797638    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff5daf19-90ef-4b9d-8176-bb0d9780dabe" (UID: "ff5daf19-90ef-4b9d-8176-bb0d9780dabe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:13:12.797736 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.797695    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff5daf19-90ef-4b9d-8176-bb0d9780dabe" (UID: "ff5daf19-90ef-4b9d-8176-bb0d9780dabe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:13:12.897143 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.897101    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-data\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:13:12.897143 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.897139    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-podinfo\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:13:12.897143 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.897152    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-workload-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:13:12.897352 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.897164    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-envoy\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:13:12.897352 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.897177    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jbbl\" (UniqueName: \"kubernetes.io/projected/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-kube-api-access-4jbbl\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:13:12.897352 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.897190    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-istio-token\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:13:12.897352 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:12.897201    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff5daf19-90ef-4b9d-8176-bb0d9780dabe-credential-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:13:13.273077 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:13.273046    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" containerID="51cfc5504acbd13568d64e150dda272b19b79ecee1c008f917fc24b42983bc0d" exitCode=0
Jul 20 13:13:13.273266 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:13.273094    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb" event={"ID":"ff5daf19-90ef-4b9d-8176-bb0d9780dabe","Type":"ContainerDied","Data":"51cfc5504acbd13568d64e150dda272b19b79ecee1c008f917fc24b42983bc0d"}
Jul 20 13:13:13.273266 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:13.273133    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb" event={"ID":"ff5daf19-90ef-4b9d-8176-bb0d9780dabe","Type":"ContainerDied","Data":"fb02965edaef2b0d81703ba88208ea3f4690da17678bf702bc037e37aa90f5d7"}
Jul 20 13:13:13.273266 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:13.273153    2557 scope.go:117] "RemoveContainer" containerID="51cfc5504acbd13568d64e150dda272b19b79ecee1c008f917fc24b42983bc0d"
Jul 20 13:13:13.273266 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:13.273095    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"
Jul 20 13:13:13.282274 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:13.282255    2557 scope.go:117] "RemoveContainer" containerID="0e0845cba023d4b874ea70bc37eb5116a108bf7761c4df272854b15ec69563e7"
Jul 20 13:13:13.290136 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:13.290119    2557 scope.go:117] "RemoveContainer" containerID="51cfc5504acbd13568d64e150dda272b19b79ecee1c008f917fc24b42983bc0d"
Jul 20 13:13:13.290373 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:13:13.290352    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51cfc5504acbd13568d64e150dda272b19b79ecee1c008f917fc24b42983bc0d\": container with ID starting with 51cfc5504acbd13568d64e150dda272b19b79ecee1c008f917fc24b42983bc0d not found: ID does not exist" containerID="51cfc5504acbd13568d64e150dda272b19b79ecee1c008f917fc24b42983bc0d"
Jul 20 13:13:13.290423 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:13.290382    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51cfc5504acbd13568d64e150dda272b19b79ecee1c008f917fc24b42983bc0d"} err="failed to get container status \"51cfc5504acbd13568d64e150dda272b19b79ecee1c008f917fc24b42983bc0d\": rpc error: code = NotFound desc = could not find container \"51cfc5504acbd13568d64e150dda272b19b79ecee1c008f917fc24b42983bc0d\": container with ID starting with 51cfc5504acbd13568d64e150dda272b19b79ecee1c008f917fc24b42983bc0d not found: ID does not exist"
Jul 20 13:13:13.290423 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:13.290398    2557 scope.go:117] "RemoveContainer" containerID="0e0845cba023d4b874ea70bc37eb5116a108bf7761c4df272854b15ec69563e7"
Jul 20 13:13:13.290656 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:13:13.290614    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e0845cba023d4b874ea70bc37eb5116a108bf7761c4df272854b15ec69563e7\": container with ID starting with 0e0845cba023d4b874ea70bc37eb5116a108bf7761c4df272854b15ec69563e7 not found: ID does not exist" containerID="0e0845cba023d4b874ea70bc37eb5116a108bf7761c4df272854b15ec69563e7"
Jul 20 13:13:13.290723 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:13.290667    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e0845cba023d4b874ea70bc37eb5116a108bf7761c4df272854b15ec69563e7"} err="failed to get container status \"0e0845cba023d4b874ea70bc37eb5116a108bf7761c4df272854b15ec69563e7\": rpc error: code = NotFound desc = could not find container \"0e0845cba023d4b874ea70bc37eb5116a108bf7761c4df272854b15ec69563e7\": container with ID starting with 0e0845cba023d4b874ea70bc37eb5116a108bf7761c4df272854b15ec69563e7 not found: ID does not exist"
Jul 20 13:13:13.295478 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:13.295459    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"]
Jul 20 13:13:13.299438 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:13.299419    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-5545572a-openshift-default-77c4c76d59-mdsvb"]
Jul 20 13:13:13.382087 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:13:13.382047    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" path="/var/lib/kubelet/pods/ff5daf19-90ef-4b9d-8176-bb0d9780dabe/volumes"
Jul 20 13:14:50.951285 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:50.951251    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"]
Jul 20 13:14:50.951899 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:50.951879    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" containerName="istio-proxy"
Jul 20 13:14:50.951985 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:50.951902    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" containerName="istio-proxy"
Jul 20 13:14:50.951985 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:50.951919    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" containerName="istio-proxy"
Jul 20 13:14:50.951985 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:50.951928    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" containerName="istio-proxy"
Jul 20 13:14:50.952136 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:50.952032    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" containerName="istio-proxy"
Jul 20 13:14:50.955360 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:50.955337    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:50.959245 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:50.959226    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f4490cdf-openshift-default-dockercfg-klp57\""
Jul 20 13:14:50.990024 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:50.990002    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"]
Jul 20 13:14:51.058077 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.058045    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-envoy\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.058293 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.058098    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-token\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.058293 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.058135    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-workload-certs\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.058293 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.058178    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istiod-ca-cert\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.058293 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.058225    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-podinfo\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.058293 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.058245    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-workload-socket\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.058641 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.058291    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-data\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.058641 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.058368    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-credential-socket\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.058641 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.058399    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-669br\" (UniqueName: \"kubernetes.io/projected/ac8e0694-af96-47a6-81f2-a6d5f92b8417-kube-api-access-669br\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.159159 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.159115    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-credential-socket\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.159159 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.159166    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-669br\" (UniqueName: \"kubernetes.io/projected/ac8e0694-af96-47a6-81f2-a6d5f92b8417-kube-api-access-669br\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.159384 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.159189    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-envoy\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.159384 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.159225    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-token\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.159384 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.159255    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-workload-certs\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.159384 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.159309    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istiod-ca-cert\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.159384 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.159338    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-podinfo\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.159384 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.159363    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-workload-socket\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.159384 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.159386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-data\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.159782 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.159676    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-credential-socket\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.160014 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.159984    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-workload-certs\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.160125 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.160068    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-workload-socket\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.160125 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.160084    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-data\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.160125 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.160092    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istiod-ca-cert\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.161811 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.161781    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-envoy\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.162069 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.162049    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-podinfo\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.188230 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.188202    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-669br\" (UniqueName: \"kubernetes.io/projected/ac8e0694-af96-47a6-81f2-a6d5f92b8417-kube-api-access-669br\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.189562 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.189539    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-token\") pod \"e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") " pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.265911 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.265829    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:51.414033 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.414004    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"]
Jul 20 13:14:51.420647 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.420376    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:14:51.420647 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.420464    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:14:51.420647 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.420509    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:14:51.728579 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.728539    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb" event={"ID":"ac8e0694-af96-47a6-81f2-a6d5f92b8417","Type":"ContainerStarted","Data":"859a2960072c6cc513e47daca3b7d22e160bdb34dd0930f2b272a2c28f3166ce"}
Jul 20 13:14:51.728792 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.728606    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb" event={"ID":"ac8e0694-af96-47a6-81f2-a6d5f92b8417","Type":"ContainerStarted","Data":"c83e755c516a7b62c749db605dbfababac3be53dfd7574a748646e3a1bcbf627"}
Jul 20 13:14:51.754727 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:51.754675    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb" podStartSLOduration=1.7546592090000002 podStartE2EDuration="1.754659209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:14:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:14:51.752784152 +0000 UTC m=+1836.885767252" watchObservedRunningTime="2026-07-20 13:14:51.754659209 +0000 UTC m=+1836.887642309"
Jul 20 13:14:52.266510 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:52.266472    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:52.271412 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:52.271385    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:52.733455 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:52.733416    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:14:52.734468 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:14:52.734444    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:15:04.793583 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:04.793549    2557 generic.go:356] "Generic (PLEG): container finished" podID="ac8e0694-af96-47a6-81f2-a6d5f92b8417" containerID="859a2960072c6cc513e47daca3b7d22e160bdb34dd0930f2b272a2c28f3166ce" exitCode=0
Jul 20 13:15:04.794038 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:04.793614    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb" event={"ID":"ac8e0694-af96-47a6-81f2-a6d5f92b8417","Type":"ContainerDied","Data":"859a2960072c6cc513e47daca3b7d22e160bdb34dd0930f2b272a2c28f3166ce"}
Jul 20 13:15:04.794038 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:04.793985    2557 scope.go:117] "RemoveContainer" containerID="859a2960072c6cc513e47daca3b7d22e160bdb34dd0930f2b272a2c28f3166ce"
Jul 20 13:15:04.794978 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:04.794947    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:15:04.795045 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:04.795032    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:15:04.795084 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:04.795069    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:15:05.799732 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:05.799695    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb" event={"ID":"ac8e0694-af96-47a6-81f2-a6d5f92b8417","Type":"ContainerStarted","Data":"e0707aba113f71cefbd0bb9f6cbc4a5fd1201b28fdeb4191752e793be85ceea7"}
Jul 20 13:15:06.266244 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:06.266205    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:15:06.267235 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:06.267205    2557 patch_prober.go:28] interesting pod/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 20 13:15:06.267384 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:06.267264    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb" podUID="ac8e0694-af96-47a6-81f2-a6d5f92b8417" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 20 13:15:07.266456 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:07.266421    2557 patch_prober.go:28] interesting pod/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 20 13:15:07.266887 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:07.266474    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb" podUID="ac8e0694-af96-47a6-81f2-a6d5f92b8417" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 20 13:15:07.733977 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:07.733934    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:15:08.266232 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:08.266194    2557 patch_prober.go:28] interesting pod/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 20 13:15:08.266419 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:08.266260    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb" podUID="ac8e0694-af96-47a6-81f2-a6d5f92b8417" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 20 13:15:09.266400 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:09.266358    2557 patch_prober.go:28] interesting pod/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 20 13:15:09.266920 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:09.266421    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb" podUID="ac8e0694-af96-47a6-81f2-a6d5f92b8417" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 20 13:15:10.270853 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:10.270820    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:15:10.271787 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:10.271765    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:15:27.133680 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:27.133638    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"]
Jul 20 13:15:27.134271 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:27.133967    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb" podUID="ac8e0694-af96-47a6-81f2-a6d5f92b8417" containerName="istio-proxy" containerID="cri-o://e0707aba113f71cefbd0bb9f6cbc4a5fd1201b28fdeb4191752e793be85ceea7" gracePeriod=30
Jul 20 13:15:32.380533 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.380508    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:15:32.453288 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.453210    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-669br\" (UniqueName: \"kubernetes.io/projected/ac8e0694-af96-47a6-81f2-a6d5f92b8417-kube-api-access-669br\") pod \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") "
Jul 20 13:15:32.453288 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.453250    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-workload-certs\") pod \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") "
Jul 20 13:15:32.453288 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.453269    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-credential-socket\") pod \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") "
Jul 20 13:15:32.453613 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.453296    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-data\") pod \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") "
Jul 20 13:15:32.453613 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.453370    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istiod-ca-cert\") pod \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") "
Jul 20 13:15:32.453613 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.453406    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-workload-socket\") pod \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") "
Jul 20 13:15:32.453613 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.453457    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-podinfo\") pod \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") "
Jul 20 13:15:32.453613 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.453497    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-envoy\") pod \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") "
Jul 20 13:15:32.453613 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.453520    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-token\") pod \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\" (UID: \"ac8e0694-af96-47a6-81f2-a6d5f92b8417\") "
Jul 20 13:15:32.453613 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.453561    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac8e0694-af96-47a6-81f2-a6d5f92b8417" (UID: "ac8e0694-af96-47a6-81f2-a6d5f92b8417"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:15:32.454035 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.453782    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac8e0694-af96-47a6-81f2-a6d5f92b8417" (UID: "ac8e0694-af96-47a6-81f2-a6d5f92b8417"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:15:32.454267 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.454242    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac8e0694-af96-47a6-81f2-a6d5f92b8417" (UID: "ac8e0694-af96-47a6-81f2-a6d5f92b8417"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:15:32.454533 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.454508    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-workload-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:15:32.454663 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.454561    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-workload-certs\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:15:32.454663 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.454578    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-credential-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:15:32.454663 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.454296    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac8e0694-af96-47a6-81f2-a6d5f92b8417" (UID: "ac8e0694-af96-47a6-81f2-a6d5f92b8417"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:15:32.454663 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.454362    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac8e0694-af96-47a6-81f2-a6d5f92b8417" (UID: "ac8e0694-af96-47a6-81f2-a6d5f92b8417"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:15:32.456000 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.455942    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac8e0694-af96-47a6-81f2-a6d5f92b8417-kube-api-access-669br" (OuterVolumeSpecName: "kube-api-access-669br") pod "ac8e0694-af96-47a6-81f2-a6d5f92b8417" (UID: "ac8e0694-af96-47a6-81f2-a6d5f92b8417"). InnerVolumeSpecName "kube-api-access-669br". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:15:32.456099 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.456082    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac8e0694-af96-47a6-81f2-a6d5f92b8417" (UID: "ac8e0694-af96-47a6-81f2-a6d5f92b8417"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:15:32.456385 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.456359    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac8e0694-af96-47a6-81f2-a6d5f92b8417" (UID: "ac8e0694-af96-47a6-81f2-a6d5f92b8417"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:15:32.456487 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.456392    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac8e0694-af96-47a6-81f2-a6d5f92b8417" (UID: "ac8e0694-af96-47a6-81f2-a6d5f92b8417"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:15:32.555801 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.555764    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-data\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:15:32.555801 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.555796    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istiod-ca-cert\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:15:32.555801 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.555805    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-podinfo\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:15:32.555801 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.555813    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-envoy\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:15:32.556072 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.555822    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac8e0694-af96-47a6-81f2-a6d5f92b8417-istio-token\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:15:32.556072 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.555830    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-669br\" (UniqueName: \"kubernetes.io/projected/ac8e0694-af96-47a6-81f2-a6d5f92b8417-kube-api-access-669br\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:15:32.928849 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.928811    2557 generic.go:356] "Generic (PLEG): container finished" podID="ac8e0694-af96-47a6-81f2-a6d5f92b8417" containerID="e0707aba113f71cefbd0bb9f6cbc4a5fd1201b28fdeb4191752e793be85ceea7" exitCode=0
Jul 20 13:15:32.928998 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.928854    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"
Jul 20 13:15:32.928998 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.928896    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb" event={"ID":"ac8e0694-af96-47a6-81f2-a6d5f92b8417","Type":"ContainerDied","Data":"e0707aba113f71cefbd0bb9f6cbc4a5fd1201b28fdeb4191752e793be85ceea7"}
Jul 20 13:15:32.928998 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.928949    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb" event={"ID":"ac8e0694-af96-47a6-81f2-a6d5f92b8417","Type":"ContainerDied","Data":"c83e755c516a7b62c749db605dbfababac3be53dfd7574a748646e3a1bcbf627"}
Jul 20 13:15:32.928998 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.928971    2557 scope.go:117] "RemoveContainer" containerID="e0707aba113f71cefbd0bb9f6cbc4a5fd1201b28fdeb4191752e793be85ceea7"
Jul 20 13:15:32.938456 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.938440    2557 scope.go:117] "RemoveContainer" containerID="859a2960072c6cc513e47daca3b7d22e160bdb34dd0930f2b272a2c28f3166ce"
Jul 20 13:15:32.945891 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.945869    2557 scope.go:117] "RemoveContainer" containerID="e0707aba113f71cefbd0bb9f6cbc4a5fd1201b28fdeb4191752e793be85ceea7"
Jul 20 13:15:32.946133 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:15:32.946112    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0707aba113f71cefbd0bb9f6cbc4a5fd1201b28fdeb4191752e793be85ceea7\": container with ID starting with e0707aba113f71cefbd0bb9f6cbc4a5fd1201b28fdeb4191752e793be85ceea7 not found: ID does not exist" containerID="e0707aba113f71cefbd0bb9f6cbc4a5fd1201b28fdeb4191752e793be85ceea7"
Jul 20 13:15:32.946194 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.946140    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0707aba113f71cefbd0bb9f6cbc4a5fd1201b28fdeb4191752e793be85ceea7"} err="failed to get container status \"e0707aba113f71cefbd0bb9f6cbc4a5fd1201b28fdeb4191752e793be85ceea7\": rpc error: code = NotFound desc = could not find container \"e0707aba113f71cefbd0bb9f6cbc4a5fd1201b28fdeb4191752e793be85ceea7\": container with ID starting with e0707aba113f71cefbd0bb9f6cbc4a5fd1201b28fdeb4191752e793be85ceea7 not found: ID does not exist"
Jul 20 13:15:32.946194 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.946156    2557 scope.go:117] "RemoveContainer" containerID="859a2960072c6cc513e47daca3b7d22e160bdb34dd0930f2b272a2c28f3166ce"
Jul 20 13:15:32.946387 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:15:32.946368    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"859a2960072c6cc513e47daca3b7d22e160bdb34dd0930f2b272a2c28f3166ce\": container with ID starting with 859a2960072c6cc513e47daca3b7d22e160bdb34dd0930f2b272a2c28f3166ce not found: ID does not exist" containerID="859a2960072c6cc513e47daca3b7d22e160bdb34dd0930f2b272a2c28f3166ce"
Jul 20 13:15:32.946445 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.946396    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"859a2960072c6cc513e47daca3b7d22e160bdb34dd0930f2b272a2c28f3166ce"} err="failed to get container status \"859a2960072c6cc513e47daca3b7d22e160bdb34dd0930f2b272a2c28f3166ce\": rpc error: code = NotFound desc = could not find container \"859a2960072c6cc513e47daca3b7d22e160bdb34dd0930f2b272a2c28f3166ce\": container with ID starting with 859a2960072c6cc513e47daca3b7d22e160bdb34dd0930f2b272a2c28f3166ce not found: ID does not exist"
Jul 20 13:15:32.950046 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.950024    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"]
Jul 20 13:15:32.954941 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:32.954919    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f4490cdf-openshift-default-54855d4967-5hscb"]
Jul 20 13:15:33.381557 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:33.381526    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac8e0694-af96-47a6-81f2-a6d5f92b8417" path="/var/lib/kubelet/pods/ac8e0694-af96-47a6-81f2-a6d5f92b8417/volumes"
Jul 20 13:15:46.751184 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.751110    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"]
Jul 20 13:15:46.751525 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.751472    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8e0694-af96-47a6-81f2-a6d5f92b8417" containerName="istio-proxy"
Jul 20 13:15:46.751525 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.751483    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8e0694-af96-47a6-81f2-a6d5f92b8417" containerName="istio-proxy"
Jul 20 13:15:46.751597 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.751552    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac8e0694-af96-47a6-81f2-a6d5f92b8417" containerName="istio-proxy"
Jul 20 13:15:46.751597 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.751560    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff5daf19-90ef-4b9d-8176-bb0d9780dabe" containerName="istio-proxy"
Jul 20 13:15:46.751597 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.751567    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac8e0694-af96-47a6-81f2-a6d5f92b8417" containerName="istio-proxy"
Jul 20 13:15:46.754439 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.754419    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.757244 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.757223    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0288096f-openshift-default-dockercfg-ng8wp\""
Jul 20 13:15:46.779991 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.779965    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"]
Jul 20 13:15:46.876866 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.876831    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9edfab99-2df2-4f5c-b22f-fbb047192456-istiod-ca-cert\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.877020 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.876882    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b8jk\" (UniqueName: \"kubernetes.io/projected/9edfab99-2df2-4f5c-b22f-fbb047192456-kube-api-access-7b8jk\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.877020 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.876946    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-data\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.877020 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.876985    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-podinfo\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.877155 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.877039    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-envoy\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.877155 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.877107    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-workload-socket\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.877239 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.877160    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-credential-socket\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.877239 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.877176    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-workload-certs\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.877239 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.877190    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-token\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.977903 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.977876    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-data\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.977903 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.977907    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-podinfo\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.978076 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.977935    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-envoy\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.978076 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.977960    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-workload-socket\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.978076 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.977986    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-credential-socket\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.978076 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.978012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-workload-certs\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.978076 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.978033    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-token\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.978335 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.978099    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9edfab99-2df2-4f5c-b22f-fbb047192456-istiod-ca-cert\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.978335 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.978150    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b8jk\" (UniqueName: \"kubernetes.io/projected/9edfab99-2df2-4f5c-b22f-fbb047192456-kube-api-access-7b8jk\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.978335 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.978283    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-data\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.978491 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.978459    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-workload-certs\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.978491 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.978474    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-credential-socket\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.978653 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.978615    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-workload-socket\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.978971 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.978954    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9edfab99-2df2-4f5c-b22f-fbb047192456-istiod-ca-cert\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.980291 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.980268    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-envoy\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.980560 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.980535    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-podinfo\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.987870 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.987847    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-token\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:46.988083 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:46.988060    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b8jk\" (UniqueName: \"kubernetes.io/projected/9edfab99-2df2-4f5c-b22f-fbb047192456-kube-api-access-7b8jk\") pod \"e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") " pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:47.065128 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:47.065095    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:47.203542 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:47.203517    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"]
Jul 20 13:15:47.205539 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:15:47.205506    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9edfab99_2df2_4f5c_b22f_fbb047192456.slice/crio-c99f978abb0d435aefd6381915c1a61b4687fc64152c4c0db51ef71f27d7bed0 WatchSource:0}: Error finding container c99f978abb0d435aefd6381915c1a61b4687fc64152c4c0db51ef71f27d7bed0: Status 404 returned error can't find the container with id c99f978abb0d435aefd6381915c1a61b4687fc64152c4c0db51ef71f27d7bed0
Jul 20 13:15:47.207600 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:47.207568    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:15:47.207727 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:47.207650    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:15:47.207727 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:47.207681    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:15:47.999928 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:47.999892    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x" event={"ID":"9edfab99-2df2-4f5c-b22f-fbb047192456","Type":"ContainerStarted","Data":"d7ae0df871bc926f9e9e8f660be6af260c5a57c295ef5cb15b6288e490c432cc"}
Jul 20 13:15:48.000310 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:47.999947    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x" event={"ID":"9edfab99-2df2-4f5c-b22f-fbb047192456","Type":"ContainerStarted","Data":"c99f978abb0d435aefd6381915c1a61b4687fc64152c4c0db51ef71f27d7bed0"}
Jul 20 13:15:48.025382 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:48.025329    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x" podStartSLOduration=2.025314437 podStartE2EDuration="2.025314437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:15:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:15:48.023972662 +0000 UTC m=+1893.156955775" watchObservedRunningTime="2026-07-20 13:15:48.025314437 +0000 UTC m=+1893.158297537"
Jul 20 13:15:48.065700 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:48.065672    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:48.070419 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:48.070346    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:49.004735 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:49.004698    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:15:49.005615 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:15:49.005594    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:16:03.074023 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:03.073979    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x" event={"ID":"9edfab99-2df2-4f5c-b22f-fbb047192456","Type":"ContainerDied","Data":"d7ae0df871bc926f9e9e8f660be6af260c5a57c295ef5cb15b6288e490c432cc"}
Jul 20 13:16:03.074517 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:03.073738    2557 generic.go:356] "Generic (PLEG): container finished" podID="9edfab99-2df2-4f5c-b22f-fbb047192456" containerID="d7ae0df871bc926f9e9e8f660be6af260c5a57c295ef5cb15b6288e490c432cc" exitCode=0
Jul 20 13:16:03.080201 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:03.074757    2557 scope.go:117] "RemoveContainer" containerID="d7ae0df871bc926f9e9e8f660be6af260c5a57c295ef5cb15b6288e490c432cc"
Jul 20 13:16:03.080201 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:03.077942    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:16:03.080201 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:03.078089    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:16:03.080201 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:03.078185    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:16:04.004702 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:04.004655    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:16:04.081060 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:04.081017    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x" event={"ID":"9edfab99-2df2-4f5c-b22f-fbb047192456","Type":"ContainerStarted","Data":"2a9c56848007eddc740e78d6d7264182d315d51ec857537294ca6631f518a726"}
Jul 20 13:16:05.065489 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:05.065454    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:16:05.066716 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:05.066686    2557 patch_prober.go:28] interesting pod/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 20 13:16:05.066866 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:05.066745    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x" podUID="9edfab99-2df2-4f5c-b22f-fbb047192456" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 20 13:16:06.066167 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:06.066134    2557 patch_prober.go:28] interesting pod/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 20 13:16:06.066584 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:06.066189    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x" podUID="9edfab99-2df2-4f5c-b22f-fbb047192456" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 20 13:16:07.065872 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:07.065826    2557 patch_prober.go:28] interesting pod/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 20 13:16:07.066086 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:07.065894    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x" podUID="9edfab99-2df2-4f5c-b22f-fbb047192456" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 20 13:16:08.070160 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:08.070121    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:16:08.070660 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:08.070468    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:16:08.071244 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:16:08.071224    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:17:48.874698 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:48.874663    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"]
Jul 20 13:17:48.875199 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:48.874921    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x" podUID="9edfab99-2df2-4f5c-b22f-fbb047192456" containerName="istio-proxy" containerID="cri-o://2a9c56848007eddc740e78d6d7264182d315d51ec857537294ca6631f518a726" gracePeriod=30
Jul 20 13:17:53.073054 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:53.073012    2557 patch_prober.go:28] interesting pod/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 13:17:53.073435 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:53.073075    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x" podUID="9edfab99-2df2-4f5c-b22f-fbb047192456" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 13:17:54.126885 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.126862    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:17:54.300191 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300105    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-envoy\") pod \"9edfab99-2df2-4f5c-b22f-fbb047192456\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") "
Jul 20 13:17:54.300191 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300138    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-workload-socket\") pod \"9edfab99-2df2-4f5c-b22f-fbb047192456\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") "
Jul 20 13:17:54.300191 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300158    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-token\") pod \"9edfab99-2df2-4f5c-b22f-fbb047192456\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") "
Jul 20 13:17:54.300191 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300177    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-workload-certs\") pod \"9edfab99-2df2-4f5c-b22f-fbb047192456\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") "
Jul 20 13:17:54.300503 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300395    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b8jk\" (UniqueName: \"kubernetes.io/projected/9edfab99-2df2-4f5c-b22f-fbb047192456-kube-api-access-7b8jk\") pod \"9edfab99-2df2-4f5c-b22f-fbb047192456\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") "
Jul 20 13:17:54.300503 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300462    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9edfab99-2df2-4f5c-b22f-fbb047192456" (UID: "9edfab99-2df2-4f5c-b22f-fbb047192456"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:17:54.300503 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300473    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9edfab99-2df2-4f5c-b22f-fbb047192456-istiod-ca-cert\") pod \"9edfab99-2df2-4f5c-b22f-fbb047192456\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") "
Jul 20 13:17:54.300503 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300502    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-data\") pod \"9edfab99-2df2-4f5c-b22f-fbb047192456\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") "
Jul 20 13:17:54.300753 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300586    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-podinfo\") pod \"9edfab99-2df2-4f5c-b22f-fbb047192456\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") "
Jul 20 13:17:54.300753 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300646    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-credential-socket\") pod \"9edfab99-2df2-4f5c-b22f-fbb047192456\" (UID: \"9edfab99-2df2-4f5c-b22f-fbb047192456\") "
Jul 20 13:17:54.300852 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300762    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9edfab99-2df2-4f5c-b22f-fbb047192456" (UID: "9edfab99-2df2-4f5c-b22f-fbb047192456"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:17:54.301018 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300964    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-workload-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:17:54.301018 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300978    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9edfab99-2df2-4f5c-b22f-fbb047192456" (UID: "9edfab99-2df2-4f5c-b22f-fbb047192456"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:17:54.301018 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300989    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-workload-certs\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:17:54.301018 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.300887    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9edfab99-2df2-4f5c-b22f-fbb047192456-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9edfab99-2df2-4f5c-b22f-fbb047192456" (UID: "9edfab99-2df2-4f5c-b22f-fbb047192456"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:17:54.301606 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.301572    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-data" (OuterVolumeSpecName: "istio-data") pod "9edfab99-2df2-4f5c-b22f-fbb047192456" (UID: "9edfab99-2df2-4f5c-b22f-fbb047192456"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:17:54.302749 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.302722    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-token" (OuterVolumeSpecName: "istio-token") pod "9edfab99-2df2-4f5c-b22f-fbb047192456" (UID: "9edfab99-2df2-4f5c-b22f-fbb047192456"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:17:54.302861 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.302770    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9edfab99-2df2-4f5c-b22f-fbb047192456-kube-api-access-7b8jk" (OuterVolumeSpecName: "kube-api-access-7b8jk") pod "9edfab99-2df2-4f5c-b22f-fbb047192456" (UID: "9edfab99-2df2-4f5c-b22f-fbb047192456"). InnerVolumeSpecName "kube-api-access-7b8jk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:17:54.303026 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.302996    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9edfab99-2df2-4f5c-b22f-fbb047192456" (UID: "9edfab99-2df2-4f5c-b22f-fbb047192456"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:17:54.303164 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.303144    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9edfab99-2df2-4f5c-b22f-fbb047192456" (UID: "9edfab99-2df2-4f5c-b22f-fbb047192456"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:17:54.401786 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.401749    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-podinfo\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:17:54.401786 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.401780    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-credential-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:17:54.401786 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.401790    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-envoy\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:17:54.402009 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.401798    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-token\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:17:54.402009 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.401807    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b8jk\" (UniqueName: \"kubernetes.io/projected/9edfab99-2df2-4f5c-b22f-fbb047192456-kube-api-access-7b8jk\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:17:54.402009 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.401815    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9edfab99-2df2-4f5c-b22f-fbb047192456-istiod-ca-cert\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:17:54.402009 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.401822    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9edfab99-2df2-4f5c-b22f-fbb047192456-istio-data\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:17:54.606465 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.606432    2557 generic.go:356] "Generic (PLEG): container finished" podID="9edfab99-2df2-4f5c-b22f-fbb047192456" containerID="2a9c56848007eddc740e78d6d7264182d315d51ec857537294ca6631f518a726" exitCode=0
Jul 20 13:17:54.606672 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.606477    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"
Jul 20 13:17:54.606672 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.606530    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x" event={"ID":"9edfab99-2df2-4f5c-b22f-fbb047192456","Type":"ContainerDied","Data":"2a9c56848007eddc740e78d6d7264182d315d51ec857537294ca6631f518a726"}
Jul 20 13:17:54.606672 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.606585    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x" event={"ID":"9edfab99-2df2-4f5c-b22f-fbb047192456","Type":"ContainerDied","Data":"c99f978abb0d435aefd6381915c1a61b4687fc64152c4c0db51ef71f27d7bed0"}
Jul 20 13:17:54.606672 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.606610    2557 scope.go:117] "RemoveContainer" containerID="2a9c56848007eddc740e78d6d7264182d315d51ec857537294ca6631f518a726"
Jul 20 13:17:54.616150 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.616129    2557 scope.go:117] "RemoveContainer" containerID="d7ae0df871bc926f9e9e8f660be6af260c5a57c295ef5cb15b6288e490c432cc"
Jul 20 13:17:54.623672 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.623652    2557 scope.go:117] "RemoveContainer" containerID="2a9c56848007eddc740e78d6d7264182d315d51ec857537294ca6631f518a726"
Jul 20 13:17:54.623930 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:17:54.623912    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a9c56848007eddc740e78d6d7264182d315d51ec857537294ca6631f518a726\": container with ID starting with 2a9c56848007eddc740e78d6d7264182d315d51ec857537294ca6631f518a726 not found: ID does not exist" containerID="2a9c56848007eddc740e78d6d7264182d315d51ec857537294ca6631f518a726"
Jul 20 13:17:54.623994 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.623939    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a9c56848007eddc740e78d6d7264182d315d51ec857537294ca6631f518a726"} err="failed to get container status \"2a9c56848007eddc740e78d6d7264182d315d51ec857537294ca6631f518a726\": rpc error: code = NotFound desc = could not find container \"2a9c56848007eddc740e78d6d7264182d315d51ec857537294ca6631f518a726\": container with ID starting with 2a9c56848007eddc740e78d6d7264182d315d51ec857537294ca6631f518a726 not found: ID does not exist"
Jul 20 13:17:54.623994 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.623956    2557 scope.go:117] "RemoveContainer" containerID="d7ae0df871bc926f9e9e8f660be6af260c5a57c295ef5cb15b6288e490c432cc"
Jul 20 13:17:54.624196 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:17:54.624176    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7ae0df871bc926f9e9e8f660be6af260c5a57c295ef5cb15b6288e490c432cc\": container with ID starting with d7ae0df871bc926f9e9e8f660be6af260c5a57c295ef5cb15b6288e490c432cc not found: ID does not exist" containerID="d7ae0df871bc926f9e9e8f660be6af260c5a57c295ef5cb15b6288e490c432cc"
Jul 20 13:17:54.624244 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.624204    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7ae0df871bc926f9e9e8f660be6af260c5a57c295ef5cb15b6288e490c432cc"} err="failed to get container status \"d7ae0df871bc926f9e9e8f660be6af260c5a57c295ef5cb15b6288e490c432cc\": rpc error: code = NotFound desc = could not find container \"d7ae0df871bc926f9e9e8f660be6af260c5a57c295ef5cb15b6288e490c432cc\": container with ID starting with d7ae0df871bc926f9e9e8f660be6af260c5a57c295ef5cb15b6288e490c432cc not found: ID does not exist"
Jul 20 13:17:54.673513 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.673487    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"]
Jul 20 13:17:54.694766 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:54.694742    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0288096f-openshift-default-54755bbcb7-hcz4x"]
Jul 20 13:17:55.381253 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:17:55.381220    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9edfab99-2df2-4f5c-b22f-fbb047192456" path="/var/lib/kubelet/pods/9edfab99-2df2-4f5c-b22f-fbb047192456/volumes"
Jul 20 13:18:15.557268 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:15.557235    2557 scope.go:117] "RemoveContainer" containerID="90fa1ce5e2219dd7f33590a68320e0eb7723d476074e468454a4a4959abe5b05"
Jul 20 13:18:51.188848 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.188768    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"]
Jul 20 13:18:51.189300 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.189182    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac8e0694-af96-47a6-81f2-a6d5f92b8417" containerName="istio-proxy"
Jul 20 13:18:51.189300 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.189194    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac8e0694-af96-47a6-81f2-a6d5f92b8417" containerName="istio-proxy"
Jul 20 13:18:51.189300 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.189210    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9edfab99-2df2-4f5c-b22f-fbb047192456" containerName="istio-proxy"
Jul 20 13:18:51.189300 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.189216    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9edfab99-2df2-4f5c-b22f-fbb047192456" containerName="istio-proxy"
Jul 20 13:18:51.189300 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.189234    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9edfab99-2df2-4f5c-b22f-fbb047192456" containerName="istio-proxy"
Jul 20 13:18:51.189300 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.189242    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9edfab99-2df2-4f5c-b22f-fbb047192456" containerName="istio-proxy"
Jul 20 13:18:51.189518 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.189305    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9edfab99-2df2-4f5c-b22f-fbb047192456" containerName="istio-proxy"
Jul 20 13:18:51.189518 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.189317    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9edfab99-2df2-4f5c-b22f-fbb047192456" containerName="istio-proxy"
Jul 20 13:18:51.192353 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.192335    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.197983 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.197959    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-98c8e4-openshift-default-dockercfg-m446b\""
Jul 20 13:18:51.219191 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.219160    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"]
Jul 20 13:18:51.292873 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.292840    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-envoy\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.292873 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.292877    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-token\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.293139 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.292910    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-podinfo\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.293139 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.292989    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-credential-socket\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.293139 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.293022    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-workload-certs\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.293139 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.293053    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp2fw\" (UniqueName: \"kubernetes.io/projected/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-kube-api-access-xp2fw\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.293139 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.293136    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-data\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.293374 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.293179    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istiod-ca-cert\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.293374 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.293243    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-workload-socket\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.394470 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.394435    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-data\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.394705 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.394477    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istiod-ca-cert\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.394705 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.394537    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-workload-socket\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.394705 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.394560    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-envoy\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.394705 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.394584    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-token\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.394960 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.394797    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-podinfo\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.394960 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.394880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-credential-socket\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.394960 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.394909    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-workload-certs\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.394960 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.394927    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-data\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.394960 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.394945    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp2fw\" (UniqueName: \"kubernetes.io/projected/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-kube-api-access-xp2fw\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.395231 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.395040    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-workload-socket\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.395231 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.395185    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-credential-socket\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.395231 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.395206    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-workload-certs\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.395391 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.395349    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istiod-ca-cert\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.396824 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.396799    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-envoy\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.397121 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.397102    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-podinfo\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.403250 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.403228    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-token\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.405051 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.405029    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp2fw\" (UniqueName: \"kubernetes.io/projected/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-kube-api-access-xp2fw\") pod \"e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") " pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.503096 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.503003    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:51.660546 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.660513    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"]
Jul 20 13:18:51.664788 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:18:51.664759    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5b0468_9709_4bbe_b2d8_2b1f0745286d.slice/crio-9f991490c7904923fe6eb57488ed39215d62b5e50dc64229df5c8bb04c270c83 WatchSource:0}: Error finding container 9f991490c7904923fe6eb57488ed39215d62b5e50dc64229df5c8bb04c270c83: Status 404 returned error can't find the container with id 9f991490c7904923fe6eb57488ed39215d62b5e50dc64229df5c8bb04c270c83
Jul 20 13:18:51.666853 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.666822    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:18:51.666969 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.666889    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:18:51.666969 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.666917    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:18:51.865566 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.865530    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k" event={"ID":"ae5b0468-9709-4bbe-b2d8-2b1f0745286d","Type":"ContainerStarted","Data":"41f6a9a3e82ac6e19ccd21edb07b456572a92cd48d711161755007211a3609d3"}
Jul 20 13:18:51.865784 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.865597    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k" event={"ID":"ae5b0468-9709-4bbe-b2d8-2b1f0745286d","Type":"ContainerStarted","Data":"9f991490c7904923fe6eb57488ed39215d62b5e50dc64229df5c8bb04c270c83"}
Jul 20 13:18:51.900030 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:51.899974    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k" podStartSLOduration=0.899952713 podStartE2EDuration="899.952713ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:18:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:18:51.898286498 +0000 UTC m=+2077.031269612" watchObservedRunningTime="2026-07-20 13:18:51.899952713 +0000 UTC m=+2077.032935814"
Jul 20 13:18:52.503814 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:52.503779    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:52.508926 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:52.508903    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:52.870847 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:52.870813    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:18:52.871688 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:18:52.871667    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:19:08.001308 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:08.001282    2557 patch_prober.go:28] interesting pod/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:60114->10.132.0.47:15021: read: connection reset by peer" start-of-body=
Jul 20 13:19:08.001763 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:08.001357    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k" podUID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:60114->10.132.0.47:15021: read: connection reset by peer"
Jul 20 13:19:08.961475 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:08.961438    2557 generic.go:356] "Generic (PLEG): container finished" podID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" containerID="41f6a9a3e82ac6e19ccd21edb07b456572a92cd48d711161755007211a3609d3" exitCode=0
Jul 20 13:19:08.961696 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:08.961485    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k" event={"ID":"ae5b0468-9709-4bbe-b2d8-2b1f0745286d","Type":"ContainerDied","Data":"41f6a9a3e82ac6e19ccd21edb07b456572a92cd48d711161755007211a3609d3"}
Jul 20 13:19:08.962042 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:08.962017    2557 scope.go:117] "RemoveContainer" containerID="41f6a9a3e82ac6e19ccd21edb07b456572a92cd48d711161755007211a3609d3"
Jul 20 13:19:08.963124 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:08.963094    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:19:08.963221 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:08.963180    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:19:08.963283 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:08.963231    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:19:09.968808 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:09.968776    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k" event={"ID":"ae5b0468-9709-4bbe-b2d8-2b1f0745286d","Type":"ContainerStarted","Data":"eec3968235a33ad4b19de00c6901606b87aeac101a86b351fb87c16b0a4ff8cf"}
Jul 20 13:19:10.503500 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:10.503458    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:19:10.503714 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:10.503696    2557 patch_prober.go:28] interesting pod/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 20 13:19:10.503779 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:10.503744    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k" podUID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 20 13:19:11.504090 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:11.504043    2557 patch_prober.go:28] interesting pod/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 20 13:19:11.504527 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:11.504112    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k" podUID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 20 13:19:12.503481 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:12.503448    2557 patch_prober.go:28] interesting pod/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 20 13:19:12.503675 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:12.503500    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k" podUID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 20 13:19:13.503740 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:13.503701    2557 patch_prober.go:28] interesting pod/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 20 13:19:13.504223 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:13.503760    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k" podUID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 20 13:19:14.507857 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:14.507824    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:19:14.508266 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:14.508080    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:19:14.508739 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:19:14.508719    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:20:43.181557 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:43.181520    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl"]
Jul 20 13:20:43.185053 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:43.185036    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl"
Jul 20 13:20:43.187462 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:43.187438    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4s4l\""
Jul 20 13:20:43.196849 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:43.196826    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl"]
Jul 20 13:20:43.301589 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:43.301557    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c49c675f-b8c9-4c54-852d-67e5c6be932f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl\" (UID: \"c49c675f-b8c9-4c54-852d-67e5c6be932f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl"
Jul 20 13:20:43.402247 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:43.402212    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c49c675f-b8c9-4c54-852d-67e5c6be932f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl\" (UID: \"c49c675f-b8c9-4c54-852d-67e5c6be932f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl"
Jul 20 13:20:43.403090 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:43.403064    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c49c675f-b8c9-4c54-852d-67e5c6be932f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl\" (UID: \"c49c675f-b8c9-4c54-852d-67e5c6be932f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl"
Jul 20 13:20:43.495906 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:43.495798    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl"
Jul 20 13:20:43.835516 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:43.835489    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl"]
Jul 20 13:20:43.838359 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:20:43.838333    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc49c675f_b8c9_4c54_852d_67e5c6be932f.slice/crio-d5e54502f83ce48395d3268c6f8319d5a085ec144a1593568069ccbe29ce12b5 WatchSource:0}: Error finding container d5e54502f83ce48395d3268c6f8319d5a085ec144a1593568069ccbe29ce12b5: Status 404 returned error can't find the container with id d5e54502f83ce48395d3268c6f8319d5a085ec144a1593568069ccbe29ce12b5
Jul 20 13:20:44.413549 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:44.413447    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl" event={"ID":"c49c675f-b8c9-4c54-852d-67e5c6be932f","Type":"ContainerStarted","Data":"a3165238276ee095dbdb637bb8fd7304b143644b6085c450e1af5289d6f6ce8f"}
Jul 20 13:20:44.413549 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:44.413512    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl" event={"ID":"c49c675f-b8c9-4c54-852d-67e5c6be932f","Type":"ContainerStarted","Data":"d5e54502f83ce48395d3268c6f8319d5a085ec144a1593568069ccbe29ce12b5"}
Jul 20 13:20:44.433774 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:44.433723    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl" podStartSLOduration=1.433707592 podStartE2EDuration="1.433707592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:20:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:20:44.43241858 +0000 UTC m=+2189.565401692" watchObservedRunningTime="2026-07-20 13:20:44.433707592 +0000 UTC m=+2189.566690692"
Jul 20 13:20:45.419393 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:45.419358    2557 generic.go:356] "Generic (PLEG): container finished" podID="c49c675f-b8c9-4c54-852d-67e5c6be932f" containerID="a3165238276ee095dbdb637bb8fd7304b143644b6085c450e1af5289d6f6ce8f" exitCode=0
Jul 20 13:20:45.419807 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:45.419441    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl" event={"ID":"c49c675f-b8c9-4c54-852d-67e5c6be932f","Type":"ContainerDied","Data":"a3165238276ee095dbdb637bb8fd7304b143644b6085c450e1af5289d6f6ce8f"}
Jul 20 13:20:46.556417 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:46.556396    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl"
Jul 20 13:20:46.630701 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:46.630669    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c49c675f-b8c9-4c54-852d-67e5c6be932f-maas-api-service-ca\") pod \"c49c675f-b8c9-4c54-852d-67e5c6be932f\" (UID: \"c49c675f-b8c9-4c54-852d-67e5c6be932f\") "
Jul 20 13:20:46.631042 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:46.631021    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c49c675f-b8c9-4c54-852d-67e5c6be932f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c49c675f-b8c9-4c54-852d-67e5c6be932f" (UID: "c49c675f-b8c9-4c54-852d-67e5c6be932f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:20:46.732031 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:46.731958    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c49c675f-b8c9-4c54-852d-67e5c6be932f-maas-api-service-ca\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:20:47.430694 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:47.430662    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl"
Jul 20 13:20:47.430694 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:47.430680    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl" event={"ID":"c49c675f-b8c9-4c54-852d-67e5c6be932f","Type":"ContainerDied","Data":"d5e54502f83ce48395d3268c6f8319d5a085ec144a1593568069ccbe29ce12b5"}
Jul 20 13:20:47.430888 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:47.430726    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5e54502f83ce48395d3268c6f8319d5a085ec144a1593568069ccbe29ce12b5"
Jul 20 13:20:58.290536 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:58.290486    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl"]
Jul 20 13:20:58.292600 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:58.292571    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-98c8e4-xp9vl"]
Jul 20 13:20:59.380636 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:20:59.380599    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c49c675f-b8c9-4c54-852d-67e5c6be932f" path="/var/lib/kubelet/pods/c49c675f-b8c9-4c54-852d-67e5c6be932f/volumes"
Jul 20 13:21:05.087689 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:05.087652    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"]
Jul 20 13:21:05.088228 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:05.087940    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k" podUID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" containerName="istio-proxy" containerID="cri-o://eec3968235a33ad4b19de00c6901606b87aeac101a86b351fb87c16b0a4ff8cf" gracePeriod=30
Jul 20 13:21:05.430991 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:05.430911    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq"]
Jul 20 13:21:05.431331 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:05.431318    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c49c675f-b8c9-4c54-852d-67e5c6be932f" containerName="revoke-keys"
Jul 20 13:21:05.431377 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:05.431333    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c49c675f-b8c9-4c54-852d-67e5c6be932f" containerName="revoke-keys"
Jul 20 13:21:05.431419 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:05.431393    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c49c675f-b8c9-4c54-852d-67e5c6be932f" containerName="revoke-keys"
Jul 20 13:21:05.434692 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:05.434674    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq"
Jul 20 13:21:05.436981 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:05.436961    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4s4l\""
Jul 20 13:21:05.442421 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:05.442394    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq"]
Jul 20 13:21:05.483930 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:05.483893    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4f9b05-a35f-4c1b-9622-955519231376-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq\" (UID: \"4d4f9b05-a35f-4c1b-9622-955519231376\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq"
Jul 20 13:21:05.584991 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:05.584956    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4f9b05-a35f-4c1b-9622-955519231376-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq\" (UID: \"4d4f9b05-a35f-4c1b-9622-955519231376\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq"
Jul 20 13:21:05.585548 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:05.585526    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4f9b05-a35f-4c1b-9622-955519231376-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq\" (UID: \"4d4f9b05-a35f-4c1b-9622-955519231376\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq"
Jul 20 13:21:05.748222 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:05.748137    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq"
Jul 20 13:21:05.884579 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:05.884550    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq"]
Jul 20 13:21:05.886441 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:21:05.886409    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4f9b05_a35f_4c1b_9622_955519231376.slice/crio-c9d3b2fcfe9c2ebda1b97eb943d3d603277c67f6e1c8064b494e53f32cd5e59d WatchSource:0}: Error finding container c9d3b2fcfe9c2ebda1b97eb943d3d603277c67f6e1c8064b494e53f32cd5e59d: Status 404 returned error can't find the container with id c9d3b2fcfe9c2ebda1b97eb943d3d603277c67f6e1c8064b494e53f32cd5e59d
Jul 20 13:21:06.522749 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:06.522653    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq" event={"ID":"4d4f9b05-a35f-4c1b-9622-955519231376","Type":"ContainerStarted","Data":"5b3c36347ffbc8d3a253a60d0ca9b517ebdb7aea7fc9303cd1ff21f1e6dcc11e"}
Jul 20 13:21:06.522749 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:06.522721    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq" event={"ID":"4d4f9b05-a35f-4c1b-9622-955519231376","Type":"ContainerStarted","Data":"c9d3b2fcfe9c2ebda1b97eb943d3d603277c67f6e1c8064b494e53f32cd5e59d"}
Jul 20 13:21:06.540670 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:06.540600    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq" podStartSLOduration=1.5405813940000002 podStartE2EDuration="1.540581394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:21:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:21:06.538310283 +0000 UTC m=+2211.671293384" watchObservedRunningTime="2026-07-20 13:21:06.540581394 +0000 UTC m=+2211.673564494"
Jul 20 13:21:07.529264 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:07.529228    2557 generic.go:356] "Generic (PLEG): container finished" podID="4d4f9b05-a35f-4c1b-9622-955519231376" containerID="5b3c36347ffbc8d3a253a60d0ca9b517ebdb7aea7fc9303cd1ff21f1e6dcc11e" exitCode=0
Jul 20 13:21:07.529264 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:07.529268    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq" event={"ID":"4d4f9b05-a35f-4c1b-9622-955519231376","Type":"ContainerDied","Data":"5b3c36347ffbc8d3a253a60d0ca9b517ebdb7aea7fc9303cd1ff21f1e6dcc11e"}
Jul 20 13:21:08.666461 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:08.666436    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq"
Jul 20 13:21:08.712707 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:08.712682    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4f9b05-a35f-4c1b-9622-955519231376-maas-api-service-ca\") pod \"4d4f9b05-a35f-4c1b-9622-955519231376\" (UID: \"4d4f9b05-a35f-4c1b-9622-955519231376\") "
Jul 20 13:21:08.713045 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:08.713024    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d4f9b05-a35f-4c1b-9622-955519231376-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4d4f9b05-a35f-4c1b-9622-955519231376" (UID: "4d4f9b05-a35f-4c1b-9622-955519231376"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:21:08.813553 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:08.813526    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d4f9b05-a35f-4c1b-9622-955519231376-maas-api-service-ca\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:21:09.539524 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:09.539493    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq"
Jul 20 13:21:09.539709 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:09.539522    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq" event={"ID":"4d4f9b05-a35f-4c1b-9622-955519231376","Type":"ContainerDied","Data":"c9d3b2fcfe9c2ebda1b97eb943d3d603277c67f6e1c8064b494e53f32cd5e59d"}
Jul 20 13:21:09.539709 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:09.539564    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9d3b2fcfe9c2ebda1b97eb943d3d603277c67f6e1c8064b494e53f32cd5e59d"
Jul 20 13:21:10.346411 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.346388    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:21:10.429314 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.429257    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-data\") pod \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") "
Jul 20 13:21:10.429441 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.429319    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-token\") pod \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") "
Jul 20 13:21:10.429441 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.429337    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-workload-certs\") pod \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") "
Jul 20 13:21:10.429441 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.429367    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-envoy\") pod \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") "
Jul 20 13:21:10.429441 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.429385    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp2fw\" (UniqueName: \"kubernetes.io/projected/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-kube-api-access-xp2fw\") pod \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") "
Jul 20 13:21:10.429441 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.429408    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-credential-socket\") pod \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") "
Jul 20 13:21:10.429441 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.429430    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-workload-socket\") pod \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") "
Jul 20 13:21:10.429780 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.429473    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-podinfo\") pod \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") "
Jul 20 13:21:10.429780 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.429497    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istiod-ca-cert\") pod \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\" (UID: \"ae5b0468-9709-4bbe-b2d8-2b1f0745286d\") "
Jul 20 13:21:10.429780 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.429694    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae5b0468-9709-4bbe-b2d8-2b1f0745286d" (UID: "ae5b0468-9709-4bbe-b2d8-2b1f0745286d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:21:10.429946 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.429804    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae5b0468-9709-4bbe-b2d8-2b1f0745286d" (UID: "ae5b0468-9709-4bbe-b2d8-2b1f0745286d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:21:10.429946 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.429852    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae5b0468-9709-4bbe-b2d8-2b1f0745286d" (UID: "ae5b0468-9709-4bbe-b2d8-2b1f0745286d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:21:10.430179 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.430121    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae5b0468-9709-4bbe-b2d8-2b1f0745286d" (UID: "ae5b0468-9709-4bbe-b2d8-2b1f0745286d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:21:10.430312 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.430180    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae5b0468-9709-4bbe-b2d8-2b1f0745286d" (UID: "ae5b0468-9709-4bbe-b2d8-2b1f0745286d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:21:10.430312 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.430243    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-workload-certs\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:21:10.430312 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.430262    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-credential-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:21:10.430312 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.430277    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-workload-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:21:10.430312 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.430291    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istiod-ca-cert\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:21:10.430312 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.430304    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-data\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:21:10.431714 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.431689    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae5b0468-9709-4bbe-b2d8-2b1f0745286d" (UID: "ae5b0468-9709-4bbe-b2d8-2b1f0745286d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:21:10.431828 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.431740    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae5b0468-9709-4bbe-b2d8-2b1f0745286d" (UID: "ae5b0468-9709-4bbe-b2d8-2b1f0745286d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:21:10.431828 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.431778    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae5b0468-9709-4bbe-b2d8-2b1f0745286d" (UID: "ae5b0468-9709-4bbe-b2d8-2b1f0745286d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:21:10.432024 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.432002    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-kube-api-access-xp2fw" (OuterVolumeSpecName: "kube-api-access-xp2fw") pod "ae5b0468-9709-4bbe-b2d8-2b1f0745286d" (UID: "ae5b0468-9709-4bbe-b2d8-2b1f0745286d"). InnerVolumeSpecName "kube-api-access-xp2fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:21:10.531472 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.531449    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-podinfo\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:21:10.531472 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.531471    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-token\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:21:10.531601 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.531480    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-istio-envoy\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:21:10.531601 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.531487    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp2fw\" (UniqueName: \"kubernetes.io/projected/ae5b0468-9709-4bbe-b2d8-2b1f0745286d-kube-api-access-xp2fw\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:21:10.545136 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.545110    2557 generic.go:356] "Generic (PLEG): container finished" podID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" containerID="eec3968235a33ad4b19de00c6901606b87aeac101a86b351fb87c16b0a4ff8cf" exitCode=0
Jul 20 13:21:10.545228 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.545155    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"
Jul 20 13:21:10.545228 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.545158    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k" event={"ID":"ae5b0468-9709-4bbe-b2d8-2b1f0745286d","Type":"ContainerDied","Data":"eec3968235a33ad4b19de00c6901606b87aeac101a86b351fb87c16b0a4ff8cf"}
Jul 20 13:21:10.545300 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.545258    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k" event={"ID":"ae5b0468-9709-4bbe-b2d8-2b1f0745286d","Type":"ContainerDied","Data":"9f991490c7904923fe6eb57488ed39215d62b5e50dc64229df5c8bb04c270c83"}
Jul 20 13:21:10.545300 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.545279    2557 scope.go:117] "RemoveContainer" containerID="eec3968235a33ad4b19de00c6901606b87aeac101a86b351fb87c16b0a4ff8cf"
Jul 20 13:21:10.553957 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.553941    2557 scope.go:117] "RemoveContainer" containerID="41f6a9a3e82ac6e19ccd21edb07b456572a92cd48d711161755007211a3609d3"
Jul 20 13:21:10.561773 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.561758    2557 scope.go:117] "RemoveContainer" containerID="eec3968235a33ad4b19de00c6901606b87aeac101a86b351fb87c16b0a4ff8cf"
Jul 20 13:21:10.562004 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:21:10.561984    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eec3968235a33ad4b19de00c6901606b87aeac101a86b351fb87c16b0a4ff8cf\": container with ID starting with eec3968235a33ad4b19de00c6901606b87aeac101a86b351fb87c16b0a4ff8cf not found: ID does not exist" containerID="eec3968235a33ad4b19de00c6901606b87aeac101a86b351fb87c16b0a4ff8cf"
Jul 20 13:21:10.562046 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.562013    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eec3968235a33ad4b19de00c6901606b87aeac101a86b351fb87c16b0a4ff8cf"} err="failed to get container status \"eec3968235a33ad4b19de00c6901606b87aeac101a86b351fb87c16b0a4ff8cf\": rpc error: code = NotFound desc = could not find container \"eec3968235a33ad4b19de00c6901606b87aeac101a86b351fb87c16b0a4ff8cf\": container with ID starting with eec3968235a33ad4b19de00c6901606b87aeac101a86b351fb87c16b0a4ff8cf not found: ID does not exist"
Jul 20 13:21:10.562046 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.562029    2557 scope.go:117] "RemoveContainer" containerID="41f6a9a3e82ac6e19ccd21edb07b456572a92cd48d711161755007211a3609d3"
Jul 20 13:21:10.562261 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:21:10.562244    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41f6a9a3e82ac6e19ccd21edb07b456572a92cd48d711161755007211a3609d3\": container with ID starting with 41f6a9a3e82ac6e19ccd21edb07b456572a92cd48d711161755007211a3609d3 not found: ID does not exist" containerID="41f6a9a3e82ac6e19ccd21edb07b456572a92cd48d711161755007211a3609d3"
Jul 20 13:21:10.562305 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.562269    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f6a9a3e82ac6e19ccd21edb07b456572a92cd48d711161755007211a3609d3"} err="failed to get container status \"41f6a9a3e82ac6e19ccd21edb07b456572a92cd48d711161755007211a3609d3\": rpc error: code = NotFound desc = could not find container \"41f6a9a3e82ac6e19ccd21edb07b456572a92cd48d711161755007211a3609d3\": container with ID starting with 41f6a9a3e82ac6e19ccd21edb07b456572a92cd48d711161755007211a3609d3 not found: ID does not exist"
Jul 20 13:21:10.568512 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.568483    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"]
Jul 20 13:21:10.575749 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:10.575731    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-98c8e4-openshift-default-5bb7476db7-8w52k"]
Jul 20 13:21:11.380757 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:11.380724    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" path="/var/lib/kubelet/pods/ae5b0468-9709-4bbe-b2d8-2b1f0745286d/volumes"
Jul 20 13:21:20.576644 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:20.576587    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq"]
Jul 20 13:21:20.589900 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:20.589872    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1feb1a-p9kqq"]
Jul 20 13:21:21.380858 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:21.380815    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d4f9b05-a35f-4c1b-9622-955519231376" path="/var/lib/kubelet/pods/4d4f9b05-a35f-4c1b-9622-955519231376/volumes"
Jul 20 13:21:28.567350 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.567317    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"]
Jul 20 13:21:28.567746 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.567707    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d4f9b05-a35f-4c1b-9622-955519231376" containerName="revoke-keys"
Jul 20 13:21:28.567746 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.567721    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d4f9b05-a35f-4c1b-9622-955519231376" containerName="revoke-keys"
Jul 20 13:21:28.567746 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.567740    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" containerName="istio-proxy"
Jul 20 13:21:28.567746 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.567745    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" containerName="istio-proxy"
Jul 20 13:21:28.567875 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.567808    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d4f9b05-a35f-4c1b-9622-955519231376" containerName="revoke-keys"
Jul 20 13:21:28.567875 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.567816    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" containerName="istio-proxy"
Jul 20 13:21:28.567875 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.567822    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" containerName="istio-proxy"
Jul 20 13:21:28.571092 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.571064    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.577104 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.577078    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-f9fd1f-openshift-default-dockercfg-vwrrh\""
Jul 20 13:21:28.588440 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.588406    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"]
Jul 20 13:21:28.684965 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.684927    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-token\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.684965 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.684971    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-workload-socket\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.685165 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.684988    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-credential-socket\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.685165 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.685029    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-data\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.685165 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.685051    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-envoy\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.685165 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.685071    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d47fbb3e-c3a6-4124-a021-0793c8c23466-istiod-ca-cert\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.685165 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.685131    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-podinfo\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.685324 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.685199    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-workload-certs\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.685324 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.685230    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk6mv\" (UniqueName: \"kubernetes.io/projected/d47fbb3e-c3a6-4124-a021-0793c8c23466-kube-api-access-kk6mv\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.785721 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.785692    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-data\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.785892 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.785728    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-envoy\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.785892 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.785760    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d47fbb3e-c3a6-4124-a021-0793c8c23466-istiod-ca-cert\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.785892 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.785797    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-podinfo\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.785892 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.785855    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-workload-certs\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.785892 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.785888    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk6mv\" (UniqueName: \"kubernetes.io/projected/d47fbb3e-c3a6-4124-a021-0793c8c23466-kube-api-access-kk6mv\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.786156 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.785962    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-token\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.786156 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.785995    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-workload-socket\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.786156 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.786113    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-data\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.786310 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.786232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-workload-certs\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.786310 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.786284    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-credential-socket\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.786576 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.786553    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d47fbb3e-c3a6-4124-a021-0793c8c23466-istiod-ca-cert\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.786708 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.786595    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-credential-socket\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.786708 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.786674    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-workload-socket\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.788070 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.788049    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-envoy\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.788457 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.788434    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-podinfo\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.796325 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.796302    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-token\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.796752 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.796732    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk6mv\" (UniqueName: \"kubernetes.io/projected/d47fbb3e-c3a6-4124-a021-0793c8c23466-kube-api-access-kk6mv\") pod \"e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") " pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:28.881606 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:28.881547    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:29.023157 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:29.023127    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"]
Jul 20 13:21:29.024747 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:21:29.024713    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47fbb3e_c3a6_4124_a021_0793c8c23466.slice/crio-32f396593dcef137ae7c9a0243737fbcf893662bdd1fed410dcc7a8becd4870d WatchSource:0}: Error finding container 32f396593dcef137ae7c9a0243737fbcf893662bdd1fed410dcc7a8becd4870d: Status 404 returned error can't find the container with id 32f396593dcef137ae7c9a0243737fbcf893662bdd1fed410dcc7a8becd4870d
Jul 20 13:21:29.026775 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:29.026745    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:21:29.026853 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:29.026807    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:21:29.026853 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:29.026837    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:21:29.637155 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:29.637117    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt" event={"ID":"d47fbb3e-c3a6-4124-a021-0793c8c23466","Type":"ContainerStarted","Data":"7509191fb4a6c1992a5c2f688a1a049c2fc46e83ed507ebea686168885b1e7fc"}
Jul 20 13:21:29.637555 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:29.637175    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt" event={"ID":"d47fbb3e-c3a6-4124-a021-0793c8c23466","Type":"ContainerStarted","Data":"32f396593dcef137ae7c9a0243737fbcf893662bdd1fed410dcc7a8becd4870d"}
Jul 20 13:21:29.662586 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:29.662534    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt" podStartSLOduration=1.662518664 podStartE2EDuration="1.662518664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:21:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:21:29.660172532 +0000 UTC m=+2234.793155648" watchObservedRunningTime="2026-07-20 13:21:29.662518664 +0000 UTC m=+2234.795501741"
Jul 20 13:21:29.882241 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:29.882199    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:30.886631 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:30.886597    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:31.648010 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:31.647978    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:31.648927 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:31.648902    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:46.748596 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:46.748242    2557 patch_prober.go:28] interesting pod/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": read tcp 10.132.0.2:53804->10.132.0.50:15021: read: connection reset by peer" start-of-body=
Jul 20 13:21:46.748596 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:46.748322    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt" podUID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": read tcp 10.132.0.2:53804->10.132.0.50:15021: read: connection reset by peer"
Jul 20 13:21:47.723318 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:47.723286    2557 generic.go:356] "Generic (PLEG): container finished" podID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerID="7509191fb4a6c1992a5c2f688a1a049c2fc46e83ed507ebea686168885b1e7fc" exitCode=0
Jul 20 13:21:47.723482 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:47.723344    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt" event={"ID":"d47fbb3e-c3a6-4124-a021-0793c8c23466","Type":"ContainerDied","Data":"7509191fb4a6c1992a5c2f688a1a049c2fc46e83ed507ebea686168885b1e7fc"}
Jul 20 13:21:47.723763 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:47.723746    2557 scope.go:117] "RemoveContainer" containerID="7509191fb4a6c1992a5c2f688a1a049c2fc46e83ed507ebea686168885b1e7fc"
Jul 20 13:21:47.724709 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:47.724681    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:21:47.724784 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:47.724759    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:21:47.724821 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:47.724790    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:21:48.734713 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:48.734672    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt" event={"ID":"d47fbb3e-c3a6-4124-a021-0793c8c23466","Type":"ContainerStarted","Data":"403d37cc7f0988e3e7ee1c23b664077dd3ee6f4d1a9c02fc60c466bcc0b1f336"}
Jul 20 13:21:48.882698 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:48.882663    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:48.882857 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:48.882818    2557 patch_prober.go:28] interesting pod/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 20 13:21:48.882905 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:48.882873    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt" podUID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 20 13:21:49.882050 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:49.882015    2557 patch_prober.go:28] interesting pod/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 20 13:21:49.882419 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:49.882066    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt" podUID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 20 13:21:50.882220 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:50.882185    2557 patch_prober.go:28] interesting pod/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 20 13:21:50.882614 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:50.882245    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt" podUID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 20 13:21:51.882180 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:51.882151    2557 patch_prober.go:28] interesting pod/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 20 13:21:51.882340 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:51.882209    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt" podUID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 20 13:21:52.795406 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:52.795374    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j"]
Jul 20 13:21:52.795790 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:52.795777    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" containerName="istio-proxy"
Jul 20 13:21:52.795843 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:52.795791    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5b0468-9709-4bbe-b2d8-2b1f0745286d" containerName="istio-proxy"
Jul 20 13:21:52.797709 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:52.797692    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j"
Jul 20 13:21:52.800778 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:52.800755    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4s4l\""
Jul 20 13:21:52.809162 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:52.809107    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j"]
Jul 20 13:21:52.814476 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:52.814446    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b75d3c3e-a6d1-42f8-be60-cd603450b16a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j\" (UID: \"b75d3c3e-a6d1-42f8-be60-cd603450b16a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j"
Jul 20 13:21:52.885938 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:52.885908    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:52.886352 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:52.886217    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:52.886811 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:52.886793    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:21:52.915074 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:52.915042    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b75d3c3e-a6d1-42f8-be60-cd603450b16a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j\" (UID: \"b75d3c3e-a6d1-42f8-be60-cd603450b16a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j"
Jul 20 13:21:52.915816 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:52.915796    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b75d3c3e-a6d1-42f8-be60-cd603450b16a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j\" (UID: \"b75d3c3e-a6d1-42f8-be60-cd603450b16a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j"
Jul 20 13:21:53.108061 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:53.108027    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j"
Jul 20 13:21:53.244755 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:53.244726    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j"]
Jul 20 13:21:53.246019 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:21:53.245995    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75d3c3e_a6d1_42f8_be60_cd603450b16a.slice/crio-7bdfe64444989536279871f693c1e3b1d3e82c149a728299c71df3f5bf5d3460 WatchSource:0}: Error finding container 7bdfe64444989536279871f693c1e3b1d3e82c149a728299c71df3f5bf5d3460: Status 404 returned error can't find the container with id 7bdfe64444989536279871f693c1e3b1d3e82c149a728299c71df3f5bf5d3460
Jul 20 13:21:53.762122 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:53.762034    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j" event={"ID":"b75d3c3e-a6d1-42f8-be60-cd603450b16a","Type":"ContainerStarted","Data":"0a2169f5e33fc5a23ae5bfcd45ace4751c061d579c84633ba9ffb489f467124f"}
Jul 20 13:21:53.762122 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:53.762087    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j" event={"ID":"b75d3c3e-a6d1-42f8-be60-cd603450b16a","Type":"ContainerStarted","Data":"7bdfe64444989536279871f693c1e3b1d3e82c149a728299c71df3f5bf5d3460"}
Jul 20 13:21:53.778530 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:53.778467    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j" podStartSLOduration=1.77842583 podStartE2EDuration="1.77842583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:21:53.778229347 +0000 UTC m=+2258.911212445" watchObservedRunningTime="2026-07-20 13:21:53.77842583 +0000 UTC m=+2258.911408932"
Jul 20 13:21:54.768306 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:54.768269    2557 generic.go:356] "Generic (PLEG): container finished" podID="b75d3c3e-a6d1-42f8-be60-cd603450b16a" containerID="0a2169f5e33fc5a23ae5bfcd45ace4751c061d579c84633ba9ffb489f467124f" exitCode=0
Jul 20 13:21:54.768698 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:54.768358    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j" event={"ID":"b75d3c3e-a6d1-42f8-be60-cd603450b16a","Type":"ContainerDied","Data":"0a2169f5e33fc5a23ae5bfcd45ace4751c061d579c84633ba9ffb489f467124f"}
Jul 20 13:21:55.915480 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:55.915455    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j"
Jul 20 13:21:55.942683 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:55.942656    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b75d3c3e-a6d1-42f8-be60-cd603450b16a-maas-api-service-ca\") pod \"b75d3c3e-a6d1-42f8-be60-cd603450b16a\" (UID: \"b75d3c3e-a6d1-42f8-be60-cd603450b16a\") "
Jul 20 13:21:55.942974 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:55.942950    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b75d3c3e-a6d1-42f8-be60-cd603450b16a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b75d3c3e-a6d1-42f8-be60-cd603450b16a" (UID: "b75d3c3e-a6d1-42f8-be60-cd603450b16a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:21:56.044120 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:56.044042    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b75d3c3e-a6d1-42f8-be60-cd603450b16a-maas-api-service-ca\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:21:56.780525 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:56.780499    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j"
Jul 20 13:21:56.780719 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:56.780501    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j" event={"ID":"b75d3c3e-a6d1-42f8-be60-cd603450b16a","Type":"ContainerDied","Data":"7bdfe64444989536279871f693c1e3b1d3e82c149a728299c71df3f5bf5d3460"}
Jul 20 13:21:56.780719 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:21:56.780660    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bdfe64444989536279871f693c1e3b1d3e82c149a728299c71df3f5bf5d3460"
Jul 20 13:22:12.881014 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:12.880983    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j"]
Jul 20 13:22:12.884353 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:12.884326    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9fd1f-ssp5j"]
Jul 20 13:22:13.380011 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:13.379967    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b75d3c3e-a6d1-42f8-be60-cd603450b16a" path="/var/lib/kubelet/pods/b75d3c3e-a6d1-42f8-be60-cd603450b16a/volumes"
Jul 20 13:22:19.503320 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:19.503282    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"]
Jul 20 13:22:19.503893 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:19.503515    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt" podUID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerName="istio-proxy" containerID="cri-o://403d37cc7f0988e3e7ee1c23b664077dd3ee6f4d1a9c02fc60c466bcc0b1f336" gracePeriod=30
Jul 20 13:22:19.856574 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:19.856539    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf"]
Jul 20 13:22:19.856973 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:19.856960    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b75d3c3e-a6d1-42f8-be60-cd603450b16a" containerName="revoke-keys"
Jul 20 13:22:19.857024 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:19.856975    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b75d3c3e-a6d1-42f8-be60-cd603450b16a" containerName="revoke-keys"
Jul 20 13:22:19.857062 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:19.857052    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b75d3c3e-a6d1-42f8-be60-cd603450b16a" containerName="revoke-keys"
Jul 20 13:22:19.859895 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:19.859878    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf"
Jul 20 13:22:19.862862 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:19.862843    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4s4l\""
Jul 20 13:22:19.867902 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:19.867705    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf"]
Jul 20 13:22:19.949610 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:19.949580    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a641c9f-aa17-4c91-a388-3e930d991b3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf\" (UID: \"6a641c9f-aa17-4c91-a388-3e930d991b3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf"
Jul 20 13:22:20.050375 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:20.050332    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a641c9f-aa17-4c91-a388-3e930d991b3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf\" (UID: \"6a641c9f-aa17-4c91-a388-3e930d991b3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf"
Jul 20 13:22:20.051053 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:20.051032    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a641c9f-aa17-4c91-a388-3e930d991b3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf\" (UID: \"6a641c9f-aa17-4c91-a388-3e930d991b3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf"
Jul 20 13:22:20.172192 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:20.172105    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf"
Jul 20 13:22:20.305956 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:20.305925    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf"]
Jul 20 13:22:20.307326 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:22:20.307297    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a641c9f_aa17_4c91_a388_3e930d991b3b.slice/crio-4978b70dd2ef804dcb6a30259620a101b6373bacc33cf79c8e6c2f286c9da413 WatchSource:0}: Error finding container 4978b70dd2ef804dcb6a30259620a101b6373bacc33cf79c8e6c2f286c9da413: Status 404 returned error can't find the container with id 4978b70dd2ef804dcb6a30259620a101b6373bacc33cf79c8e6c2f286c9da413
Jul 20 13:22:20.901298 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:20.901255    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf" event={"ID":"6a641c9f-aa17-4c91-a388-3e930d991b3b","Type":"ContainerStarted","Data":"65febdf7cb035b6302e618087b05824cfa751102d609021ff55caff1e9ebb473"}
Jul 20 13:22:20.901699 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:20.901320    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf" event={"ID":"6a641c9f-aa17-4c91-a388-3e930d991b3b","Type":"ContainerStarted","Data":"4978b70dd2ef804dcb6a30259620a101b6373bacc33cf79c8e6c2f286c9da413"}
Jul 20 13:22:20.918532 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:20.918456    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf" podStartSLOduration=1.918431314 podStartE2EDuration="1.918431314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:22:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:22:20.917868018 +0000 UTC m=+2286.050851119" watchObservedRunningTime="2026-07-20 13:22:20.918431314 +0000 UTC m=+2286.051414418"
Jul 20 13:22:21.906702 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:21.906672    2557 generic.go:356] "Generic (PLEG): container finished" podID="6a641c9f-aa17-4c91-a388-3e930d991b3b" containerID="65febdf7cb035b6302e618087b05824cfa751102d609021ff55caff1e9ebb473" exitCode=0
Jul 20 13:22:21.907066 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:21.906747    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf" event={"ID":"6a641c9f-aa17-4c91-a388-3e930d991b3b","Type":"ContainerDied","Data":"65febdf7cb035b6302e618087b05824cfa751102d609021ff55caff1e9ebb473"}
Jul 20 13:22:22.888833 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:22.888797    2557 patch_prober.go:28] interesting pod/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 20 13:22:22.889000 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:22.888852    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt" podUID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 13:22:23.048918 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:23.048893    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf"
Jul 20 13:22:23.179661 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:23.179554    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a641c9f-aa17-4c91-a388-3e930d991b3b-maas-api-service-ca\") pod \"6a641c9f-aa17-4c91-a388-3e930d991b3b\" (UID: \"6a641c9f-aa17-4c91-a388-3e930d991b3b\") "
Jul 20 13:22:23.179979 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:23.179948    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a641c9f-aa17-4c91-a388-3e930d991b3b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6a641c9f-aa17-4c91-a388-3e930d991b3b" (UID: "6a641c9f-aa17-4c91-a388-3e930d991b3b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:22:23.280106 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:23.280081    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a641c9f-aa17-4c91-a388-3e930d991b3b-maas-api-service-ca\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:22:23.919674 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:23.919607    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf" event={"ID":"6a641c9f-aa17-4c91-a388-3e930d991b3b","Type":"ContainerDied","Data":"4978b70dd2ef804dcb6a30259620a101b6373bacc33cf79c8e6c2f286c9da413"}
Jul 20 13:22:23.919883 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:23.919738    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4978b70dd2ef804dcb6a30259620a101b6373bacc33cf79c8e6c2f286c9da413"
Jul 20 13:22:23.919883 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:23.919818    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf"
Jul 20 13:22:24.757564 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.757540    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:22:24.895042 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895001    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-envoy\") pod \"d47fbb3e-c3a6-4124-a021-0793c8c23466\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") "
Jul 20 13:22:24.895239 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895061    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-workload-socket\") pod \"d47fbb3e-c3a6-4124-a021-0793c8c23466\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") "
Jul 20 13:22:24.895239 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895147    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-credential-socket\") pod \"d47fbb3e-c3a6-4124-a021-0793c8c23466\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") "
Jul 20 13:22:24.895239 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895219    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk6mv\" (UniqueName: \"kubernetes.io/projected/d47fbb3e-c3a6-4124-a021-0793c8c23466-kube-api-access-kk6mv\") pod \"d47fbb3e-c3a6-4124-a021-0793c8c23466\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") "
Jul 20 13:22:24.895417 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895247    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-podinfo\") pod \"d47fbb3e-c3a6-4124-a021-0793c8c23466\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") "
Jul 20 13:22:24.895417 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895282    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-token\") pod \"d47fbb3e-c3a6-4124-a021-0793c8c23466\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") "
Jul 20 13:22:24.895417 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895334    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-data\") pod \"d47fbb3e-c3a6-4124-a021-0793c8c23466\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") "
Jul 20 13:22:24.895417 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895372    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-workload-certs\") pod \"d47fbb3e-c3a6-4124-a021-0793c8c23466\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") "
Jul 20 13:22:24.895417 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895399    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d47fbb3e-c3a6-4124-a021-0793c8c23466-istiod-ca-cert\") pod \"d47fbb3e-c3a6-4124-a021-0793c8c23466\" (UID: \"d47fbb3e-c3a6-4124-a021-0793c8c23466\") "
Jul 20 13:22:24.895713 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895367    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d47fbb3e-c3a6-4124-a021-0793c8c23466" (UID: "d47fbb3e-c3a6-4124-a021-0793c8c23466"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:22:24.895713 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895376    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d47fbb3e-c3a6-4124-a021-0793c8c23466" (UID: "d47fbb3e-c3a6-4124-a021-0793c8c23466"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:22:24.895713 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895587    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d47fbb3e-c3a6-4124-a021-0793c8c23466" (UID: "d47fbb3e-c3a6-4124-a021-0793c8c23466"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:22:24.895881 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895754    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-workload-certs\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:22:24.895881 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895773    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-workload-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:22:24.895881 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895786    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-credential-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:22:24.895881 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.895842    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d47fbb3e-c3a6-4124-a021-0793c8c23466-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d47fbb3e-c3a6-4124-a021-0793c8c23466" (UID: "d47fbb3e-c3a6-4124-a021-0793c8c23466"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:22:24.896239 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.896213    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-data" (OuterVolumeSpecName: "istio-data") pod "d47fbb3e-c3a6-4124-a021-0793c8c23466" (UID: "d47fbb3e-c3a6-4124-a021-0793c8c23466"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:22:24.897407 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.897375    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-token" (OuterVolumeSpecName: "istio-token") pod "d47fbb3e-c3a6-4124-a021-0793c8c23466" (UID: "d47fbb3e-c3a6-4124-a021-0793c8c23466"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:22:24.897407 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.897410    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d47fbb3e-c3a6-4124-a021-0793c8c23466" (UID: "d47fbb3e-c3a6-4124-a021-0793c8c23466"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:22:24.897640 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.897418    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d47fbb3e-c3a6-4124-a021-0793c8c23466-kube-api-access-kk6mv" (OuterVolumeSpecName: "kube-api-access-kk6mv") pod "d47fbb3e-c3a6-4124-a021-0793c8c23466" (UID: "d47fbb3e-c3a6-4124-a021-0793c8c23466"). InnerVolumeSpecName "kube-api-access-kk6mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:22:24.897640 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.897520    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d47fbb3e-c3a6-4124-a021-0793c8c23466" (UID: "d47fbb3e-c3a6-4124-a021-0793c8c23466"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:22:24.926054 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.926027    2557 generic.go:356] "Generic (PLEG): container finished" podID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerID="403d37cc7f0988e3e7ee1c23b664077dd3ee6f4d1a9c02fc60c466bcc0b1f336" exitCode=0
Jul 20 13:22:24.926161 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.926075    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"
Jul 20 13:22:24.926161 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.926106    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt" event={"ID":"d47fbb3e-c3a6-4124-a021-0793c8c23466","Type":"ContainerDied","Data":"403d37cc7f0988e3e7ee1c23b664077dd3ee6f4d1a9c02fc60c466bcc0b1f336"}
Jul 20 13:22:24.926161 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.926154    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt" event={"ID":"d47fbb3e-c3a6-4124-a021-0793c8c23466","Type":"ContainerDied","Data":"32f396593dcef137ae7c9a0243737fbcf893662bdd1fed410dcc7a8becd4870d"}
Jul 20 13:22:24.926289 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.926175    2557 scope.go:117] "RemoveContainer" containerID="403d37cc7f0988e3e7ee1c23b664077dd3ee6f4d1a9c02fc60c466bcc0b1f336"
Jul 20 13:22:24.935144 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.935130    2557 scope.go:117] "RemoveContainer" containerID="7509191fb4a6c1992a5c2f688a1a049c2fc46e83ed507ebea686168885b1e7fc"
Jul 20 13:22:24.942708 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.942691    2557 scope.go:117] "RemoveContainer" containerID="403d37cc7f0988e3e7ee1c23b664077dd3ee6f4d1a9c02fc60c466bcc0b1f336"
Jul 20 13:22:24.942959 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:22:24.942933    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"403d37cc7f0988e3e7ee1c23b664077dd3ee6f4d1a9c02fc60c466bcc0b1f336\": container with ID starting with 403d37cc7f0988e3e7ee1c23b664077dd3ee6f4d1a9c02fc60c466bcc0b1f336 not found: ID does not exist" containerID="403d37cc7f0988e3e7ee1c23b664077dd3ee6f4d1a9c02fc60c466bcc0b1f336"
Jul 20 13:22:24.943050 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.942959    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403d37cc7f0988e3e7ee1c23b664077dd3ee6f4d1a9c02fc60c466bcc0b1f336"} err="failed to get container status \"403d37cc7f0988e3e7ee1c23b664077dd3ee6f4d1a9c02fc60c466bcc0b1f336\": rpc error: code = NotFound desc = could not find container \"403d37cc7f0988e3e7ee1c23b664077dd3ee6f4d1a9c02fc60c466bcc0b1f336\": container with ID starting with 403d37cc7f0988e3e7ee1c23b664077dd3ee6f4d1a9c02fc60c466bcc0b1f336 not found: ID does not exist"
Jul 20 13:22:24.943050 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.942976    2557 scope.go:117] "RemoveContainer" containerID="7509191fb4a6c1992a5c2f688a1a049c2fc46e83ed507ebea686168885b1e7fc"
Jul 20 13:22:24.943190 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:22:24.943173    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7509191fb4a6c1992a5c2f688a1a049c2fc46e83ed507ebea686168885b1e7fc\": container with ID starting with 7509191fb4a6c1992a5c2f688a1a049c2fc46e83ed507ebea686168885b1e7fc not found: ID does not exist" containerID="7509191fb4a6c1992a5c2f688a1a049c2fc46e83ed507ebea686168885b1e7fc"
Jul 20 13:22:24.943230 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.943197    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7509191fb4a6c1992a5c2f688a1a049c2fc46e83ed507ebea686168885b1e7fc"} err="failed to get container status \"7509191fb4a6c1992a5c2f688a1a049c2fc46e83ed507ebea686168885b1e7fc\": rpc error: code = NotFound desc = could not find container \"7509191fb4a6c1992a5c2f688a1a049c2fc46e83ed507ebea686168885b1e7fc\": container with ID starting with 7509191fb4a6c1992a5c2f688a1a049c2fc46e83ed507ebea686168885b1e7fc not found: ID does not exist"
Jul 20 13:22:24.949251 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.949230    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"]
Jul 20 13:22:24.952431 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.952410    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-f9fd1f-openshift-default-d8f569d8c-rxttt"]
Jul 20 13:22:24.997261 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.997240    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-data\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:22:24.997334 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.997265    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d47fbb3e-c3a6-4124-a021-0793c8c23466-istiod-ca-cert\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:22:24.997334 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.997278    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-envoy\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:22:24.997334 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.997290    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk6mv\" (UniqueName: \"kubernetes.io/projected/d47fbb3e-c3a6-4124-a021-0793c8c23466-kube-api-access-kk6mv\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:22:24.997334 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.997304    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-podinfo\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:22:24.997334 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:24.997317    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d47fbb3e-c3a6-4124-a021-0793c8c23466-istio-token\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:22:25.380434 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:25.380401    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d47fbb3e-c3a6-4124-a021-0793c8c23466" path="/var/lib/kubelet/pods/d47fbb3e-c3a6-4124-a021-0793c8c23466/volumes"
Jul 20 13:22:39.955783 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:39.955741    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf"]
Jul 20 13:22:39.963055 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:39.963026    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1797d3-qf7rf"]
Jul 20 13:22:41.380327 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:41.380297    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a641c9f-aa17-4c91-a388-3e930d991b3b" path="/var/lib/kubelet/pods/6a641c9f-aa17-4c91-a388-3e930d991b3b/volumes"
Jul 20 13:22:47.860166 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.860132    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"]
Jul 20 13:22:47.860549 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.860499    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerName="istio-proxy"
Jul 20 13:22:47.860549 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.860511    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerName="istio-proxy"
Jul 20 13:22:47.860549 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.860520    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a641c9f-aa17-4c91-a388-3e930d991b3b" containerName="revoke-keys"
Jul 20 13:22:47.860549 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.860525    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a641c9f-aa17-4c91-a388-3e930d991b3b" containerName="revoke-keys"
Jul 20 13:22:47.860549 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.860533    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerName="istio-proxy"
Jul 20 13:22:47.860549 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.860538    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerName="istio-proxy"
Jul 20 13:22:47.860825 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.860632    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerName="istio-proxy"
Jul 20 13:22:47.860825 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.860643    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a641c9f-aa17-4c91-a388-3e930d991b3b" containerName="revoke-keys"
Jul 20 13:22:47.860825 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.860652    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d47fbb3e-c3a6-4124-a021-0793c8c23466" containerName="istio-proxy"
Jul 20 13:22:47.865309 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.865286    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.867980 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.867954    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-7f57a3-openshift-default-dockercfg-z6c9w\""
Jul 20 13:22:47.879490 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.879466    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"]
Jul 20 13:22:47.890468 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.890439    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-credential-socket\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.890634 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.890483    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-workload-certs\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.890634 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.890552    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-workload-socket\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.890634 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.890597    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istiod-ca-cert\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.890783 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.890686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-envoy\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.890783 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.890725    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njknm\" (UniqueName: \"kubernetes.io/projected/04a0682a-6b83-4deb-b8d4-06312e8e14b6-kube-api-access-njknm\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.890783 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.890750    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-data\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.890899 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.890798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-podinfo\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.890899 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.890815    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-token\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.991869 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.991831    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-token\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.992056 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.991887    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-credential-socket\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.992056 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.991911    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-workload-certs\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.992056 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.991936    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-workload-socket\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.992056 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.991954    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istiod-ca-cert\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.992056 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.991997    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-envoy\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.992056 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.992015    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njknm\" (UniqueName: \"kubernetes.io/projected/04a0682a-6b83-4deb-b8d4-06312e8e14b6-kube-api-access-njknm\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.992056 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.992044    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-data\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.992434 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.992098    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-podinfo\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.992434 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.992394    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-workload-certs\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.992434 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.992416    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-workload-socket\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.992595 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.992504    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-data\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.992692 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.992646    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-credential-socket\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.992827 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.992805    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istiod-ca-cert\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.994425 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.994403    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-envoy\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:47.994613 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:47.994582    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-podinfo\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:48.001234 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:48.001201    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-token\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:48.001476 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:48.001457    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njknm\" (UniqueName: \"kubernetes.io/projected/04a0682a-6b83-4deb-b8d4-06312e8e14b6-kube-api-access-njknm\") pod \"e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") " pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:48.175398 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:48.175313    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:48.313940 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:48.313908    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"]
Jul 20 13:22:48.316503 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:22:48.316471    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a0682a_6b83_4deb_b8d4_06312e8e14b6.slice/crio-d14f4e76ee25124815c2bf76a72de24615b415278dc9569fdc516b102d206e61 WatchSource:0}: Error finding container d14f4e76ee25124815c2bf76a72de24615b415278dc9569fdc516b102d206e61: Status 404 returned error can't find the container with id d14f4e76ee25124815c2bf76a72de24615b415278dc9569fdc516b102d206e61
Jul 20 13:22:48.319061 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:48.319024    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:22:48.319149 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:48.319109    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:22:48.319186 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:48.319151    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:22:49.053600 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:49.053559    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8" event={"ID":"04a0682a-6b83-4deb-b8d4-06312e8e14b6","Type":"ContainerStarted","Data":"955ba4729b9ae22468ea54bbb2e6686fa19d08090ea71d441fd35fb54f42ce53"}
Jul 20 13:22:49.054036 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:49.053674    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8" event={"ID":"04a0682a-6b83-4deb-b8d4-06312e8e14b6","Type":"ContainerStarted","Data":"d14f4e76ee25124815c2bf76a72de24615b415278dc9569fdc516b102d206e61"}
Jul 20 13:22:49.078777 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:49.078730    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8" podStartSLOduration=2.078713262 podStartE2EDuration="2.078713262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:22:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:22:49.077520263 +0000 UTC m=+2314.210503364" watchObservedRunningTime="2026-07-20 13:22:49.078713262 +0000 UTC m=+2314.211696362"
Jul 20 13:22:49.175833 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:49.175796    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:49.180956 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:49.180930    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:50.058994 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:50.058960    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:50.060112 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:50.060088    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:22:56.166565 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.166533    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"]
Jul 20 13:22:56.169896 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.169879    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.173561 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.173543    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-b8383c-openshift-default-dockercfg-kd8dz\""
Jul 20 13:22:56.183686 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.183664    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"]
Jul 20 13:22:56.269926 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.269884    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-istio-data\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.269926 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.269926    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-workload-certs\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.270149 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.269947    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/189052d5-9d77-46be-bea9-2d947e8652f5-istio-token\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.270149 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.270013    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/189052d5-9d77-46be-bea9-2d947e8652f5-istiod-ca-cert\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.270149 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.270062    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/189052d5-9d77-46be-bea9-2d947e8652f5-istio-podinfo\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.270149 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.270090    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-credential-socket\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.270300 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.270154    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-istio-envoy\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.270300 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.270177    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-workload-socket\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.270300 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.270244    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hz6q\" (UniqueName: \"kubernetes.io/projected/189052d5-9d77-46be-bea9-2d947e8652f5-kube-api-access-7hz6q\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.371290 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.371258    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-istio-data\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.371460 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.371296    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-workload-certs\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.371460 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.371317    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/189052d5-9d77-46be-bea9-2d947e8652f5-istio-token\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.371460 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.371348    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/189052d5-9d77-46be-bea9-2d947e8652f5-istiod-ca-cert\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.371460 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.371390    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/189052d5-9d77-46be-bea9-2d947e8652f5-istio-podinfo\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.371460 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.371426    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-credential-socket\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.371766 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.371474    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-istio-envoy\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.371766 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.371502    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-workload-socket\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.371766 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.371529    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hz6q\" (UniqueName: \"kubernetes.io/projected/189052d5-9d77-46be-bea9-2d947e8652f5-kube-api-access-7hz6q\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.371766 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.371745    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-istio-data\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.371967 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.371946    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-workload-certs\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.372020 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.371968    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-workload-socket\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.372020 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.371995    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-credential-socket\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.372167 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.372147    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/189052d5-9d77-46be-bea9-2d947e8652f5-istiod-ca-cert\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.373724 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.373702    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-istio-envoy\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.373944 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.373925    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/189052d5-9d77-46be-bea9-2d947e8652f5-istio-podinfo\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.379081 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.379058    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hz6q\" (UniqueName: \"kubernetes.io/projected/189052d5-9d77-46be-bea9-2d947e8652f5-kube-api-access-7hz6q\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.379175 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.379154    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/189052d5-9d77-46be-bea9-2d947e8652f5-istio-token\") pod \"e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") " pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.480943 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.480877    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:56.617705 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.617681    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"]
Jul 20 13:22:56.619947 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:22:56.619918    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod189052d5_9d77_46be_bea9_2d947e8652f5.slice/crio-5946eca3f884dbda54aab6c19f7f263b2e694b9b252bc10ef773a1909283fae0 WatchSource:0}: Error finding container 5946eca3f884dbda54aab6c19f7f263b2e694b9b252bc10ef773a1909283fae0: Status 404 returned error can't find the container with id 5946eca3f884dbda54aab6c19f7f263b2e694b9b252bc10ef773a1909283fae0
Jul 20 13:22:56.622702 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.622664    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:22:56.622790 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.622745    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:22:56.622837 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:56.622789    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:22:57.096247 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:57.096216    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894" event={"ID":"189052d5-9d77-46be-bea9-2d947e8652f5","Type":"ContainerStarted","Data":"cd3471e0b7833cefe1886b2babb52f7a10340721d70483424155b2465ff4cd5e"}
Jul 20 13:22:57.096416 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:57.096267    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894" event={"ID":"189052d5-9d77-46be-bea9-2d947e8652f5","Type":"ContainerStarted","Data":"5946eca3f884dbda54aab6c19f7f263b2e694b9b252bc10ef773a1909283fae0"}
Jul 20 13:22:57.119973 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:57.119904    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894" podStartSLOduration=1.119890694 podStartE2EDuration="1.119890694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:22:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:22:57.119015568 +0000 UTC m=+2322.251998669" watchObservedRunningTime="2026-07-20 13:22:57.119890694 +0000 UTC m=+2322.252873794"
Jul 20 13:22:57.481982 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:57.481887    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:57.487320 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:57.487284    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:58.100977 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:58.100946    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:22:58.101881 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:22:58.101859    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:23:05.060561 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:05.060526    2557 patch_prober.go:28] interesting pod/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 20 13:23:05.061014 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:05.060581    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8" podUID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 20 13:23:05.142414 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:05.142378    2557 generic.go:356] "Generic (PLEG): container finished" podID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" containerID="955ba4729b9ae22468ea54bbb2e6686fa19d08090ea71d441fd35fb54f42ce53" exitCode=0
Jul 20 13:23:05.142658 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:05.142454    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8" event={"ID":"04a0682a-6b83-4deb-b8d4-06312e8e14b6","Type":"ContainerDied","Data":"955ba4729b9ae22468ea54bbb2e6686fa19d08090ea71d441fd35fb54f42ce53"}
Jul 20 13:23:05.142940 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:05.142923    2557 scope.go:117] "RemoveContainer" containerID="955ba4729b9ae22468ea54bbb2e6686fa19d08090ea71d441fd35fb54f42ce53"
Jul 20 13:23:05.144093 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:05.144066    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:23:05.144212 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:05.144160    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:23:05.144282 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:05.144244    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:23:06.153116 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:06.153067    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8" event={"ID":"04a0682a-6b83-4deb-b8d4-06312e8e14b6","Type":"ContainerStarted","Data":"dd27d402a6a70bd4702b11a2e353d318e901dcd3accf8d986faac57d0f977af7"}
Jul 20 13:23:06.175764 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:06.175725    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:23:06.176001 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:06.175979    2557 patch_prober.go:28] interesting pod/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 20 13:23:06.176045 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:06.176029    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8" podUID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 20 13:23:07.176208 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:07.176171    2557 patch_prober.go:28] interesting pod/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 20 13:23:07.176605 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:07.176231    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8" podUID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 20 13:23:08.175841 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:08.175802    2557 patch_prober.go:28] interesting pod/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 20 13:23:08.176026 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:08.175861    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8" podUID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 20 13:23:09.176058 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:09.176020    2557 patch_prober.go:28] interesting pod/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 20 13:23:09.176555 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:09.176092    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8" podUID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 20 13:23:10.180262 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:10.180231    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:23:10.180662 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:10.180579    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:23:10.181286 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:10.181266    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:23:11.185654 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:11.185598    2557 generic.go:356] "Generic (PLEG): container finished" podID="189052d5-9d77-46be-bea9-2d947e8652f5" containerID="cd3471e0b7833cefe1886b2babb52f7a10340721d70483424155b2465ff4cd5e" exitCode=0
Jul 20 13:23:11.186177 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:11.185680    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894" event={"ID":"189052d5-9d77-46be-bea9-2d947e8652f5","Type":"ContainerDied","Data":"cd3471e0b7833cefe1886b2babb52f7a10340721d70483424155b2465ff4cd5e"}
Jul 20 13:23:11.186293 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:11.186277    2557 scope.go:117] "RemoveContainer" containerID="cd3471e0b7833cefe1886b2babb52f7a10340721d70483424155b2465ff4cd5e"
Jul 20 13:23:11.187315 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:11.187286    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:23:11.187389 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:11.187359    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:23:11.187430 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:11.187391    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:23:12.194054 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:12.194017    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894" event={"ID":"189052d5-9d77-46be-bea9-2d947e8652f5","Type":"ContainerStarted","Data":"33f237358e26a288d86f64610afd0cb27304143d8bd16713808e193cef546509"}
Jul 20 13:23:12.481363 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:12.481266    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:23:12.482562 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:12.482533    2557 patch_prober.go:28] interesting pod/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 20 13:23:12.482704 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:12.482583    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894" podUID="189052d5-9d77-46be-bea9-2d947e8652f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 20 13:23:13.101482 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:13.101442    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:23:13.481687 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:13.481586    2557 patch_prober.go:28] interesting pod/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 20 13:23:13.481687 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:13.481672    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894" podUID="189052d5-9d77-46be-bea9-2d947e8652f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 20 13:23:14.482265 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:14.482233    2557 patch_prober.go:28] interesting pod/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 20 13:23:14.482696 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:14.482295    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894" podUID="189052d5-9d77-46be-bea9-2d947e8652f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 20 13:23:15.482245 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:15.482209    2557 patch_prober.go:28] interesting pod/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 20 13:23:15.482419 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:15.482265    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894" podUID="189052d5-9d77-46be-bea9-2d947e8652f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 20 13:23:16.485304 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:16.485273    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:23:16.486378 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:23:16.486351    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:27:15.644967 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:27:15.644929    2557 scope.go:117] "RemoveContainer" containerID="5b3c36347ffbc8d3a253a60d0ca9b517ebdb7aea7fc9303cd1ff21f1e6dcc11e"
Jul 20 13:27:15.653200 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:27:15.653180    2557 scope.go:117] "RemoveContainer" containerID="a3165238276ee095dbdb637bb8fd7304b143644b6085c450e1af5289d6f6ce8f"
Jul 20 13:28:15.673881 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:28:15.673850    2557 scope.go:117] "RemoveContainer" containerID="0a2169f5e33fc5a23ae5bfcd45ace4751c061d579c84633ba9ffb489f467124f"
Jul 20 13:29:15.692054 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:15.692023    2557 scope.go:117] "RemoveContainer" containerID="65febdf7cb035b6302e618087b05824cfa751102d609021ff55caff1e9ebb473"
Jul 20 13:29:28.329934 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:28.329901    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"]
Jul 20 13:29:28.330391 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:28.330159    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8" podUID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" containerName="istio-proxy" containerID="cri-o://dd27d402a6a70bd4702b11a2e353d318e901dcd3accf8d986faac57d0f977af7" gracePeriod=30
Jul 20 13:29:29.064004 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:29.063745    2557 generic.go:356] "Generic (PLEG): container finished" podID="aa6a26f2-75fb-4239-81f8-d9d43ef6f52e" containerID="2a420b23f5cf1340722d39c9aa4e75f829cd0300638c7a974753cd4f20ce75c5" exitCode=1
Jul 20 13:29:29.064004 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:29.063828    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf" event={"ID":"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e","Type":"ContainerDied","Data":"2a420b23f5cf1340722d39c9aa4e75f829cd0300638c7a974753cd4f20ce75c5"}
Jul 20 13:29:29.064307 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:29.064290    2557 scope.go:117] "RemoveContainer" containerID="2a420b23f5cf1340722d39c9aa4e75f829cd0300638c7a974753cd4f20ce75c5"
Jul 20 13:29:29.064603 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:29.064591    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:29:29.694856 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:29.694812    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/odh-model-controller-7998c67dc4-vqntk" podUID="c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.19:8081/readyz\": dial tcp 10.132.0.19:8081: connect: connection refused"
Jul 20 13:29:30.070984 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:30.070950    2557 generic.go:356] "Generic (PLEG): container finished" podID="c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2" containerID="61957172588e1434988ea03eb48510415996f22fba83e90e47b851a742415b14" exitCode=1
Jul 20 13:29:30.071179 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:30.071024    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vqntk" event={"ID":"c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2","Type":"ContainerDied","Data":"61957172588e1434988ea03eb48510415996f22fba83e90e47b851a742415b14"}
Jul 20 13:29:30.071472 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:30.071449    2557 scope.go:117] "RemoveContainer" containerID="61957172588e1434988ea03eb48510415996f22fba83e90e47b851a742415b14"
Jul 20 13:29:30.073465 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:30.073443    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf" event={"ID":"aa6a26f2-75fb-4239-81f8-d9d43ef6f52e","Type":"ContainerStarted","Data":"afcec99f8d49c4b87faf3170490f6a2ad62f0d61592cd9d1e2a5159bc98a9d2a"}
Jul 20 13:29:30.073687 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:30.073668    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 13:29:31.080395 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:31.080360    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vqntk" event={"ID":"c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2","Type":"ContainerStarted","Data":"5bd81ae6f708a095d4df12fe4ff6dc6025f199245de08a817fbc59c2c9a6e803"}
Jul 20 13:29:31.080825 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:31.080747    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-vqntk"
Jul 20 13:29:33.589763 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.589734    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:29:33.706896 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.706821    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-workload-socket\") pod \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") "
Jul 20 13:29:33.706896 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.706875    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-envoy\") pod \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") "
Jul 20 13:29:33.706896 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.706898    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-data\") pod \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") "
Jul 20 13:29:33.707164 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.706924    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-workload-certs\") pod \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") "
Jul 20 13:29:33.707164 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.706980    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-credential-socket\") pod \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") "
Jul 20 13:29:33.707164 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.707032    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njknm\" (UniqueName: \"kubernetes.io/projected/04a0682a-6b83-4deb-b8d4-06312e8e14b6-kube-api-access-njknm\") pod \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") "
Jul 20 13:29:33.707164 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.707057    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-token\") pod \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") "
Jul 20 13:29:33.707164 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.707087    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-podinfo\") pod \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") "
Jul 20 13:29:33.707164 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.707125    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "04a0682a-6b83-4deb-b8d4-06312e8e14b6" (UID: "04a0682a-6b83-4deb-b8d4-06312e8e14b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:33.707164 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.707141    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istiod-ca-cert\") pod \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\" (UID: \"04a0682a-6b83-4deb-b8d4-06312e8e14b6\") "
Jul 20 13:29:33.707539 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.707249    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "04a0682a-6b83-4deb-b8d4-06312e8e14b6" (UID: "04a0682a-6b83-4deb-b8d4-06312e8e14b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:33.707539 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.707302    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "04a0682a-6b83-4deb-b8d4-06312e8e14b6" (UID: "04a0682a-6b83-4deb-b8d4-06312e8e14b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:33.707539 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.707476    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-workload-certs\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:33.707539 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.707495    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-credential-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:33.707539 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.707509    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-workload-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:33.707819 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.707570    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "04a0682a-6b83-4deb-b8d4-06312e8e14b6" (UID: "04a0682a-6b83-4deb-b8d4-06312e8e14b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:29:33.707877 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.707830    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-data" (OuterVolumeSpecName: "istio-data") pod "04a0682a-6b83-4deb-b8d4-06312e8e14b6" (UID: "04a0682a-6b83-4deb-b8d4-06312e8e14b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:33.709243 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.709199    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "04a0682a-6b83-4deb-b8d4-06312e8e14b6" (UID: "04a0682a-6b83-4deb-b8d4-06312e8e14b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:29:33.709243 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.709216    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-token" (OuterVolumeSpecName: "istio-token") pod "04a0682a-6b83-4deb-b8d4-06312e8e14b6" (UID: "04a0682a-6b83-4deb-b8d4-06312e8e14b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:29:33.709406 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.709258    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a0682a-6b83-4deb-b8d4-06312e8e14b6-kube-api-access-njknm" (OuterVolumeSpecName: "kube-api-access-njknm") pod "04a0682a-6b83-4deb-b8d4-06312e8e14b6" (UID: "04a0682a-6b83-4deb-b8d4-06312e8e14b6"). InnerVolumeSpecName "kube-api-access-njknm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:29:33.709406 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.709286    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "04a0682a-6b83-4deb-b8d4-06312e8e14b6" (UID: "04a0682a-6b83-4deb-b8d4-06312e8e14b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:33.808348 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.808315    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njknm\" (UniqueName: \"kubernetes.io/projected/04a0682a-6b83-4deb-b8d4-06312e8e14b6-kube-api-access-njknm\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:33.808348 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.808343    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-token\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:33.808348 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.808354    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-podinfo\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:33.808585 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.808363    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istiod-ca-cert\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:33.808585 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.808372    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-envoy\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:33.808585 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:33.808379    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04a0682a-6b83-4deb-b8d4-06312e8e14b6-istio-data\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:34.104219 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:34.104186    2557 generic.go:356] "Generic (PLEG): container finished" podID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" containerID="dd27d402a6a70bd4702b11a2e353d318e901dcd3accf8d986faac57d0f977af7" exitCode=0
Jul 20 13:29:34.104395 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:34.104241    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"
Jul 20 13:29:34.104395 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:34.104247    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8" event={"ID":"04a0682a-6b83-4deb-b8d4-06312e8e14b6","Type":"ContainerDied","Data":"dd27d402a6a70bd4702b11a2e353d318e901dcd3accf8d986faac57d0f977af7"}
Jul 20 13:29:34.104472 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:34.104397    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8" event={"ID":"04a0682a-6b83-4deb-b8d4-06312e8e14b6","Type":"ContainerDied","Data":"d14f4e76ee25124815c2bf76a72de24615b415278dc9569fdc516b102d206e61"}
Jul 20 13:29:34.104472 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:34.104431    2557 scope.go:117] "RemoveContainer" containerID="dd27d402a6a70bd4702b11a2e353d318e901dcd3accf8d986faac57d0f977af7"
Jul 20 13:29:34.114209 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:34.114188    2557 scope.go:117] "RemoveContainer" containerID="955ba4729b9ae22468ea54bbb2e6686fa19d08090ea71d441fd35fb54f42ce53"
Jul 20 13:29:34.121879 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:34.121864    2557 scope.go:117] "RemoveContainer" containerID="dd27d402a6a70bd4702b11a2e353d318e901dcd3accf8d986faac57d0f977af7"
Jul 20 13:29:34.122098 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:29:34.122079    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd27d402a6a70bd4702b11a2e353d318e901dcd3accf8d986faac57d0f977af7\": container with ID starting with dd27d402a6a70bd4702b11a2e353d318e901dcd3accf8d986faac57d0f977af7 not found: ID does not exist" containerID="dd27d402a6a70bd4702b11a2e353d318e901dcd3accf8d986faac57d0f977af7"
Jul 20 13:29:34.122149 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:34.122106    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd27d402a6a70bd4702b11a2e353d318e901dcd3accf8d986faac57d0f977af7"} err="failed to get container status \"dd27d402a6a70bd4702b11a2e353d318e901dcd3accf8d986faac57d0f977af7\": rpc error: code = NotFound desc = could not find container \"dd27d402a6a70bd4702b11a2e353d318e901dcd3accf8d986faac57d0f977af7\": container with ID starting with dd27d402a6a70bd4702b11a2e353d318e901dcd3accf8d986faac57d0f977af7 not found: ID does not exist"
Jul 20 13:29:34.122149 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:34.122123    2557 scope.go:117] "RemoveContainer" containerID="955ba4729b9ae22468ea54bbb2e6686fa19d08090ea71d441fd35fb54f42ce53"
Jul 20 13:29:34.122354 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:29:34.122336    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"955ba4729b9ae22468ea54bbb2e6686fa19d08090ea71d441fd35fb54f42ce53\": container with ID starting with 955ba4729b9ae22468ea54bbb2e6686fa19d08090ea71d441fd35fb54f42ce53 not found: ID does not exist" containerID="955ba4729b9ae22468ea54bbb2e6686fa19d08090ea71d441fd35fb54f42ce53"
Jul 20 13:29:34.122394 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:34.122359    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"955ba4729b9ae22468ea54bbb2e6686fa19d08090ea71d441fd35fb54f42ce53"} err="failed to get container status \"955ba4729b9ae22468ea54bbb2e6686fa19d08090ea71d441fd35fb54f42ce53\": rpc error: code = NotFound desc = could not find container \"955ba4729b9ae22468ea54bbb2e6686fa19d08090ea71d441fd35fb54f42ce53\": container with ID starting with 955ba4729b9ae22468ea54bbb2e6686fa19d08090ea71d441fd35fb54f42ce53 not found: ID does not exist"
Jul 20 13:29:34.126283 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:34.126258    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"]
Jul 20 13:29:34.130806 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:34.130785    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-7f57a3-openshift-default-77b98568c9-6p7z8"]
Jul 20 13:29:35.381111 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:35.381078    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" path="/var/lib/kubelet/pods/04a0682a-6b83-4deb-b8d4-06312e8e14b6/volumes"
Jul 20 13:29:41.082863 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:41.082827    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-749978ccd7-smgrf"
Jul 20 13:29:42.087687 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:42.087649    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-vqntk"
Jul 20 13:29:50.364245 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:50.364211    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"]
Jul 20 13:29:50.364753 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:50.364423    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894" podUID="189052d5-9d77-46be-bea9-2d947e8652f5" containerName="istio-proxy" containerID="cri-o://33f237358e26a288d86f64610afd0cb27304143d8bd16713808e193cef546509" gracePeriod=30
Jul 20 13:29:55.626309 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.626283    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:29:55.697749 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.697689    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/189052d5-9d77-46be-bea9-2d947e8652f5-istio-token\") pod \"189052d5-9d77-46be-bea9-2d947e8652f5\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") "
Jul 20 13:29:55.697749 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.697731    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-istio-data\") pod \"189052d5-9d77-46be-bea9-2d947e8652f5\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") "
Jul 20 13:29:55.697948 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.697755    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hz6q\" (UniqueName: \"kubernetes.io/projected/189052d5-9d77-46be-bea9-2d947e8652f5-kube-api-access-7hz6q\") pod \"189052d5-9d77-46be-bea9-2d947e8652f5\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") "
Jul 20 13:29:55.697948 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.697795    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/189052d5-9d77-46be-bea9-2d947e8652f5-istiod-ca-cert\") pod \"189052d5-9d77-46be-bea9-2d947e8652f5\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") "
Jul 20 13:29:55.697948 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.697825    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-credential-socket\") pod \"189052d5-9d77-46be-bea9-2d947e8652f5\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") "
Jul 20 13:29:55.698112 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.697960    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-istio-envoy\") pod \"189052d5-9d77-46be-bea9-2d947e8652f5\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") "
Jul 20 13:29:55.698112 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.698031    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-workload-certs\") pod \"189052d5-9d77-46be-bea9-2d947e8652f5\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") "
Jul 20 13:29:55.698112 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.698064    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-workload-socket\") pod \"189052d5-9d77-46be-bea9-2d947e8652f5\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") "
Jul 20 13:29:55.698257 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.698119    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "189052d5-9d77-46be-bea9-2d947e8652f5" (UID: "189052d5-9d77-46be-bea9-2d947e8652f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:55.698257 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.698146    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/189052d5-9d77-46be-bea9-2d947e8652f5-istio-podinfo\") pod \"189052d5-9d77-46be-bea9-2d947e8652f5\" (UID: \"189052d5-9d77-46be-bea9-2d947e8652f5\") "
Jul 20 13:29:55.698257 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.698215    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/189052d5-9d77-46be-bea9-2d947e8652f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "189052d5-9d77-46be-bea9-2d947e8652f5" (UID: "189052d5-9d77-46be-bea9-2d947e8652f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:29:55.698377 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.698326    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "189052d5-9d77-46be-bea9-2d947e8652f5" (UID: "189052d5-9d77-46be-bea9-2d947e8652f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:55.698494 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.698475    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/189052d5-9d77-46be-bea9-2d947e8652f5-istiod-ca-cert\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.698569 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.698492    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "189052d5-9d77-46be-bea9-2d947e8652f5" (UID: "189052d5-9d77-46be-bea9-2d947e8652f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:55.698569 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.698500    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "189052d5-9d77-46be-bea9-2d947e8652f5" (UID: "189052d5-9d77-46be-bea9-2d947e8652f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:55.698569 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.698499    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-credential-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.698569 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.698543    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-workload-certs\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.700120 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.700095    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "189052d5-9d77-46be-bea9-2d947e8652f5" (UID: "189052d5-9d77-46be-bea9-2d947e8652f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:29:55.700295 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.700273    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/189052d5-9d77-46be-bea9-2d947e8652f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "189052d5-9d77-46be-bea9-2d947e8652f5" (UID: "189052d5-9d77-46be-bea9-2d947e8652f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:29:55.700343 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.700297    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/189052d5-9d77-46be-bea9-2d947e8652f5-kube-api-access-7hz6q" (OuterVolumeSpecName: "kube-api-access-7hz6q") pod "189052d5-9d77-46be-bea9-2d947e8652f5" (UID: "189052d5-9d77-46be-bea9-2d947e8652f5"). InnerVolumeSpecName "kube-api-access-7hz6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:29:55.700486 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.700471    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/189052d5-9d77-46be-bea9-2d947e8652f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "189052d5-9d77-46be-bea9-2d947e8652f5" (UID: "189052d5-9d77-46be-bea9-2d947e8652f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 13:29:55.799514 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.799491    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/189052d5-9d77-46be-bea9-2d947e8652f5-istio-token\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.799514 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.799513    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-istio-data\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.799680 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.799522    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hz6q\" (UniqueName: \"kubernetes.io/projected/189052d5-9d77-46be-bea9-2d947e8652f5-kube-api-access-7hz6q\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.799680 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.799530    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-istio-envoy\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.799680 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.799539    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/189052d5-9d77-46be-bea9-2d947e8652f5-workload-socket\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:55.799680 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:55.799546    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/189052d5-9d77-46be-bea9-2d947e8652f5-istio-podinfo\") on node \"ip-10-0-141-54.ec2.internal\" DevicePath \"\""
Jul 20 13:29:56.213192 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:56.213154    2557 generic.go:356] "Generic (PLEG): container finished" podID="189052d5-9d77-46be-bea9-2d947e8652f5" containerID="33f237358e26a288d86f64610afd0cb27304143d8bd16713808e193cef546509" exitCode=0
Jul 20 13:29:56.213372 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:56.213217    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"
Jul 20 13:29:56.213372 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:56.213225    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894" event={"ID":"189052d5-9d77-46be-bea9-2d947e8652f5","Type":"ContainerDied","Data":"33f237358e26a288d86f64610afd0cb27304143d8bd16713808e193cef546509"}
Jul 20 13:29:56.213372 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:56.213287    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894" event={"ID":"189052d5-9d77-46be-bea9-2d947e8652f5","Type":"ContainerDied","Data":"5946eca3f884dbda54aab6c19f7f263b2e694b9b252bc10ef773a1909283fae0"}
Jul 20 13:29:56.213372 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:56.213316    2557 scope.go:117] "RemoveContainer" containerID="33f237358e26a288d86f64610afd0cb27304143d8bd16713808e193cef546509"
Jul 20 13:29:56.222752 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:56.222733    2557 scope.go:117] "RemoveContainer" containerID="cd3471e0b7833cefe1886b2babb52f7a10340721d70483424155b2465ff4cd5e"
Jul 20 13:29:56.231580 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:56.231561    2557 scope.go:117] "RemoveContainer" containerID="33f237358e26a288d86f64610afd0cb27304143d8bd16713808e193cef546509"
Jul 20 13:29:56.231876 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:29:56.231848    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33f237358e26a288d86f64610afd0cb27304143d8bd16713808e193cef546509\": container with ID starting with 33f237358e26a288d86f64610afd0cb27304143d8bd16713808e193cef546509 not found: ID does not exist" containerID="33f237358e26a288d86f64610afd0cb27304143d8bd16713808e193cef546509"
Jul 20 13:29:56.231968 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:56.231886    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f237358e26a288d86f64610afd0cb27304143d8bd16713808e193cef546509"} err="failed to get container status \"33f237358e26a288d86f64610afd0cb27304143d8bd16713808e193cef546509\": rpc error: code = NotFound desc = could not find container \"33f237358e26a288d86f64610afd0cb27304143d8bd16713808e193cef546509\": container with ID starting with 33f237358e26a288d86f64610afd0cb27304143d8bd16713808e193cef546509 not found: ID does not exist"
Jul 20 13:29:56.231968 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:56.231912    2557 scope.go:117] "RemoveContainer" containerID="cd3471e0b7833cefe1886b2babb52f7a10340721d70483424155b2465ff4cd5e"
Jul 20 13:29:56.232196 ip-10-0-141-54 kubenswrapper[2557]: E0720 13:29:56.232178    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd3471e0b7833cefe1886b2babb52f7a10340721d70483424155b2465ff4cd5e\": container with ID starting with cd3471e0b7833cefe1886b2babb52f7a10340721d70483424155b2465ff4cd5e not found: ID does not exist" containerID="cd3471e0b7833cefe1886b2babb52f7a10340721d70483424155b2465ff4cd5e"
Jul 20 13:29:56.232269 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:56.232204    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd3471e0b7833cefe1886b2babb52f7a10340721d70483424155b2465ff4cd5e"} err="failed to get container status \"cd3471e0b7833cefe1886b2babb52f7a10340721d70483424155b2465ff4cd5e\": rpc error: code = NotFound desc = could not find container \"cd3471e0b7833cefe1886b2babb52f7a10340721d70483424155b2465ff4cd5e\": container with ID starting with cd3471e0b7833cefe1886b2babb52f7a10340721d70483424155b2465ff4cd5e not found: ID does not exist"
Jul 20 13:29:56.238068 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:56.238042    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"]
Jul 20 13:29:56.243529 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:56.243504    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-b8383c-openshift-default-5f78f946c-gx894"]
Jul 20 13:29:56.889970 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:56.889945    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-48rs8_f076bd39-a163-4e47-85c4-dad2317a81f4/manager/0.log"
Jul 20 13:29:57.014898 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:57.014869    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zgqxh_beea95a7-65c3-4c05-a20e-7bed244f671f/manager/0.log"
Jul 20 13:29:57.173745 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:57.173661    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5767485bdf-zn8bz_cc93167b-3ad7-44ea-a0ba-51311bf7813b/manager/0.log"
Jul 20 13:29:57.291581 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:57.291550    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-59vzh_fba8ebc1-3f12-41f6-b5b1-1253d30137c5/server/0.log"
Jul 20 13:29:57.380634 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:57.380584    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="189052d5-9d77-46be-bea9-2d947e8652f5" path="/var/lib/kubelet/pods/189052d5-9d77-46be-bea9-2d947e8652f5/volumes"
Jul 20 13:29:57.407690 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:57.407663    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vqntk_c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2/manager/1.log"
Jul 20 13:29:57.793537 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:57.793510    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749978ccd7-smgrf_aa6a26f2-75fb-4239-81f8-d9d43ef6f52e/copy-manifests/0.log"
Jul 20 13:29:57.800648 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:57.800611    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749978ccd7-smgrf_aa6a26f2-75fb-4239-81f8-d9d43ef6f52e/manager/1.log"
Jul 20 13:29:58.171993 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:58.171959    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-d4b798dcb-r2cnd_1e5fcb3c-3274-40e6-914a-4f2854c1faae/maas-api/0.log"
Jul 20 13:29:58.512315 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:29:58.512233    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-6xv8x_0ee5126d-6d33-4730-afef-65171dcc61c2/postgres/0.log"
Jul 20 13:30:00.138113 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.138077    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742570-fmzgs"]
Jul 20 13:30:00.138495 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.138420    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="189052d5-9d77-46be-bea9-2d947e8652f5" containerName="istio-proxy"
Jul 20 13:30:00.138495 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.138430    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="189052d5-9d77-46be-bea9-2d947e8652f5" containerName="istio-proxy"
Jul 20 13:30:00.138495 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.138442    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" containerName="istio-proxy"
Jul 20 13:30:00.138495 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.138447    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" containerName="istio-proxy"
Jul 20 13:30:00.138495 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.138456    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" containerName="istio-proxy"
Jul 20 13:30:00.138495 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.138463    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" containerName="istio-proxy"
Jul 20 13:30:00.138717 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.138533    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" containerName="istio-proxy"
Jul 20 13:30:00.138717 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.138540    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="189052d5-9d77-46be-bea9-2d947e8652f5" containerName="istio-proxy"
Jul 20 13:30:00.138717 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.138546    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="189052d5-9d77-46be-bea9-2d947e8652f5" containerName="istio-proxy"
Jul 20 13:30:00.138717 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.138557    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a0682a-6b83-4deb-b8d4-06312e8e14b6" containerName="istio-proxy"
Jul 20 13:30:00.142938 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.142921    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-fmzgs"
Jul 20 13:30:00.144881 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.144862    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-v4s4l\""
Jul 20 13:30:00.147999 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.147974    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742570-fmzgs"]
Jul 20 13:30:00.154865 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.154846    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-fmzgs"
Jul 20 13:30:00.290533 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:00.290430    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742570-fmzgs"]
Jul 20 13:30:00.293648 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:30:00.293594    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad3cbde_fc58_49a5_b717_d0c3a3e74b33.slice/crio-69e47183ac03b56f6819789cc681fe2e49fabce5388a1601a76b17dac81cf527 WatchSource:0}: Error finding container 69e47183ac03b56f6819789cc681fe2e49fabce5388a1601a76b17dac81cf527: Status 404 returned error can't find the container with id 69e47183ac03b56f6819789cc681fe2e49fabce5388a1601a76b17dac81cf527
Jul 20 13:30:01.084499 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:01.084474    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5kdg5_5623e02d-26a5-4950-82d7-5586e6cd70f2/discovery/0.log"
Jul 20 13:30:01.238806 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:01.238773    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-fmzgs" event={"ID":"8ad3cbde-fc58-49a5-b717-d0c3a3e74b33","Type":"ContainerStarted","Data":"42e6c236ea5f6155e44e45d439ce3347d0063d2821f4341879b65676ead0786d"}
Jul 20 13:30:01.239214 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:01.238827    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-fmzgs" event={"ID":"8ad3cbde-fc58-49a5-b717-d0c3a3e74b33","Type":"ContainerStarted","Data":"69e47183ac03b56f6819789cc681fe2e49fabce5388a1601a76b17dac81cf527"}
Jul 20 13:30:01.256331 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:01.256284    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-fmzgs" podStartSLOduration=1.256266269 podStartE2EDuration="1.256266269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:30:01.254799139 +0000 UTC m=+2746.387782241" watchObservedRunningTime="2026-07-20 13:30:01.256266269 +0000 UTC m=+2746.389249371"
Jul 20 13:30:01.323894 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:01.323868    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f7c7fb896-w2jxc_34281c51-746a-4e62-b808-8a1e2ec2a4c3/kube-auth-proxy/0.log"
Jul 20 13:30:01.457156 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:01.457067    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gjvc4_b87714f9-0043-473e-a7e5-12230a85f5d7/istio-proxy/1.log"
Jul 20 13:30:01.590057 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:01.590030    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-97llz_b1fd95ca-3edf-4e50-8c02-79917a7d57f9/payload-pre-processing/0.log"
Jul 20 13:30:01.712721 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:01.712648    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-kwknk_ff75f022-61d8-4556-b419-3d97c3f8f4fd/payload-processing/0.log"
Jul 20 13:30:02.183979 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:02.183949    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-gkfvf_0fe48a04-a75c-4a2f-a266-7a1723fbc874/main/0.log"
Jul 20 13:30:02.244728 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:02.244699    2557 generic.go:356] "Generic (PLEG): container finished" podID="8ad3cbde-fc58-49a5-b717-d0c3a3e74b33" containerID="42e6c236ea5f6155e44e45d439ce3347d0063d2821f4341879b65676ead0786d" exitCode=0
Jul 20 13:30:02.245071 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:02.244748    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-fmzgs" event={"ID":"8ad3cbde-fc58-49a5-b717-d0c3a3e74b33","Type":"ContainerDied","Data":"42e6c236ea5f6155e44e45d439ce3347d0063d2821f4341879b65676ead0786d"}
Jul 20 13:30:02.416700 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:02.416671    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-8svvs_2b31696d-66a6-471f-af3d-d99fffd9ac27/main/0.log"
Jul 20 13:30:02.648509 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:02.648449    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-qfl7d_15dd190e-b543-4639-b857-cd44c57d90ac/main/0.log"
Jul 20 13:30:03.389939 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:03.389915    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-fmzgs"
Jul 20 13:30:04.255298 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:04.255263    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-fmzgs" event={"ID":"8ad3cbde-fc58-49a5-b717-d0c3a3e74b33","Type":"ContainerDied","Data":"69e47183ac03b56f6819789cc681fe2e49fabce5388a1601a76b17dac81cf527"}
Jul 20 13:30:04.255477 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:04.255315    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69e47183ac03b56f6819789cc681fe2e49fabce5388a1601a76b17dac81cf527"
Jul 20 13:30:04.255477 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:04.255281    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-fmzgs"
Jul 20 13:30:11.022364 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:11.022329    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h4x68_5bbd5447-6fb8-45a5-bf3f-ecb313480f2b/global-pull-secret-syncer/0.log"
Jul 20 13:30:11.139116 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:11.139083    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d9nvp_aa4e1d7c-8c44-4a7b-96a8-6306ca0a6af9/konnectivity-agent/0.log"
Jul 20 13:30:11.244981 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:11.244950    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-54.ec2.internal_73f6bdbf997a544246c875c3b1e88545/haproxy/0.log"
Jul 20 13:30:18.741479 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:18.741445    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-2lqkh_5cbd3fd4-9a3b-4076-9179-40314357c9d9/cluster-monitoring-operator/0.log"
Jul 20 13:30:18.914197 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:18.914168    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8rgnc_0fc36941-41db-4bf5-b1bf-05487f4c4337/node-exporter/0.log"
Jul 20 13:30:18.935767 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:18.935739    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8rgnc_0fc36941-41db-4bf5-b1bf-05487f4c4337/kube-rbac-proxy/0.log"
Jul 20 13:30:18.956947 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:18.956925    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8rgnc_0fc36941-41db-4bf5-b1bf-05487f4c4337/init-textfile/0.log"
Jul 20 13:30:21.350981 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.350944    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"]
Jul 20 13:30:21.351455 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.351350    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="189052d5-9d77-46be-bea9-2d947e8652f5" containerName="istio-proxy"
Jul 20 13:30:21.351455 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.351365    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="189052d5-9d77-46be-bea9-2d947e8652f5" containerName="istio-proxy"
Jul 20 13:30:21.351455 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.351374    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad3cbde-fc58-49a5-b717-d0c3a3e74b33" containerName="cleanup"
Jul 20 13:30:21.351455 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.351380    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad3cbde-fc58-49a5-b717-d0c3a3e74b33" containerName="cleanup"
Jul 20 13:30:21.351455 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.351441    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad3cbde-fc58-49a5-b717-d0c3a3e74b33" containerName="cleanup"
Jul 20 13:30:21.356093 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.356072    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.358456 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.358432    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-478p7\"/\"openshift-service-ca.crt\""
Jul 20 13:30:21.358456 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.358446    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-478p7\"/\"kube-root-ca.crt\""
Jul 20 13:30:21.360561 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.360545    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-478p7\"/\"default-dockercfg-dd2k8\""
Jul 20 13:30:21.365309 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.365279    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"]
Jul 20 13:30:21.526091 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.526052    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64ce152b-3b3d-4392-808f-0a96f8b3aeff-podres\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.526091 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.526097    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64ce152b-3b3d-4392-808f-0a96f8b3aeff-lib-modules\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.526313 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.526137    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64ce152b-3b3d-4392-808f-0a96f8b3aeff-proc\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.526313 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.526154    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls2rs\" (UniqueName: \"kubernetes.io/projected/64ce152b-3b3d-4392-808f-0a96f8b3aeff-kube-api-access-ls2rs\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.526313 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.526238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64ce152b-3b3d-4392-808f-0a96f8b3aeff-sys\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.626867 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.626774    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64ce152b-3b3d-4392-808f-0a96f8b3aeff-sys\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.626867 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.626819    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64ce152b-3b3d-4392-808f-0a96f8b3aeff-podres\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.626867 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.626843    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64ce152b-3b3d-4392-808f-0a96f8b3aeff-lib-modules\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.627079 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.626900    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64ce152b-3b3d-4392-808f-0a96f8b3aeff-proc\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.627079 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.626911    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64ce152b-3b3d-4392-808f-0a96f8b3aeff-sys\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.627079 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.626925    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls2rs\" (UniqueName: \"kubernetes.io/projected/64ce152b-3b3d-4392-808f-0a96f8b3aeff-kube-api-access-ls2rs\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.627079 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.626968    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64ce152b-3b3d-4392-808f-0a96f8b3aeff-podres\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.627079 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.626983    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64ce152b-3b3d-4392-808f-0a96f8b3aeff-proc\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.627079 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.627017    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64ce152b-3b3d-4392-808f-0a96f8b3aeff-lib-modules\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.635410 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.635384    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls2rs\" (UniqueName: \"kubernetes.io/projected/64ce152b-3b3d-4392-808f-0a96f8b3aeff-kube-api-access-ls2rs\") pod \"perf-node-gather-daemonset-z5tvb\" (UID: \"64ce152b-3b3d-4392-808f-0a96f8b3aeff\") " pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.667479 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.667447    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:21.800645 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:21.800598    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"]
Jul 20 13:30:21.803213 ip-10-0-141-54 kubenswrapper[2557]: W0720 13:30:21.803186    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod64ce152b_3b3d_4392_808f_0a96f8b3aeff.slice/crio-91e4cdb975eeea89d8f46fac8b68b64c5b7f6ea02a1001bddcf3eaa02a50050c WatchSource:0}: Error finding container 91e4cdb975eeea89d8f46fac8b68b64c5b7f6ea02a1001bddcf3eaa02a50050c: Status 404 returned error can't find the container with id 91e4cdb975eeea89d8f46fac8b68b64c5b7f6ea02a1001bddcf3eaa02a50050c
Jul 20 13:30:22.344598 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:22.344559    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb" event={"ID":"64ce152b-3b3d-4392-808f-0a96f8b3aeff","Type":"ContainerStarted","Data":"b7db77eff6f9376c1886b9927ac71e83120847104b21d07976d428d8a4beeaee"}
Jul 20 13:30:22.344777 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:22.344635    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb" event={"ID":"64ce152b-3b3d-4392-808f-0a96f8b3aeff","Type":"ContainerStarted","Data":"91e4cdb975eeea89d8f46fac8b68b64c5b7f6ea02a1001bddcf3eaa02a50050c"}
Jul 20 13:30:22.344777 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:22.344674    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:22.367181 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:22.367136    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb" podStartSLOduration=1.367121584 podStartE2EDuration="1.367121584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:30:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:30:22.364169654 +0000 UTC m=+2767.497152754" watchObservedRunningTime="2026-07-20 13:30:22.367121584 +0000 UTC m=+2767.500104684"
Jul 20 13:30:23.599445 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:23.599416    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5fzgt_10bcc69c-4bb6-4c9e-8120-8745ad7c2784/dns/0.log"
Jul 20 13:30:23.617011 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:23.616987    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5fzgt_10bcc69c-4bb6-4c9e-8120-8745ad7c2784/kube-rbac-proxy/0.log"
Jul 20 13:30:23.729812 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:23.729790    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zfnzx_aa98a74e-b651-463c-b67c-d1cb18bad0f3/dns-node-resolver/0.log"
Jul 20 13:30:24.267995 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:24.267963    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n85wg_f9bbfbe6-3003-4ca0-aa5e-be4f921ddcc7/node-ca/0.log"
Jul 20 13:30:25.471532 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:25.471495    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5kdg5_5623e02d-26a5-4950-82d7-5586e6cd70f2/discovery/0.log"
Jul 20 13:30:25.520661 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:25.520609    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f7c7fb896-w2jxc_34281c51-746a-4e62-b808-8a1e2ec2a4c3/kube-auth-proxy/0.log"
Jul 20 13:30:25.556607 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:25.556573    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gjvc4_b87714f9-0043-473e-a7e5-12230a85f5d7/istio-proxy/0.log"
Jul 20 13:30:25.605326 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:25.605298    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gjvc4_b87714f9-0043-473e-a7e5-12230a85f5d7/istio-proxy/1.log"
Jul 20 13:30:25.642954 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:25.642926    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-97llz_b1fd95ca-3edf-4e50-8c02-79917a7d57f9/payload-pre-processing/0.log"
Jul 20 13:30:25.680363 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:25.680330    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-kwknk_ff75f022-61d8-4556-b419-3d97c3f8f4fd/payload-processing/0.log"
Jul 20 13:30:26.441350 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:26.441309    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pv4fk_e4067e76-be14-4847-8a2e-de8c8377c7e0/serve-healthcheck-canary/0.log"
Jul 20 13:30:26.881536 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:26.881500    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-pflw4_9c829d12-c2b9-4335-bc78-65693d34da89/insights-operator/0.log"
Jul 20 13:30:26.882507 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:26.882487    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-pflw4_9c829d12-c2b9-4335-bc78-65693d34da89/insights-operator/1.log"
Jul 20 13:30:26.903342 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:26.903319    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7jz9z_2d1d58ae-a9ab-4354-8c70-a070e4f49955/kube-rbac-proxy/0.log"
Jul 20 13:30:26.920744 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:26.920710    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7jz9z_2d1d58ae-a9ab-4354-8c70-a070e4f49955/exporter/0.log"
Jul 20 13:30:26.940047 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:26.940014    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7jz9z_2d1d58ae-a9ab-4354-8c70-a070e4f49955/extractor/0.log"
Jul 20 13:30:28.359730 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:28.359703    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-478p7/perf-node-gather-daemonset-z5tvb"
Jul 20 13:30:29.128280 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:29.128248    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-48rs8_f076bd39-a163-4e47-85c4-dad2317a81f4/manager/0.log"
Jul 20 13:30:29.445889 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:29.445802    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zgqxh_beea95a7-65c3-4c05-a20e-7bed244f671f/manager/0.log"
Jul 20 13:30:29.632319 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:29.632282    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5767485bdf-zn8bz_cc93167b-3ad7-44ea-a0ba-51311bf7813b/manager/0.log"
Jul 20 13:30:29.653954 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:29.653931    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-59vzh_fba8ebc1-3f12-41f6-b5b1-1253d30137c5/server/0.log"
Jul 20 13:30:29.688304 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:29.688273    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vqntk_c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2/manager/1.log"
Jul 20 13:30:29.763139 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:29.763021    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vqntk_c03ab8ba-3e60-4d48-a9bd-c981d02e9ea2/manager/0.log"
Jul 20 13:30:29.879055 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:29.879019    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749978ccd7-smgrf_aa6a26f2-75fb-4239-81f8-d9d43ef6f52e/manager/1.log"
Jul 20 13:30:29.967606 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:29.967574    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749978ccd7-smgrf_aa6a26f2-75fb-4239-81f8-d9d43ef6f52e/manager/0.log"
Jul 20 13:30:29.983228 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:29.983207    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749978ccd7-smgrf_aa6a26f2-75fb-4239-81f8-d9d43ef6f52e/copy-manifests/0.log"
Jul 20 13:30:31.256340 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:31.256295    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5kdg5_5623e02d-26a5-4950-82d7-5586e6cd70f2/discovery/0.log"
Jul 20 13:30:31.270469 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:31.270440    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wzl2g_cea8c889-5353-4a2b-8ccf-0ae5f6620779/openshift-lws-operator/0.log"
Jul 20 13:30:31.285251 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:31.285223    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f7c7fb896-w2jxc_34281c51-746a-4e62-b808-8a1e2ec2a4c3/kube-auth-proxy/0.log"
Jul 20 13:30:31.306751 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:31.306730    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gjvc4_b87714f9-0043-473e-a7e5-12230a85f5d7/istio-proxy/0.log"
Jul 20 13:30:31.358945 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:31.358924    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gjvc4_b87714f9-0043-473e-a7e5-12230a85f5d7/istio-proxy/1.log"
Jul 20 13:30:31.385037 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:31.385013    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-97llz_b1fd95ca-3edf-4e50-8c02-79917a7d57f9/payload-pre-processing/0.log"
Jul 20 13:30:31.410765 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:31.410743    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-kwknk_ff75f022-61d8-4556-b419-3d97c3f8f4fd/payload-processing/0.log"
Jul 20 13:30:32.964691 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:32.964660    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-5kdg5_5623e02d-26a5-4950-82d7-5586e6cd70f2/discovery/0.log"
Jul 20 13:30:32.993912 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:32.993885    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f7c7fb896-w2jxc_34281c51-746a-4e62-b808-8a1e2ec2a4c3/kube-auth-proxy/0.log"
Jul 20 13:30:33.013865 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:33.013838    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gjvc4_b87714f9-0043-473e-a7e5-12230a85f5d7/istio-proxy/0.log"
Jul 20 13:30:33.063198 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:33.063156    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gjvc4_b87714f9-0043-473e-a7e5-12230a85f5d7/istio-proxy/1.log"
Jul 20 13:30:33.095816 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:33.095790    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-97llz_b1fd95ca-3edf-4e50-8c02-79917a7d57f9/payload-pre-processing/0.log"
Jul 20 13:30:33.125642 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:33.125603    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-kwknk_ff75f022-61d8-4556-b419-3d97c3f8f4fd/payload-processing/0.log"
Jul 20 13:30:36.234532 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:36.234494    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-6gs6j_76d62d7c-b918-4610-a496-ffc02e02c958/migrator/0.log"
Jul 20 13:30:36.254962 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:36.254935    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-6gs6j_76d62d7c-b918-4610-a496-ffc02e02c958/graceful-termination/0.log"
Jul 20 13:30:37.721900 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:37.721874    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5sb7_b2e46c1e-c52b-46b5-b19c-e25efea77fa2/kube-multus-additional-cni-plugins/0.log"
Jul 20 13:30:37.742645 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:37.742599    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5sb7_b2e46c1e-c52b-46b5-b19c-e25efea77fa2/egress-router-binary-copy/0.log"
Jul 20 13:30:37.761880 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:37.761856    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5sb7_b2e46c1e-c52b-46b5-b19c-e25efea77fa2/cni-plugins/0.log"
Jul 20 13:30:37.779918 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:37.779871    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5sb7_b2e46c1e-c52b-46b5-b19c-e25efea77fa2/bond-cni-plugin/0.log"
Jul 20 13:30:37.798080 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:37.798056    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5sb7_b2e46c1e-c52b-46b5-b19c-e25efea77fa2/routeoverride-cni/0.log"
Jul 20 13:30:37.817421 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:37.817403    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5sb7_b2e46c1e-c52b-46b5-b19c-e25efea77fa2/whereabouts-cni-bincopy/0.log"
Jul 20 13:30:37.837110 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:37.837089    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5sb7_b2e46c1e-c52b-46b5-b19c-e25efea77fa2/whereabouts-cni/0.log"
Jul 20 13:30:38.053433 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:38.053321    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v75j2_55ec64d0-1738-4a94-b720-14a8d8a7e2f7/kube-multus/0.log"
Jul 20 13:30:38.204558 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:38.204521    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j62gp_c44e5f72-2a44-4fc6-bcac-56ce085e2bdd/network-metrics-daemon/0.log"
Jul 20 13:30:38.252059 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:38.252028    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j62gp_c44e5f72-2a44-4fc6-bcac-56ce085e2bdd/kube-rbac-proxy/0.log"
Jul 20 13:30:39.060915 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:39.060883    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chtb7_4435b501-e398-4e47-ac8e-21b1f87f0723/ovn-controller/0.log"
Jul 20 13:30:39.074758 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:39.074728    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chtb7_4435b501-e398-4e47-ac8e-21b1f87f0723/ovn-acl-logging/0.log"
Jul 20 13:30:39.099290 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:39.099261    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chtb7_4435b501-e398-4e47-ac8e-21b1f87f0723/kube-rbac-proxy-node/0.log"
Jul 20 13:30:39.117340 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:39.117314    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chtb7_4435b501-e398-4e47-ac8e-21b1f87f0723/kube-rbac-proxy-ovn-metrics/0.log"
Jul 20 13:30:39.131941 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:39.131919    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chtb7_4435b501-e398-4e47-ac8e-21b1f87f0723/northd/0.log"
Jul 20 13:30:39.148646 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:39.148609    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chtb7_4435b501-e398-4e47-ac8e-21b1f87f0723/nbdb/0.log"
Jul 20 13:30:39.166090 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:39.166062    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chtb7_4435b501-e398-4e47-ac8e-21b1f87f0723/sbdb/0.log"
Jul 20 13:30:39.250466 ip-10-0-141-54 kubenswrapper[2557]: I0720 13:30:39.250435    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-chtb7_4435b501-e398-4e47-ac8e-21b1f87f0723/ovnkube-controller/0.log"