Jul 07 18:50:50.708133 ip-10-0-128-118 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 18:50:51.138021 ip-10-0-128-118 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:50:51.138021 ip-10-0-128-118 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 18:50:51.138021 ip-10-0-128-118 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:50:51.138021 ip-10-0-128-118 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 18:50:51.138021 ip-10-0-128-118 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:50:51.140272 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.140154    2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 18:50:51.146109 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146090    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:51.146109 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146107    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:51.146109 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146111    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146114    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146117    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146120    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146124    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146127    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146130    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146137    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146140    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146143    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146146    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146148    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146151    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146153    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146156    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146159    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146162    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146164    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146167    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146170    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:51.146209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146172    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146175    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146178    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146180    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146183    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146187    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146192    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146196    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146199    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146202    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146205    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146208    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146211    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146214    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146217    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146220    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146225    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146227    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146230    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:51.146693 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146232    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146236    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146239    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146241    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146244    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146246    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146249    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146251    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146254    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146257    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146259    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146262    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146264    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146266    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146269    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146272    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146274    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146277    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146279    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146282    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:51.147169 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146285    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146287    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146290    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146292    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146295    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146298    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146301    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146303    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146306    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146309    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146311    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146315    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146317    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146319    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146323    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146325    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146328    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146330    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146333    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146335    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146338    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:51.147678 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146340    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146343    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146345    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146349    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146353    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146356    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146358    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146361    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146363    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146366    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146368    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146371    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146373    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146376    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146379    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146381    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.146385    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147107    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147115    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:51.148197 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147118    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147122    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147125    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147129    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147132    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147135    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147138    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147142    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147145    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147150    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147153    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147156    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147159    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147162    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147165    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147168    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147171    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147174    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147176    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147179    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:51.148653 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147182    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147184    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147187    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147190    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147192    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147197    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147201    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147204    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147206    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147209    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147212    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147215    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147217    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147220    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147222    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147225    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147229    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147232    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147235    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:51.149155 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147237    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147241    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147243    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147246    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147249    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147251    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147254    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147256    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147259    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147261    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147265    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147268    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147270    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147273    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147276    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147278    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147281    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147283    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147286    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:51.149611 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147288    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147291    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147293    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147297    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147299    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147302    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147305    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147307    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147310    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147314    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147317    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147320    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147322    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147325    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147327    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147330    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147333    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147336    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147338    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147340    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:51.150111 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147343    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147345    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147348    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147351    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147353    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147356    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147358    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147361    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147363    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147366    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147369    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147371    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147374    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147377    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147379    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147382    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147385    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147388    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147390    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147749    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:51.150604 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147754    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147757    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147759    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147762    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147764    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147769    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147773    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147776    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147779    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147782    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147785    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147787    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147790    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147792    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147813    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147817    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147820    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147823    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147825    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:51.151158 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147827    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147830    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147833    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147835    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147838    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147841    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147844    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147846    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147849    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147852    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147854    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147857    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147860    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147862    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147865    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147867    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147870    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147873    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147875    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147878    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:51.151642 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147880    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147883    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147886    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147888    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147891    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147894    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147897    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147900    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147902    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147905    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147908    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147910    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147913    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147915    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147918    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147920    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147923    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147925    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147927    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147930    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:51.152131 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147933    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147935    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147938    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147940    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147943    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147945    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147948    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147950    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147952    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147955    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147957    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147960    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147962    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147965    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147968    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147970    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147973    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147975    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147977    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147980    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:51.152616 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147983    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147985    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147988    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147990    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147993    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147995    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.147998    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148000    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148003    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148005    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148009    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148011    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148016    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148019    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148022    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148026    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148029    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148032    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148034    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148107    2554 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 18:50:51.153134 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148114    2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148120    2554 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148125    2554 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148129    2554 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148132    2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148136    2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148141    2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148145    2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148148    2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148151    2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148155    2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148158    2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148162    2554 flags.go:64] FLAG: --cgroup-root=""
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148165    2554 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148168    2554 flags.go:64] FLAG: --client-ca-file=""
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148171    2554 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148174    2554 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148179    2554 flags.go:64] FLAG: --cluster-domain=""
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148181    2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148185    2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148188    2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148191    2554 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148195    2554 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 18:50:51.153604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148198    2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148204    2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148207    2554 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148211    2554 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148214    2554 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148217    2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148220    2554 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148223    2554 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148227    2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148230    2554 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148233    2554 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148235    2554 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148238    2554 flags.go:64] FLAG: --enable-server="true"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148241    2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148247    2554 flags.go:64] FLAG: --event-burst="100"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148250    2554 flags.go:64] FLAG: --event-qps="50"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148253    2554 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148257    2554 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148260    2554 flags.go:64] FLAG: --eviction-hard=""
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148264    2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148267    2554 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148270    2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148272    2554 flags.go:64] FLAG: --eviction-soft=""
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148275    2554 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148278    2554 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 18:50:51.154169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148281    2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148284    2554 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148287    2554 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148290    2554 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148293    2554 flags.go:64] FLAG: --feature-gates=""
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148297    2554 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148299    2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148303    2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148306    2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148309    2554 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148312    2554 flags.go:64] FLAG: --help="false"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148315    2554 flags.go:64] FLAG: --hostname-override="ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148319    2554 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148321    2554 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148325    2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148328    2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148331    2554 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148335    2554 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148337    2554 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148340    2554 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148343    2554 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148347    2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148350    2554 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148353    2554 flags.go:64] FLAG: --kube-reserved=""
Jul 07 18:50:51.154853 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148356    2554 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148359    2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148362    2554 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148365    2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148368    2554 flags.go:64] FLAG: --lock-file=""
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148371    2554 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148374    2554 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148377    2554 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148387    2554 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148390    2554 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148393    2554 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148396    2554 flags.go:64] FLAG: --logging-format="text"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148399    2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148402    2554 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148405    2554 flags.go:64] FLAG: --manifest-url=""
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148408    2554 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148412    2554 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148415    2554 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148420    2554 flags.go:64] FLAG: --max-pods="110"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148423    2554 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148426    2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148429    2554 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148432    2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148436    2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148438    2554 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 18:50:51.155761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148441    2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148449    2554 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148452    2554 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148455    2554 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148460    2554 flags.go:64] FLAG: --pod-cidr=""
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148462    2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148468    2554 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148471    2554 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148474    2554 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148478    2554 flags.go:64] FLAG: --port="10250"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148481    2554 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148484    2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b706ad294b638c07"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148487    2554 flags.go:64] FLAG: --qos-reserved=""
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148490    2554 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148493    2554 flags.go:64] FLAG: --register-node="true"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148496    2554 flags.go:64] FLAG: --register-with-taints=""
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148499    2554 flags.go:64] FLAG: --registry-burst="10"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148502    2554 flags.go:64] FLAG: --registry-qps="5"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148505    2554 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148508    2554 flags.go:64] FLAG: --reserved-memory=""
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148512    2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148515    2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148518    2554 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148521    2554 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148524    2554 flags.go:64] FLAG: --runonce="false"
Jul 07 18:50:51.156414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148526    2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148529    2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148532    2554 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148535    2554 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148538    2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148541    2554 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148544    2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148547    2554 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148550    2554 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148553    2554 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148556    2554 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148560    2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148563    2554 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148566    2554 flags.go:64] FLAG: --system-cgroups=""
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148569    2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148574    2554 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148577    2554 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148581    2554 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148585    2554 flags.go:64] FLAG: --tls-min-version=""
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148588    2554 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148590    2554 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148593    2554 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148596    2554 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148599    2554 flags.go:64] FLAG: --v="2"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148602    2554 flags.go:64] FLAG: --version="false"
Jul 07 18:50:51.157046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148606    2554 flags.go:64] FLAG: --vmodule=""
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148610    2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.148613    2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148730    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148734    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148737    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148740    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148743    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148746    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148749    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148753    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148756    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148758    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148761    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148763    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148765    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148768    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148770    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148775    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148777    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:51.157660 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148780    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148782    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148785    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148787    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148790    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148808    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148812    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148815    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148817    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148820    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148822    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148825    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148828    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148830    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148832    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148835    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148839    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148842    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148844    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:51.158165 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148847    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148849    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148852    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148855    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148857    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148860    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148863    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148865    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148868    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148870    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148873    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148877    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148879    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148882    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148884    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148887    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148889    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148894    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148897    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148901    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:51.158672 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148904    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148907    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148910    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148913    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148915    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148918    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148921    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148923    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148926    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148930    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148932    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148935    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148937    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148940    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148943    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148945    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148948    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148950    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148953    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148956    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:51.159209 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148958    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148961    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148963    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148967    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148970    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148973    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148975    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148978    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148981    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148983    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148986    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148989    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148992    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148994    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148997    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.148999    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.149003    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.149006    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.149009    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:51.159707 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.149012    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:51.160185 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.149014    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:51.160185 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.149018    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:51.160185 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.149021    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:51.160185 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.149032    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:50:51.160185 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.156976    2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 18:50:51.160185 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.156992    2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 18:50:51.160185 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.157018    2554 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 18:50:51.160185 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.157027    2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 18:50:51.160185 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157083    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:51.160185 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157090    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:51.160185 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157093    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:51.160185 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157096    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:51.160185 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157099    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:51.160185 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157102    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157105    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157108    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157110    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157113    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157115    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157118    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157120    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157123    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157126    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157129    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157132    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157134    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157137    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157139    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157142    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157145    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157147    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157150    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157152    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:51.160530 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157154    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157157    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157160    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157163    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157166    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157169    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157171    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157174    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157176    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157179    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157181    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157184    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157186    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157189    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157191    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157194    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157196    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157199    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157201    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157204    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:51.161038 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157206    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157209    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157212    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157214    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157217    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157219    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157222    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157224    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157227    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157229    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157232    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157234    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157237    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157240    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157242    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157244    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157248    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157250    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157253    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157255    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:51.161514 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157258    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157261    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157263    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157265    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157268    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157270    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157273    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157275    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157278    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157281    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157283    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157285    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157288    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157290    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157294    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157298    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157301    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157304    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157307    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:51.162026 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157309    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:51.162473 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157312    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:51.162473 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157315    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:51.162473 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157319    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:51.162473 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157321    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:51.162473 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157324    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:51.162473 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157327    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:51.162473 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157330    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:51.162473 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157332    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:51.162473 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157335    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:51.162473 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157338    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:51.162473 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157341    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:51.162473 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157344    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:51.162473 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157346    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:51.162473 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157349    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.157354    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157465    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157470    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157473    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157475    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157478    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157481    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157484    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157487    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157489    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157492    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157494    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157497    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157500    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:50:51.162930 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157503    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157505    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157507    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157510    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157513    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157515    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157518    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157520    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157522    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157525    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157527    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157530    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157533    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157535    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157538    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157541    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157543    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157546    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157548    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157551    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:50:51.163305 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157553    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157556    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157558    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157561    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157563    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157566    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157568    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157571    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157573    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157576    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157578    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157581    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157584    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157587    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157589    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157591    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157594    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157597    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157599    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157602    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:50:51.163791 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157604    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157607    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157609    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157612    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157615    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157617    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157620    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157623    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157625    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157629    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157633    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157637    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157640    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157643    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157645    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157648    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157651    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157653    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157655    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:50:51.164287 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157659    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157663    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157666    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157669    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157672    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157675    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157678    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157680    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157683    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157685    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157688    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157690    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157693    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157695    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157697    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157700    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157703    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157705    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157708    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:50:51.164735 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157710    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:50:51.165208 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157713    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:50:51.165208 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157715    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:50:51.165208 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157718    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:50:51.165208 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157720    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:50:51.165208 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157723    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:50:51.165208 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157725    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:50:51.165208 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:51.157728    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:50:51.165208 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.157733    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:50:51.165208 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.157853    2554 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 18:50:51.165208 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.159870    2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 18:50:51.165208 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.161303    2554 server.go:1019] "Starting client certificate rotation"
Jul 07 18:50:51.165208 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.161398    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 18:50:51.165208 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.161431    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 18:50:51.165530 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.163990    2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 18:50:51.165782 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.165763    2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 18:50:51.173859 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.173842    2554 log.go:25] "Validated CRI v1 runtime API"
Jul 07 18:50:51.176613 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.176598    2554 log.go:25] "Validated CRI v1 image API"
Jul 07 18:50:51.180810 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.180782    2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 18:50:51.184153 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.184127    2554 fs.go:135] Filesystem UUIDs: map[07ddf1f9-dcb6-48de-a439-f4d3188f8345:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ce440b35-6caa-4a5d-9bc7-3f16d3083b32:/dev/nvme0n1p3]
Jul 07 18:50:51.184232 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.184151    2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 18:50:51.189728 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.189594    2554 manager.go:216] Machine: {Timestamp:2026-07-07 18:50:51.187946815 +0000 UTC m=+0.347286664 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102826 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d3cf5e7b95edefc7c0dd475f7fb37 SystemUUID:ec2d3cf5-e7b9-5ede-fc7c-0dd475f7fb37 BootID:8f688fb6-7557-45cd-aa5b-48767bb4b6f6 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8b:e5:78:d5:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8b:e5:78:d5:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:7e:71:48:fb:b9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 18:50:51.189728 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.189724    2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 18:50:51.189887 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.189849    2554 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 18:50:51.192199 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.192181    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 18:50:51.192944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.192915    2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 18:50:51.193080 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.192949    2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 18:50:51.193741 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.193731    2554 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 18:50:51.193774 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.193742    2554 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 18:50:51.193774 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.193750    2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 18:50:51.194351 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.194339    2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 18:50:51.195735 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.195724    2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 18:50:51.199404 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.199392    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 18:50:51.199530 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.199520    2554 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 18:50:51.199559 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.199553    2554 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 18:50:51.199586 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.199563    2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 18:50:51.199586 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.199577    2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 18:50:51.199636 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.199590    2554 kubelet.go:398] "Adding apiserver pod source"
Jul 07 18:50:51.199636 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.199608    2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 18:50:51.200013 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.199995    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 18:50:51.200113 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.200021    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 18:50:51.202264 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.202242    2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 18:50:51.204315 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.204302    2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 18:50:51.204361 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.204333    2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 18:50:51.205327 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.205315    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 18:50:51.205362 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.205332    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 18:50:51.205362 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.205338    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 18:50:51.205362 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.205344    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 18:50:51.205362 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.205352    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 18:50:51.205362 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.205358    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 18:50:51.205631 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.205623    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 18:50:51.205659 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.205632    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 18:50:51.205659 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.205639    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 18:50:51.205659 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.205649    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 18:50:51.205734 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.205662    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 18:50:51.205734 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.205669    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 18:50:51.208120 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.208105    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 18:50:51.208161 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.208123    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 18:50:51.210909 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.210889    2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 18:50:51.211068 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.211040    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 18:50:51.211154 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.211105    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 18:50:51.211680 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.211663    2554 server.go:1268] "Started kubelet"
Jul 07 18:50:51.211779 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.211716    2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 18:50:51.212288 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.212232    2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 18:50:51.212370 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.212315    2554 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 18:50:51.212965 ip-10-0-128-118 systemd[1]: Started Kubernetes Kubelet.
Jul 07 18:50:51.215231 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.213598    2554 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 18:50:51.215231 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.214418    2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 18:50:51.219253 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.216032    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-118.ec2.internal.18c0168dea094d85  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-118.ec2.internal,UID:ip-10-0-128-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-118.ec2.internal,},FirstTimestamp:2026-07-07 18:50:51.211394437 +0000 UTC m=+0.370734255,LastTimestamp:2026-07-07 18:50:51.211394437 +0000 UTC m=+0.370734255,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-118.ec2.internal,}"
Jul 07 18:50:51.219253 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.217230    2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 18:50:51.220792 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.220775    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dshd5"
Jul 07 18:50:51.222479 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.222463    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 18:50:51.222542 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.222464    2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 18:50:51.222589 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.222581    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Jul 07 18:50:51.223136 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.223120    2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 18:50:51.223218 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.223166    2554 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 18:50:51.223218 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.223179    2554 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 18:50:51.223359 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.223342    2554 factory.go:55] Registering systemd factory
Jul 07 18:50:51.223418 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.223364    2554 factory.go:223] Registration of the systemd container factory successfully
Jul 07 18:50:51.223631 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.223618    2554 factory.go:153] Registering CRI-O factory
Jul 07 18:50:51.223631 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.223633    2554 factory.go:223] Registration of the crio container factory successfully
Jul 07 18:50:51.223729 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.223677    2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 18:50:51.223729 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.223698    2554 factory.go:103] Registering Raw factory
Jul 07 18:50:51.223729 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.223708    2554 manager.go:1196] Started watching for new ooms in manager
Jul 07 18:50:51.223874 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.223862    2554 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 18:50:51.223921 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.223875    2554 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 18:50:51.224244 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.224224    2554 manager.go:349] Starting recovery of all containers
Jul 07 18:50:51.229123 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.228729    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dshd5"
Jul 07 18:50:51.233470 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.233448    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:51.236691 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.236669    2554 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-118.ec2.internal\" not found" node="ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.237750 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.237730    2554 manager.go:354] Recovery completed
Jul 07 18:50:51.239458 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.239433    2554 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 07 18:50:51.243324 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.243307    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:51.245717 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.245699    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:51.245819 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.245735    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:51.245819 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.245751    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:51.247285 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.247270    2554 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 18:50:51.247285 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.247284    2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 18:50:51.247381 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.247299    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 18:50:51.247381 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.247340    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:51.248224 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.248209    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:51.248285 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.248272    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:51.248342 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.248292    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:51.248377 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.248342    2554 policy_none.go:49] "None policy: Start"
Jul 07 18:50:51.248377 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.248359    2554 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 18:50:51.248377 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.248369    2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 18:50:51.249528 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.249517    2554 policy_none.go:47] "Start"
Jul 07 18:50:51.287440 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.287423    2554 manager.go:337] "Starting Device Plugin manager"
Jul 07 18:50:51.287526 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.287467    2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 18:50:51.287526 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.287480    2554 server.go:87] "Starting device plugin registration server"
Jul 07 18:50:51.287809 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.287785    2554 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 18:50:51.287866 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.287831    2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 18:50:51.287925 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.287914    2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 18:50:51.288030 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.288015    2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 18:50:51.288030 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.288030    2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 18:50:51.288641 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.288602    2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 18:50:51.288715 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.288653    2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-118.ec2.internal\" not found"
Jul 07 18:50:51.388267 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.388157    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:51.390730 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.390492    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:51.390730 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.390526    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:51.390730 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.390540    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:51.390730 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.390583    2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.399950 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.399930    2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.410667 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.399959    2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-118.ec2.internal\": node \"ip-10-0-128-118.ec2.internal\" not found"
Jul 07 18:50:51.432741 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.432578    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Jul 07 18:50:51.466579 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.466539    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 18:50:51.467780 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.467761    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 18:50:51.467904 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.467818    2554 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 18:50:51.467904 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.467853    2554 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 18:50:51.467995 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.467924    2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 18:50:51.470661 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.470646    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:51.533194 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.533152    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Jul 07 18:50:51.568378 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.568330    2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal"]
Jul 07 18:50:51.568442 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.568432    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:51.569477 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.569460    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:51.569547 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.569490    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:51.569547 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.569499    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:51.570879 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.570868    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:51.570999 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.570983    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.571048 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.571018    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:51.571616 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.571590    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:51.571616 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.571610    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:51.571783 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.571633    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:51.571783 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.571644    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:51.571783 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.571614    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:51.571783 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.571673    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:51.572737 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.572723    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.572781 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.572747    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:50:51.573492 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.573477    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:50:51.573563 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.573509    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:50:51.573563 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.573519    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:50:51.598436 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.598417    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-118.ec2.internal\" not found" node="ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.603333 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.603316    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-118.ec2.internal\" not found" node="ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.626587 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.626560    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d92d5a692bdd8433c39950bab5b5ec7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal\" (UID: \"d92d5a692bdd8433c39950bab5b5ec7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.626587 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.626592    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d92d5a692bdd8433c39950bab5b5ec7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal\" (UID: \"d92d5a692bdd8433c39950bab5b5ec7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.626731 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.626610    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/157622ff2cd69c4f1b3676d86c923065-config\") pod \"kube-apiserver-proxy-ip-10-0-128-118.ec2.internal\" (UID: \"157622ff2cd69c4f1b3676d86c923065\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.633680 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.633652    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Jul 07 18:50:51.727260 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.727231    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d92d5a692bdd8433c39950bab5b5ec7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal\" (UID: \"d92d5a692bdd8433c39950bab5b5ec7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.727414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.727269    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d92d5a692bdd8433c39950bab5b5ec7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal\" (UID: \"d92d5a692bdd8433c39950bab5b5ec7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.727414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.727295    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/157622ff2cd69c4f1b3676d86c923065-config\") pod \"kube-apiserver-proxy-ip-10-0-128-118.ec2.internal\" (UID: \"157622ff2cd69c4f1b3676d86c923065\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.727414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.727348    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/157622ff2cd69c4f1b3676d86c923065-config\") pod \"kube-apiserver-proxy-ip-10-0-128-118.ec2.internal\" (UID: \"157622ff2cd69c4f1b3676d86c923065\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.727414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.727359    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d92d5a692bdd8433c39950bab5b5ec7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal\" (UID: \"d92d5a692bdd8433c39950bab5b5ec7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.727414 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.727408    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d92d5a692bdd8433c39950bab5b5ec7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal\" (UID: \"d92d5a692bdd8433c39950bab5b5ec7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.734111 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.734086    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Jul 07 18:50:51.834311 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.834266    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Jul 07 18:50:51.906093 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.906056    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.907306 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:51.907282    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:51.935449 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:51.935411    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Jul 07 18:50:52.036239 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:52.036146    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Jul 07 18:50:52.137300 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:52.137256    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Jul 07 18:50:52.161234 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:52.161190    2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 18:50:52.161659 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:52.161375    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 18:50:52.161659 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:52.161426    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 18:50:52.231655 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:52.231601    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 18:45:51 +0000 UTC" deadline="2028-04-13 02:25:05.379161494 +0000 UTC"
Jul 07 18:50:52.231655 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:52.231650    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15487h34m13.147515853s"
Jul 07 18:50:52.237833 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:52.237796    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Jul 07 18:50:52.338144 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:52.338109    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-118.ec2.internal\" not found"
Jul 07 18:50:52.343366 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:52.343340    2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:52.422812 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:52.422784    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:52.432077 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:52.432033    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod157622ff2cd69c4f1b3676d86c923065.slice/crio-b139752c23459b0e03dadaf4af026546e49538ccabc65421d5bc748bbc74360f WatchSource:0}: Error finding container b139752c23459b0e03dadaf4af026546e49538ccabc65421d5bc748bbc74360f: Status 404 returned error can't find the container with id b139752c23459b0e03dadaf4af026546e49538ccabc65421d5bc748bbc74360f
Jul 07 18:50:52.432291 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:52.432268    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92d5a692bdd8433c39950bab5b5ec7f.slice/crio-e9135547fe438e33b69ee0a5a12127d79093ad8210c9db85b14f8cd74dc9262f WatchSource:0}: Error finding container e9135547fe438e33b69ee0a5a12127d79093ad8210c9db85b14f8cd74dc9262f: Status 404 returned error can't find the container with id e9135547fe438e33b69ee0a5a12127d79093ad8210c9db85b14f8cd74dc9262f
Jul 07 18:50:52.436091 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:52.436034    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 18:50:52.436251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:52.436235    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:50:52.438858 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:52.438843    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"
Jul 07 18:50:52.450076 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:52.450051    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 18:50:52.471285 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:52.471235    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal" event={"ID":"157622ff2cd69c4f1b3676d86c923065","Type":"ContainerStarted","Data":"b139752c23459b0e03dadaf4af026546e49538ccabc65421d5bc748bbc74360f"}
Jul 07 18:50:52.472199 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:52.472172    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal" event={"ID":"d92d5a692bdd8433c39950bab5b5ec7f","Type":"ContainerStarted","Data":"e9135547fe438e33b69ee0a5a12127d79093ad8210c9db85b14f8cd74dc9262f"}
Jul 07 18:50:52.755085 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:52.755053    2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:53.091119 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.091034    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:53.200525 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.200488    2554 apiserver.go:52] "Watching apiserver"
Jul 07 18:50:53.213811 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.213785    2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 18:50:53.214200 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.214178    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-mf5t6","openshift-multus/network-metrics-daemon-jm9g5","openshift-network-diagnostics/network-check-target-tjsjj","openshift-ovn-kubernetes/ovnkube-node-6nshg","kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6","openshift-cluster-node-tuning-operator/tuned-jhfcr","openshift-dns/node-resolver-f5gzx","openshift-multus/multus-mdwzs","openshift-network-operator/iptables-alerter-qkvjx","kube-system/global-pull-secret-syncer-f76tc","kube-system/konnectivity-agent-bd6mt","openshift-image-registry/node-ca-bbt8z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal"]
Jul 07 18:50:53.215624 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.215607    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.216810 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.216784    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:53.216966 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.216945    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:50:53.218825 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.218788    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:50:53.218934 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.218883    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:50:53.219917 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.219897    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:50:53.220461 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.220432    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 18:50:53.220581 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.220472    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.220581 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.220521    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tvp4h\""
Jul 07 18:50:53.222264 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.221974    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f5gzx"
Jul 07 18:50:53.223070 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.223048    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 18:50:53.223720 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.223698    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.224143 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.224123    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 18:50:53.224340 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.224320    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f8dwq\""
Jul 07 18:50:53.224413 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.224379    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 18:50:53.224489 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.224472    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 18:50:53.224974 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.224905    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 18:50:53.225433 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.225412    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.226817 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.226415    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 18:50:53.226817 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.226461    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 18:50:53.226983 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.226957    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 18:50:53.227383 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.227162    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 18:50:53.227383 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.227290    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 18:50:53.227529 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.227428    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7gw4z\""
Jul 07 18:50:53.228474 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.228454    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 18:50:53.228695 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.228675    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8cqg4\""
Jul 07 18:50:53.228775 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.228721    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bbt8z"
Jul 07 18:50:53.229021 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.228837    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 18:50:53.229021 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.229001    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 18:50:53.230962 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.230926    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 18:50:53.231222 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.231204    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:50:53.231323 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.231267    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:50:53.231762 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.231743    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 18:50:53.231833 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.231748    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pdhkf\""
Jul 07 18:50:53.232203 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.232183    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x42jt\""
Jul 07 18:50:53.232717 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.232699    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qkvjx"
Jul 07 18:50:53.233420 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.233404    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 18:50:53.233905 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.233881    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 18:50:53.233981 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.233934    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 18:50:53.233981 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.233888    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 18:50:53.234292 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.234277    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.235634 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.235619    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bd6mt"
Jul 07 18:50:53.235974 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.235959    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 18:50:53.236059 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.236041    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 18:50:53.236305 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.236287    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:50:53.236822 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.236806    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tnmks\""
Jul 07 18:50:53.236955 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.236938    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-sys\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.237020 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.236964    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvwx6\" (UniqueName: \"kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6\") pod \"network-check-target-tjsjj\" (UID: \"10195eeb-1db4-4853-98c9-dc7f19a59df0\") " pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:50:53.237020 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.236983    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-run-openvswitch\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237125 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237016    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-run-ovn\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237125 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237042    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-var-lib-kubelet\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.237125 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237058    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-dbus\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:53.237125 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237073    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-run-systemd\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237125 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237113    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-var-lib-openvswitch\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237152    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-node-log\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237173    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-log-socket\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237189    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237213    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-sysctl-d\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.237379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237269    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-registration-dir\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.237379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237290    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-modprobe-d\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.237379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237306    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-sysconfig\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.237379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237329    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-host\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.237379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237346    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-kubelet\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237360    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-etc-openvswitch\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237379    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-cni-bin\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237413    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-sysctl-conf\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237436    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-tuned\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237453    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-cni-netd\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237500    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-env-overrides\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237518    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttqdn\" (UniqueName: \"kubernetes.io/projected/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-kube-api-access-ttqdn\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237558    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-device-dir\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237605    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-systemd\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237630    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-systemd-units\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237670    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-ovnkube-script-lib\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237696    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19bf2468-4a15-4e76-9c66-6d26e6a73d93-hosts-file\") pod \"node-resolver-f5gzx\" (UID: \"19bf2468-4a15-4e76-9c66-6d26e6a73d93\") " pod="openshift-dns/node-resolver-f5gzx"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237719    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-run\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237757    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff2eb360-d34b-42f6-8427-4bf13c4cd407-tmp\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237786    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-run-netns\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237806    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19bf2468-4a15-4e76-9c66-6d26e6a73d93-tmp-dir\") pod \"node-resolver-f5gzx\" (UID: \"19bf2468-4a15-4e76-9c66-6d26e6a73d93\") " pod="openshift-dns/node-resolver-f5gzx"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237855    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-socket-dir\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.237977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237883    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-lib-modules\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237907    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237950    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-ovnkube-config\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.237978    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238006    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-sys-fs\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238027    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bjlk\" (UniqueName: \"kubernetes.io/projected/ff2eb360-d34b-42f6-8427-4bf13c4cd407-kube-api-access-5bjlk\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238062    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-kubelet-config\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238086    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-slash\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238151    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238180    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-ovn-node-metrics-cert\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238210    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdd5x\" (UniqueName: \"kubernetes.io/projected/19bf2468-4a15-4e76-9c66-6d26e6a73d93-kube-api-access-mdd5x\") pod \"node-resolver-f5gzx\" (UID: \"19bf2468-4a15-4e76-9c66-6d26e6a73d93\") " pod="openshift-dns/node-resolver-f5gzx"
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238239    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-kubernetes\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238216    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238264    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-etc-selinux\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238295    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmbxz\" (UniqueName: \"kubernetes.io/projected/35b51a62-f49b-476f-b8ba-be97ff5e075f-kube-api-access-jmbxz\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238392    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238436    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238544    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h6vqb\""
Jul 07 18:50:53.238777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.238608    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 18:50:53.239717 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.239700    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q5q46\""
Jul 07 18:50:53.241380 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.241307    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 18:50:53.266615 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.266588    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-htmbt"
Jul 07 18:50:53.275963 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.275939    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-htmbt"
Jul 07 18:50:53.324275 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.324247    2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 18:50:53.338484 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.338456    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-dbus\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:53.338640 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.338496    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-run-systemd\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.339905 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.339319    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-var-lib-openvswitch\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.339905 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.339367    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-dbus\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:53.339905 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.339480    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-run-systemd\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.339905 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.339572    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-var-lib-openvswitch\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.339905 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.339594    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-node-log\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.339386    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-node-log\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340278    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-log-socket\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340337    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-cni-bin\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340371    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19bf2468-4a15-4e76-9c66-6d26e6a73d93-hosts-file\") pod \"node-resolver-f5gzx\" (UID: \"19bf2468-4a15-4e76-9c66-6d26e6a73d93\") " pod="openshift-dns/node-resolver-f5gzx"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340402    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-modprobe-d\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340426    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-host\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340456    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-kubelet\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340487    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-etc-openvswitch\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340519    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttqdn\" (UniqueName: \"kubernetes.io/projected/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-kube-api-access-ttqdn\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340558    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxrcf\" (UniqueName: \"kubernetes.io/projected/85ef9f9d-7b7d-4153-9b73-575bec23fffd-kube-api-access-qxrcf\") pod \"iptables-alerter-qkvjx\" (UID: \"85ef9f9d-7b7d-4153-9b73-575bec23fffd\") " pod="openshift-network-operator/iptables-alerter-qkvjx"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340588    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnhff\" (UniqueName: \"kubernetes.io/projected/eb453689-3272-4296-8339-269354e1dd6f-kube-api-access-wnhff\") pod \"network-metrics-daemon-jm9g5\" (UID: \"eb453689-3272-4296-8339-269354e1dd6f\") " pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340621    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02314617-8ae9-46ef-bccc-536660fadb9b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340652    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-tuned\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340693    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-cni-netd\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340723    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85ef9f9d-7b7d-4153-9b73-575bec23fffd-host-slash\") pod \"iptables-alerter-qkvjx\" (UID: \"85ef9f9d-7b7d-4153-9b73-575bec23fffd\") " pod="openshift-network-operator/iptables-alerter-qkvjx"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340749    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41ccf198-2ae4-4b4d-908b-dcdff0614253-konnectivity-ca\") pod \"konnectivity-agent-bd6mt\" (UID: \"41ccf198-2ae4-4b4d-908b-dcdff0614253\") " pod="kube-system/konnectivity-agent-bd6mt"
Jul 07 18:50:53.342337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340784    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-device-dir\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340824    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-systemd-units\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340887    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85ef9f9d-7b7d-4153-9b73-575bec23fffd-iptables-alerter-script\") pod \"iptables-alerter-qkvjx\" (UID: \"85ef9f9d-7b7d-4153-9b73-575bec23fffd\") " pod="openshift-network-operator/iptables-alerter-qkvjx"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340919    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-multus-cni-dir\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340952    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c74d8\" (UniqueName: \"kubernetes.io/projected/eddf68ee-cdbb-4e8e-8b32-b86fb51faaec-kube-api-access-c74d8\") pod \"node-ca-bbt8z\" (UID: \"eddf68ee-cdbb-4e8e-8b32-b86fb51faaec\") " pod="openshift-image-registry/node-ca-bbt8z"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.340978    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-run\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341008    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff2eb360-d34b-42f6-8427-4bf13c4cd407-tmp\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341040    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-os-release\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341071    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-socket-dir\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341101    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-ovnkube-config\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341128    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-run-netns\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341160    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-multus-conf-dir\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341178    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-cni-netd\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341191    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-multus-daemon-config\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341224    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02314617-8ae9-46ef-bccc-536660fadb9b-system-cni-dir\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341251    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-log-socket\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341251    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.343251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341306    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-sys-fs\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341321    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341342    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-kubelet-config\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341372    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-ovn-node-metrics-cert\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341406    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdd5x\" (UniqueName: \"kubernetes.io/projected/19bf2468-4a15-4e76-9c66-6d26e6a73d93-kube-api-access-mdd5x\") pod \"node-resolver-f5gzx\" (UID: \"19bf2468-4a15-4e76-9c66-6d26e6a73d93\") " pod="openshift-dns/node-resolver-f5gzx"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341427    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-device-dir\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341442    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-cnibin\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341484    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-systemd-units\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341514    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-cni-bin\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341521    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs\") pod \"network-metrics-daemon-jm9g5\" (UID: \"eb453689-3272-4296-8339-269354e1dd6f\") " pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341559    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02314617-8ae9-46ef-bccc-536660fadb9b-os-release\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341750    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-kubelet\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341791    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-etc-selinux\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341821    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-sys\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341849    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvwx6\" (UniqueName: \"kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6\") pod \"network-check-target-tjsjj\" (UID: \"10195eeb-1db4-4853-98c9-dc7f19a59df0\") " pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341901    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-run-ovn\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341936    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-var-lib-cni-bin\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.344126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341967    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eddf68ee-cdbb-4e8e-8b32-b86fb51faaec-host\") pod \"node-ca-bbt8z\" (UID: \"eddf68ee-cdbb-4e8e-8b32-b86fb51faaec\") " pod="openshift-image-registry/node-ca-bbt8z"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.341995    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342037    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-ovnkube-script-lib\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342064    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-sysctl-d\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342095    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-registration-dir\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342124    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-sysconfig\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342152    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-hostroot\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342247    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-etc-openvswitch\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342256    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342363    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-sys\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342415    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-run\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342415    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-run-multus-certs\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342557    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-modprobe-d\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342597    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-sysctl-conf\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342462    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19bf2468-4a15-4e76-9c66-6d26e6a73d93-hosts-file\") pod \"node-resolver-f5gzx\" (UID: \"19bf2468-4a15-4e76-9c66-6d26e6a73d93\") " pod="openshift-dns/node-resolver-f5gzx"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342617    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-socket-dir\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342669    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-etc-selinux\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342721    2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 18:50:53.345007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342868    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-sysconfig\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342889    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-run-ovn\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.342970    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-kubelet-config\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343030    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-ovnkube-config\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343094    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-env-overrides\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343120    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-sysctl-conf\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343187    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-sys-fs\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343264    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-host\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343292    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-sysctl-d\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343342    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-etc-kubernetes\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343366    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-ovnkube-script-lib\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343379    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02314617-8ae9-46ef-bccc-536660fadb9b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343341    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/35b51a62-f49b-476f-b8ba-be97ff5e075f-registration-dir\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343448    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-systemd\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343504    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-systemd\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343502    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02314617-8ae9-46ef-bccc-536660fadb9b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343573    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-run-netns\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.345944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343625    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19bf2468-4a15-4e76-9c66-6d26e6a73d93-tmp-dir\") pod \"node-resolver-f5gzx\" (UID: \"19bf2468-4a15-4e76-9c66-6d26e6a73d93\") " pod="openshift-dns/node-resolver-f5gzx"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343766    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41ccf198-2ae4-4b4d-908b-dcdff0614253-agent-certs\") pod \"konnectivity-agent-bd6mt\" (UID: \"41ccf198-2ae4-4b4d-908b-dcdff0614253\") " pod="kube-system/konnectivity-agent-bd6mt"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343771    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-env-overrides\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343819    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-run-netns\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343850    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-system-cni-dir\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343897    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-multus-socket-dir-parent\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343919    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19bf2468-4a15-4e76-9c66-6d26e6a73d93-tmp-dir\") pod \"node-resolver-f5gzx\" (UID: \"19bf2468-4a15-4e76-9c66-6d26e6a73d93\") " pod="openshift-dns/node-resolver-f5gzx"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.343978    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-run-k8s-cni-cncf-io\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344029    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-var-lib-cni-multus\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344066    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eddf68ee-cdbb-4e8e-8b32-b86fb51faaec-serviceca\") pod \"node-ca-bbt8z\" (UID: \"eddf68ee-cdbb-4e8e-8b32-b86fb51faaec\") " pod="openshift-image-registry/node-ca-bbt8z"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344116    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-lib-modules\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344153    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344210    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-cni-binary-copy\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.344305    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344368    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqjbq\" (UniqueName: \"kubernetes.io/projected/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-kube-api-access-sqjbq\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344400    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-lib-modules\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344403    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02314617-8ae9-46ef-bccc-536660fadb9b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344441    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bjlk\" (UniqueName: \"kubernetes.io/projected/ff2eb360-d34b-42f6-8427-4bf13c4cd407-kube-api-access-5bjlk\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.346867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344472    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-slash\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.347813 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344509    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.347813 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344638    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02314617-8ae9-46ef-bccc-536660fadb9b-cnibin\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.347813 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344671    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-kubernetes\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.347813 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344699    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmbxz\" (UniqueName: \"kubernetes.io/projected/35b51a62-f49b-476f-b8ba-be97ff5e075f-kube-api-access-jmbxz\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.347813 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344726    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-run-openvswitch\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.347813 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344771    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-var-lib-kubelet\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.347813 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344846    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jvzb\" (UniqueName: \"kubernetes.io/projected/02314617-8ae9-46ef-bccc-536660fadb9b-kube-api-access-8jvzb\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.347813 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.344896    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-var-lib-kubelet\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.347813 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.345004    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-var-lib-kubelet\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.347813 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.345076    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.347813 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.345127    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-host-slash\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.347813 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.345157    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-kubernetes\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.347813 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.345222    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-run-openvswitch\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.347813 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.345413    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret podName:9467a0f3-0b26-4d87-b1de-0fcf62a224ec nodeName:}" failed. No retries permitted until 2026-07-07 18:50:53.845266772 +0000 UTC m=+3.004606648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret") pod "global-pull-secret-syncer-f76tc" (UID: "9467a0f3-0b26-4d87-b1de-0fcf62a224ec") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:53.348616 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.348445    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff2eb360-d34b-42f6-8427-4bf13c4cd407-etc-tuned\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.348681 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.348619    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff2eb360-d34b-42f6-8427-4bf13c4cd407-tmp\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.349280 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.349227    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-ovn-node-metrics-cert\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.349430 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.349409    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:53.349702 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.349684    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:53.349867 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.349854    2554 projected.go:196] Error preparing data for projected volume kube-api-access-nvwx6 for pod openshift-network-diagnostics/network-check-target-tjsjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:53.350112 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.350094    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6 podName:10195eeb-1db4-4853-98c9-dc7f19a59df0 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:53.850047655 +0000 UTC m=+3.009387494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nvwx6" (UniqueName: "kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6") pod "network-check-target-tjsjj" (UID: "10195eeb-1db4-4853-98c9-dc7f19a59df0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:53.351763 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.351739    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdd5x\" (UniqueName: \"kubernetes.io/projected/19bf2468-4a15-4e76-9c66-6d26e6a73d93-kube-api-access-mdd5x\") pod \"node-resolver-f5gzx\" (UID: \"19bf2468-4a15-4e76-9c66-6d26e6a73d93\") " pod="openshift-dns/node-resolver-f5gzx"
Jul 07 18:50:53.353740 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.353688    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttqdn\" (UniqueName: \"kubernetes.io/projected/423f17ea-41e4-4dd9-91a0-5ce6d13f31ee-kube-api-access-ttqdn\") pod \"ovnkube-node-6nshg\" (UID: \"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.355467 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.355438    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmbxz\" (UniqueName: \"kubernetes.io/projected/35b51a62-f49b-476f-b8ba-be97ff5e075f-kube-api-access-jmbxz\") pod \"aws-ebs-csi-driver-node-p8gg6\" (UID: \"35b51a62-f49b-476f-b8ba-be97ff5e075f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.355690 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.355665    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bjlk\" (UniqueName: \"kubernetes.io/projected/ff2eb360-d34b-42f6-8427-4bf13c4cd407-kube-api-access-5bjlk\") pod \"tuned-jhfcr\" (UID: \"ff2eb360-d34b-42f6-8427-4bf13c4cd407\") " pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.445206 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445170    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02314617-8ae9-46ef-bccc-536660fadb9b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.445206 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445220    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41ccf198-2ae4-4b4d-908b-dcdff0614253-agent-certs\") pod \"konnectivity-agent-bd6mt\" (UID: \"41ccf198-2ae4-4b4d-908b-dcdff0614253\") " pod="kube-system/konnectivity-agent-bd6mt"
Jul 07 18:50:53.445463 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445248    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-system-cni-dir\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.445463 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445274    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-multus-socket-dir-parent\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.445463 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445311    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-run-k8s-cni-cncf-io\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.445463 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445338    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-var-lib-cni-multus\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.445463 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445362    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eddf68ee-cdbb-4e8e-8b32-b86fb51faaec-serviceca\") pod \"node-ca-bbt8z\" (UID: \"eddf68ee-cdbb-4e8e-8b32-b86fb51faaec\") " pod="openshift-image-registry/node-ca-bbt8z"
Jul 07 18:50:53.445463 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445405    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-cni-binary-copy\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.445463 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445432    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqjbq\" (UniqueName: \"kubernetes.io/projected/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-kube-api-access-sqjbq\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.445810 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445468    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02314617-8ae9-46ef-bccc-536660fadb9b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.445810 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445501    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02314617-8ae9-46ef-bccc-536660fadb9b-cnibin\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.445810 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445544    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-var-lib-kubelet\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.445810 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445575    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jvzb\" (UniqueName: \"kubernetes.io/projected/02314617-8ae9-46ef-bccc-536660fadb9b-kube-api-access-8jvzb\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.445810 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445619    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxrcf\" (UniqueName: \"kubernetes.io/projected/85ef9f9d-7b7d-4153-9b73-575bec23fffd-kube-api-access-qxrcf\") pod \"iptables-alerter-qkvjx\" (UID: \"85ef9f9d-7b7d-4153-9b73-575bec23fffd\") " pod="openshift-network-operator/iptables-alerter-qkvjx"
Jul 07 18:50:53.445810 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445642    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-var-lib-cni-multus\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.445810 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445647    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnhff\" (UniqueName: \"kubernetes.io/projected/eb453689-3272-4296-8339-269354e1dd6f-kube-api-access-wnhff\") pod \"network-metrics-daemon-jm9g5\" (UID: \"eb453689-3272-4296-8339-269354e1dd6f\") " pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:50:53.445810 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445713    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02314617-8ae9-46ef-bccc-536660fadb9b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.445810 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445738    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85ef9f9d-7b7d-4153-9b73-575bec23fffd-host-slash\") pod \"iptables-alerter-qkvjx\" (UID: \"85ef9f9d-7b7d-4153-9b73-575bec23fffd\") " pod="openshift-network-operator/iptables-alerter-qkvjx"
Jul 07 18:50:53.445810 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445756    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41ccf198-2ae4-4b4d-908b-dcdff0614253-konnectivity-ca\") pod \"konnectivity-agent-bd6mt\" (UID: \"41ccf198-2ae4-4b4d-908b-dcdff0614253\") " pod="kube-system/konnectivity-agent-bd6mt"
Jul 07 18:50:53.445810 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445781    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85ef9f9d-7b7d-4153-9b73-575bec23fffd-iptables-alerter-script\") pod \"iptables-alerter-qkvjx\" (UID: \"85ef9f9d-7b7d-4153-9b73-575bec23fffd\") " pod="openshift-network-operator/iptables-alerter-qkvjx"
Jul 07 18:50:53.445810 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445804    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-multus-cni-dir\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445838    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c74d8\" (UniqueName: \"kubernetes.io/projected/eddf68ee-cdbb-4e8e-8b32-b86fb51faaec-kube-api-access-c74d8\") pod \"node-ca-bbt8z\" (UID: \"eddf68ee-cdbb-4e8e-8b32-b86fb51faaec\") " pod="openshift-image-registry/node-ca-bbt8z"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445881    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-os-release\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445909    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-run-netns\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445934    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-multus-conf-dir\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445959    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-multus-daemon-config\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.445994    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02314617-8ae9-46ef-bccc-536660fadb9b-system-cni-dir\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.446027    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-cnibin\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.446052    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs\") pod \"network-metrics-daemon-jm9g5\" (UID: \"eb453689-3272-4296-8339-269354e1dd6f\") " pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.446094    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02314617-8ae9-46ef-bccc-536660fadb9b-os-release\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.446141    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-var-lib-cni-bin\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.446167    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eddf68ee-cdbb-4e8e-8b32-b86fb51faaec-host\") pod \"node-ca-bbt8z\" (UID: \"eddf68ee-cdbb-4e8e-8b32-b86fb51faaec\") " pod="openshift-image-registry/node-ca-bbt8z"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.446203    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-hostroot\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.446227    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-run-multus-certs\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.446259    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-etc-kubernetes\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.446286    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02314617-8ae9-46ef-bccc-536660fadb9b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.446513 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.446460    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eddf68ee-cdbb-4e8e-8b32-b86fb51faaec-serviceca\") pod \"node-ca-bbt8z\" (UID: \"eddf68ee-cdbb-4e8e-8b32-b86fb51faaec\") " pod="openshift-image-registry/node-ca-bbt8z"
Jul 07 18:50:53.447330 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.446704    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02314617-8ae9-46ef-bccc-536660fadb9b-cnibin\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.447330 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.446912    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02314617-8ae9-46ef-bccc-536660fadb9b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.447330 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447075    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-cni-binary-copy\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.447330 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447299    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-var-lib-kubelet\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.447541 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447361    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-run-netns\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.447541 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447388    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02314617-8ae9-46ef-bccc-536660fadb9b-cni-binary-copy\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.447541 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447416    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02314617-8ae9-46ef-bccc-536660fadb9b-os-release\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.447541 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447443    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02314617-8ae9-46ef-bccc-536660fadb9b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.447541 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447456    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-var-lib-cni-bin\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.447541 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447475    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-multus-conf-dir\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.447541 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447520    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-hostroot\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.447931 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447529    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-system-cni-dir\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.447931 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447561    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eddf68ee-cdbb-4e8e-8b32-b86fb51faaec-host\") pod \"node-ca-bbt8z\" (UID: \"eddf68ee-cdbb-4e8e-8b32-b86fb51faaec\") " pod="openshift-image-registry/node-ca-bbt8z"
Jul 07 18:50:53.447931 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447596    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85ef9f9d-7b7d-4153-9b73-575bec23fffd-host-slash\") pod \"iptables-alerter-qkvjx\" (UID: \"85ef9f9d-7b7d-4153-9b73-575bec23fffd\") " pod="openshift-network-operator/iptables-alerter-qkvjx"
Jul 07 18:50:53.447931 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447604    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-run-multus-certs\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.447931 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447654    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-multus-socket-dir-parent\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.447931 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447647    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-etc-kubernetes\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.447931 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447681    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-cnibin\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.447931 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447708    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-multus-cni-dir\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.447931 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447707    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-host-run-k8s-cni-cncf-io\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.447931 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447737    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02314617-8ae9-46ef-bccc-536660fadb9b-system-cni-dir\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.447931 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.447853    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02314617-8ae9-46ef-bccc-536660fadb9b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.448491 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.448023    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-multus-daemon-config\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.448491 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.448129    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:53.448491 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.448153    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-os-release\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.448491 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.448190    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs podName:eb453689-3272-4296-8339-269354e1dd6f nodeName:}" failed. No retries permitted until 2026-07-07 18:50:53.948169807 +0000 UTC m=+3.107509629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs") pod "network-metrics-daemon-jm9g5" (UID: "eb453689-3272-4296-8339-269354e1dd6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:53.448491 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.448328    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85ef9f9d-7b7d-4153-9b73-575bec23fffd-iptables-alerter-script\") pod \"iptables-alerter-qkvjx\" (UID: \"85ef9f9d-7b7d-4153-9b73-575bec23fffd\") " pod="openshift-network-operator/iptables-alerter-qkvjx"
Jul 07 18:50:53.448491 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.448331    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41ccf198-2ae4-4b4d-908b-dcdff0614253-konnectivity-ca\") pod \"konnectivity-agent-bd6mt\" (UID: \"41ccf198-2ae4-4b4d-908b-dcdff0614253\") " pod="kube-system/konnectivity-agent-bd6mt"
Jul 07 18:50:53.450454 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.450428    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41ccf198-2ae4-4b4d-908b-dcdff0614253-agent-certs\") pod \"konnectivity-agent-bd6mt\" (UID: \"41ccf198-2ae4-4b4d-908b-dcdff0614253\") " pod="kube-system/konnectivity-agent-bd6mt"
Jul 07 18:50:53.457234 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.457151    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxrcf\" (UniqueName: \"kubernetes.io/projected/85ef9f9d-7b7d-4153-9b73-575bec23fffd-kube-api-access-qxrcf\") pod \"iptables-alerter-qkvjx\" (UID: \"85ef9f9d-7b7d-4153-9b73-575bec23fffd\") " pod="openshift-network-operator/iptables-alerter-qkvjx"
Jul 07 18:50:53.457234 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.457179    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnhff\" (UniqueName: \"kubernetes.io/projected/eb453689-3272-4296-8339-269354e1dd6f-kube-api-access-wnhff\") pod \"network-metrics-daemon-jm9g5\" (UID: \"eb453689-3272-4296-8339-269354e1dd6f\") " pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:50:53.458392 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.458372    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jvzb\" (UniqueName: \"kubernetes.io/projected/02314617-8ae9-46ef-bccc-536660fadb9b-kube-api-access-8jvzb\") pod \"multus-additional-cni-plugins-mf5t6\" (UID: \"02314617-8ae9-46ef-bccc-536660fadb9b\") " pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.458757 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.458731    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqjbq\" (UniqueName: \"kubernetes.io/projected/359eeb92-ae77-4fc6-8a25-b9cdedeb731e-kube-api-access-sqjbq\") pod \"multus-mdwzs\" (UID: \"359eeb92-ae77-4fc6-8a25-b9cdedeb731e\") " pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.459052 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.459036    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c74d8\" (UniqueName: \"kubernetes.io/projected/eddf68ee-cdbb-4e8e-8b32-b86fb51faaec-kube-api-access-c74d8\") pod \"node-ca-bbt8z\" (UID: \"eddf68ee-cdbb-4e8e-8b32-b86fb51faaec\") " pod="openshift-image-registry/node-ca-bbt8z"
Jul 07 18:50:53.526069 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.526032    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jhfcr"
Jul 07 18:50:53.534484 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.534450    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:50:53.536201 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:53.536167    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff2eb360_d34b_42f6_8427_4bf13c4cd407.slice/crio-f6cce1c4df762eff256f4f6ae7f845fac07adbb4be48e530e81c797a6148e8cc WatchSource:0}: Error finding container f6cce1c4df762eff256f4f6ae7f845fac07adbb4be48e530e81c797a6148e8cc: Status 404 returned error can't find the container with id f6cce1c4df762eff256f4f6ae7f845fac07adbb4be48e530e81c797a6148e8cc
Jul 07 18:50:53.541094 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.541042    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:50:53.543160 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.543137    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f5gzx"
Jul 07 18:50:53.545028 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:53.545003    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423f17ea_41e4_4dd9_91a0_5ce6d13f31ee.slice/crio-39653582cf0c4db4ed0fbca140aa205798751d476b8f15f6122066d7ed4b83a4 WatchSource:0}: Error finding container 39653582cf0c4db4ed0fbca140aa205798751d476b8f15f6122066d7ed4b83a4: Status 404 returned error can't find the container with id 39653582cf0c4db4ed0fbca140aa205798751d476b8f15f6122066d7ed4b83a4
Jul 07 18:50:53.549544 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.549377    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6"
Jul 07 18:50:53.558391 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.557726    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mdwzs"
Jul 07 18:50:53.560132 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:53.560106    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b51a62_f49b_476f_b8ba_be97ff5e075f.slice/crio-8fed78dcf2d22853a08901688990fe5fa2bd0b5d64890b345a6de95a6ae617af WatchSource:0}: Error finding container 8fed78dcf2d22853a08901688990fe5fa2bd0b5d64890b345a6de95a6ae617af: Status 404 returned error can't find the container with id 8fed78dcf2d22853a08901688990fe5fa2bd0b5d64890b345a6de95a6ae617af
Jul 07 18:50:53.566679 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.566650    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bbt8z"
Jul 07 18:50:53.569055 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:53.569033    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359eeb92_ae77_4fc6_8a25_b9cdedeb731e.slice/crio-0f6b889faaf9637b3cd4ed8448ef69f8ec8faca6fa4b691a785acc04eb3bfa65 WatchSource:0}: Error finding container 0f6b889faaf9637b3cd4ed8448ef69f8ec8faca6fa4b691a785acc04eb3bfa65: Status 404 returned error can't find the container with id 0f6b889faaf9637b3cd4ed8448ef69f8ec8faca6fa4b691a785acc04eb3bfa65
Jul 07 18:50:53.576379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.576216    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qkvjx"
Jul 07 18:50:53.576670 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:53.576646    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeddf68ee_cdbb_4e8e_8b32_b86fb51faaec.slice/crio-82bf7528813072be4b4d9181d728259ed2c5f2247d9a2292b9c4cba8bcf427f0 WatchSource:0}: Error finding container 82bf7528813072be4b4d9181d728259ed2c5f2247d9a2292b9c4cba8bcf427f0: Status 404 returned error can't find the container with id 82bf7528813072be4b4d9181d728259ed2c5f2247d9a2292b9c4cba8bcf427f0
Jul 07 18:50:53.583670 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.583649    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mf5t6"
Jul 07 18:50:53.586235 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:53.586206    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ef9f9d_7b7d_4153_9b73_575bec23fffd.slice/crio-1c3e1f4715fa15aef2692e1a105a742555221823b8a26b999662830fb8657c52 WatchSource:0}: Error finding container 1c3e1f4715fa15aef2692e1a105a742555221823b8a26b999662830fb8657c52: Status 404 returned error can't find the container with id 1c3e1f4715fa15aef2692e1a105a742555221823b8a26b999662830fb8657c52
Jul 07 18:50:53.590873 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.590848    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bd6mt"
Jul 07 18:50:53.593903 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:53.593850    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02314617_8ae9_46ef_bccc_536660fadb9b.slice/crio-532f86b846fa26e862f2aeba9e1747335290ead7859cedd419c53f912647a39b WatchSource:0}: Error finding container 532f86b846fa26e862f2aeba9e1747335290ead7859cedd419c53f912647a39b: Status 404 returned error can't find the container with id 532f86b846fa26e862f2aeba9e1747335290ead7859cedd419c53f912647a39b
Jul 07 18:50:53.601867 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:50:53.601840    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ccf198_2ae4_4b4d_908b_dcdff0614253.slice/crio-c7e3ef0279a46dcba74970dc4d98727381bfc4194f062d2cd0cfe42d2d0dcbc3 WatchSource:0}: Error finding container c7e3ef0279a46dcba74970dc4d98727381bfc4194f062d2cd0cfe42d2d0dcbc3: Status 404 returned error can't find the container with id c7e3ef0279a46dcba74970dc4d98727381bfc4194f062d2cd0cfe42d2d0dcbc3
Jul 07 18:50:53.849394 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.849300    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:53.849534 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.849447    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:53.849534 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.849520    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret podName:9467a0f3-0b26-4d87-b1de-0fcf62a224ec nodeName:}" failed. No retries permitted until 2026-07-07 18:50:54.849500216 +0000 UTC m=+4.008840023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret") pod "global-pull-secret-syncer-f76tc" (UID: "9467a0f3-0b26-4d87-b1de-0fcf62a224ec") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:53.950018 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.949979    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs\") pod \"network-metrics-daemon-jm9g5\" (UID: \"eb453689-3272-4296-8339-269354e1dd6f\") " pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:50:53.950183 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:53.950027    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvwx6\" (UniqueName: \"kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6\") pod \"network-check-target-tjsjj\" (UID: \"10195eeb-1db4-4853-98c9-dc7f19a59df0\") " pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:50:53.950183 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.950155    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:53.950183 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.950170    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:53.950333 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.950188    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:53.950333 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.950203    2554 projected.go:196] Error preparing data for projected volume kube-api-access-nvwx6 for pod openshift-network-diagnostics/network-check-target-tjsjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:53.950333 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.950239    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs podName:eb453689-3272-4296-8339-269354e1dd6f nodeName:}" failed. No retries permitted until 2026-07-07 18:50:54.950215001 +0000 UTC m=+4.109554822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs") pod "network-metrics-daemon-jm9g5" (UID: "eb453689-3272-4296-8339-269354e1dd6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:53.950333 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:53.950257    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6 podName:10195eeb-1db4-4853-98c9-dc7f19a59df0 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:54.950249828 +0000 UTC m=+4.109589634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvwx6" (UniqueName: "kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6") pod "network-check-target-tjsjj" (UID: "10195eeb-1db4-4853-98c9-dc7f19a59df0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:54.278282 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.278162    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:45:53 +0000 UTC" deadline="2028-04-19 01:04:15.930874868 +0000 UTC"
Jul 07 18:50:54.278282 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.278225    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15630h13m21.652654454s"
Jul 07 18:50:54.469192 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.469149    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:50:54.469365 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.469156    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:50:54.469365 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:54.469325    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:50:54.469365 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:54.469358    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:50:54.480340 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.480260    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qkvjx" event={"ID":"85ef9f9d-7b7d-4153-9b73-575bec23fffd","Type":"ContainerStarted","Data":"1c3e1f4715fa15aef2692e1a105a742555221823b8a26b999662830fb8657c52"}
Jul 07 18:50:54.482092 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.482012    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mdwzs" event={"ID":"359eeb92-ae77-4fc6-8a25-b9cdedeb731e","Type":"ContainerStarted","Data":"0f6b889faaf9637b3cd4ed8448ef69f8ec8faca6fa4b691a785acc04eb3bfa65"}
Jul 07 18:50:54.483487 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.483463    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f5gzx" event={"ID":"19bf2468-4a15-4e76-9c66-6d26e6a73d93","Type":"ContainerStarted","Data":"a7d2bd2a7f5320680e7e32b7777ab2e459001f43cbc5f85cd442cbc53abe79e8"}
Jul 07 18:50:54.484969 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.484943    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jhfcr" event={"ID":"ff2eb360-d34b-42f6-8427-4bf13c4cd407","Type":"ContainerStarted","Data":"f6cce1c4df762eff256f4f6ae7f845fac07adbb4be48e530e81c797a6148e8cc"}
Jul 07 18:50:54.486926 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.486892    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bd6mt" event={"ID":"41ccf198-2ae4-4b4d-908b-dcdff0614253","Type":"ContainerStarted","Data":"c7e3ef0279a46dcba74970dc4d98727381bfc4194f062d2cd0cfe42d2d0dcbc3"}
Jul 07 18:50:54.489028 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.489003    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf5t6" event={"ID":"02314617-8ae9-46ef-bccc-536660fadb9b","Type":"ContainerStarted","Data":"532f86b846fa26e862f2aeba9e1747335290ead7859cedd419c53f912647a39b"}
Jul 07 18:50:54.490476 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.490448    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bbt8z" event={"ID":"eddf68ee-cdbb-4e8e-8b32-b86fb51faaec","Type":"ContainerStarted","Data":"82bf7528813072be4b4d9181d728259ed2c5f2247d9a2292b9c4cba8bcf427f0"}
Jul 07 18:50:54.493273 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.493245    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6" event={"ID":"35b51a62-f49b-476f-b8ba-be97ff5e075f","Type":"ContainerStarted","Data":"8fed78dcf2d22853a08901688990fe5fa2bd0b5d64890b345a6de95a6ae617af"}
Jul 07 18:50:54.494984 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.494959    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg" event={"ID":"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee","Type":"ContainerStarted","Data":"39653582cf0c4db4ed0fbca140aa205798751d476b8f15f6122066d7ed4b83a4"}
Jul 07 18:50:54.858817 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.858772    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:54.859041 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:54.858956    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:54.859041 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:54.859026    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret podName:9467a0f3-0b26-4d87-b1de-0fcf62a224ec nodeName:}" failed. No retries permitted until 2026-07-07 18:50:56.85900547 +0000 UTC m=+6.018345279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret") pod "global-pull-secret-syncer-f76tc" (UID: "9467a0f3-0b26-4d87-b1de-0fcf62a224ec") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:54.959498 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.959451    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs\") pod \"network-metrics-daemon-jm9g5\" (UID: \"eb453689-3272-4296-8339-269354e1dd6f\") " pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:50:54.959671 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:54.959519    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvwx6\" (UniqueName: \"kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6\") pod \"network-check-target-tjsjj\" (UID: \"10195eeb-1db4-4853-98c9-dc7f19a59df0\") " pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:50:54.960452 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:54.959799    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:54.960452 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:54.959826    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:54.960452 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:54.959872    2554 projected.go:196] Error preparing data for projected volume kube-api-access-nvwx6 for pod openshift-network-diagnostics/network-check-target-tjsjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:54.960452 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:54.959940    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6 podName:10195eeb-1db4-4853-98c9-dc7f19a59df0 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:56.959920095 +0000 UTC m=+6.119259903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvwx6" (UniqueName: "kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6") pod "network-check-target-tjsjj" (UID: "10195eeb-1db4-4853-98c9-dc7f19a59df0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:54.960452 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:54.960378    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:54.960452 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:54.960429    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs podName:eb453689-3272-4296-8339-269354e1dd6f nodeName:}" failed. No retries permitted until 2026-07-07 18:50:56.960412985 +0000 UTC m=+6.119752793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs") pod "network-metrics-daemon-jm9g5" (UID: "eb453689-3272-4296-8339-269354e1dd6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:55.279212 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:55.279166    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:45:53 +0000 UTC" deadline="2027-12-29 18:23:15.767875226 +0000 UTC"
Jul 07 18:50:55.279212 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:55.279211    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12959h32m20.488669442s"
Jul 07 18:50:55.469915 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:55.469471    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:55.469915 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:55.469703    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:50:56.468353 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:56.468035    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:50:56.468974 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:56.468419    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:50:56.468974 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:56.468868    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:50:56.469090 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:56.469001    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:50:56.516893 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:56.516766    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal" event={"ID":"157622ff2cd69c4f1b3676d86c923065","Type":"ContainerStarted","Data":"4f39a95097f60cd559006ea01577fda945f6ca31b62efebecf565f50d7320e59"}
Jul 07 18:50:56.524037 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:56.523578    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal" event={"ID":"d92d5a692bdd8433c39950bab5b5ec7f","Type":"ContainerStarted","Data":"e700182ba036e9d4d81b4c6ee3694e3c685c3089e4d9045d24bdb78b329970bf"}
Jul 07 18:50:56.537748 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:56.537693    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-118.ec2.internal" podStartSLOduration=3.537674588 podStartE2EDuration="3.537674588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:56.537113535 +0000 UTC m=+5.696453390" watchObservedRunningTime="2026-07-07 18:50:56.537674588 +0000 UTC m=+5.697014418"
Jul 07 18:50:56.874156 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:56.874111    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:56.874364 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:56.874337    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:56.874438 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:56.874405    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret podName:9467a0f3-0b26-4d87-b1de-0fcf62a224ec nodeName:}" failed. No retries permitted until 2026-07-07 18:51:00.874386316 +0000 UTC m=+10.033726136 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret") pod "global-pull-secret-syncer-f76tc" (UID: "9467a0f3-0b26-4d87-b1de-0fcf62a224ec") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:50:56.975135 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:56.975092    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs\") pod \"network-metrics-daemon-jm9g5\" (UID: \"eb453689-3272-4296-8339-269354e1dd6f\") " pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:50:56.975317 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:56.975156    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvwx6\" (UniqueName: \"kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6\") pod \"network-check-target-tjsjj\" (UID: \"10195eeb-1db4-4853-98c9-dc7f19a59df0\") " pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:50:56.975381 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:56.975307    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:56.975381 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:56.975343    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:50:56.975381 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:56.975365    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:50:56.975381 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:56.975380    2554 projected.go:196] Error preparing data for projected volume kube-api-access-nvwx6 for pod openshift-network-diagnostics/network-check-target-tjsjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:56.975643 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:56.975389    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs podName:eb453689-3272-4296-8339-269354e1dd6f nodeName:}" failed. No retries permitted until 2026-07-07 18:51:00.975367011 +0000 UTC m=+10.134706820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs") pod "network-metrics-daemon-jm9g5" (UID: "eb453689-3272-4296-8339-269354e1dd6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:50:56.975643 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:56.975435    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6 podName:10195eeb-1db4-4853-98c9-dc7f19a59df0 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:00.975417184 +0000 UTC m=+10.134756994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvwx6" (UniqueName: "kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6") pod "network-check-target-tjsjj" (UID: "10195eeb-1db4-4853-98c9-dc7f19a59df0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:50:57.469188 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:57.469151    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:57.469705 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:57.469312    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:50:58.468170 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:58.468131    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:50:58.468170 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:58.468164    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:50:58.468447 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:58.468272    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:50:58.468447 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:58.468426    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:50:59.469021 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:59.468780    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:50:59.469021 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:50:59.468931    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:50:59.535440 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:59.535125    2554 generic.go:356] "Generic (PLEG): container finished" podID="d92d5a692bdd8433c39950bab5b5ec7f" containerID="e700182ba036e9d4d81b4c6ee3694e3c685c3089e4d9045d24bdb78b329970bf" exitCode=0
Jul 07 18:50:59.535440 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:50:59.535242    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal" event={"ID":"d92d5a692bdd8433c39950bab5b5ec7f","Type":"ContainerDied","Data":"e700182ba036e9d4d81b4c6ee3694e3c685c3089e4d9045d24bdb78b329970bf"}
Jul 07 18:51:00.468645 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:00.468610    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:00.468645 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:00.468651    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:00.468927 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:00.468764    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:00.469123 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:00.469077    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:00.908744 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:00.908707    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:00.908936 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:00.908914    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:51:00.909015 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:00.908999    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret podName:9467a0f3-0b26-4d87-b1de-0fcf62a224ec nodeName:}" failed. No retries permitted until 2026-07-07 18:51:08.908976581 +0000 UTC m=+18.068316391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret") pod "global-pull-secret-syncer-f76tc" (UID: "9467a0f3-0b26-4d87-b1de-0fcf62a224ec") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:51:01.009641 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:01.009602    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs\") pod \"network-metrics-daemon-jm9g5\" (UID: \"eb453689-3272-4296-8339-269354e1dd6f\") " pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:01.009804 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:01.009646    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvwx6\" (UniqueName: \"kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6\") pod \"network-check-target-tjsjj\" (UID: \"10195eeb-1db4-4853-98c9-dc7f19a59df0\") " pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:01.009804 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:01.009766    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:51:01.009804 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:01.009780    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:51:01.009804 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:01.009795    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:51:01.009804 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:01.009809    2554 projected.go:196] Error preparing data for projected volume kube-api-access-nvwx6 for pod openshift-network-diagnostics/network-check-target-tjsjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:51:01.010018 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:01.009856    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs podName:eb453689-3272-4296-8339-269354e1dd6f nodeName:}" failed. No retries permitted until 2026-07-07 18:51:09.009835298 +0000 UTC m=+18.169175116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs") pod "network-metrics-daemon-jm9g5" (UID: "eb453689-3272-4296-8339-269354e1dd6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:51:01.010018 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:01.009876    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6 podName:10195eeb-1db4-4853-98c9-dc7f19a59df0 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:09.009866127 +0000 UTC m=+18.169205937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvwx6" (UniqueName: "kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6") pod "network-check-target-tjsjj" (UID: "10195eeb-1db4-4853-98c9-dc7f19a59df0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:51:01.469709 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:01.469214    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:01.469709 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:01.469337    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:02.468431 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:02.468393    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:02.468431 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:02.468429    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:02.468631 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:02.468553    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:02.468680 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:02.468662    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:03.468862 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:03.468760    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:03.469318 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:03.468920    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:04.468899 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:04.468732    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:04.468899 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:04.468777    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:04.468899 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:04.468865    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:04.469426 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:04.468984    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:05.468286 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:05.468056    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:05.468429 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:05.468334    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:05.551164 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:05.551081    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f5gzx" event={"ID":"19bf2468-4a15-4e76-9c66-6d26e6a73d93","Type":"ContainerStarted","Data":"05bd768d98387d28bcca16786a5a3f276091876663833243d4b08d7fb8bb520b"}
Jul 07 18:51:05.553491 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:05.553460    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jhfcr" event={"ID":"ff2eb360-d34b-42f6-8427-4bf13c4cd407","Type":"ContainerStarted","Data":"1a850f3291c81a6b6d3e64f144920a99c3093648ad49dfd476c72804b4c506d3"}
Jul 07 18:51:05.555816 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:05.555771    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal" event={"ID":"d92d5a692bdd8433c39950bab5b5ec7f","Type":"ContainerStarted","Data":"18be8ce7c8f6048a259eef0f8a002a3d85b15eacaa51418755d740d31acf471a"}
Jul 07 18:51:05.557534 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:05.557511    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bd6mt" event={"ID":"41ccf198-2ae4-4b4d-908b-dcdff0614253","Type":"ContainerStarted","Data":"1f47f8447fe6d8c6a4838d7ec5a39cbf143904c2f5d6a99814a699601b757c2b"}
Jul 07 18:51:05.559603 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:05.559476    2554 generic.go:356] "Generic (PLEG): container finished" podID="02314617-8ae9-46ef-bccc-536660fadb9b" containerID="c4eafcf2040a2fd6c3a0de947bb07fb958089aaa631f0485703459fa7f530109" exitCode=0
Jul 07 18:51:05.559603 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:05.559562    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf5t6" event={"ID":"02314617-8ae9-46ef-bccc-536660fadb9b","Type":"ContainerDied","Data":"c4eafcf2040a2fd6c3a0de947bb07fb958089aaa631f0485703459fa7f530109"}
Jul 07 18:51:05.562145 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:05.562104    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bbt8z" event={"ID":"eddf68ee-cdbb-4e8e-8b32-b86fb51faaec","Type":"ContainerStarted","Data":"ae05473221e3e4444dfb17db3c40663ec87608122f97adcee3e91fd6c71989b2"}
Jul 07 18:51:05.563922 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:05.563898    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6" event={"ID":"35b51a62-f49b-476f-b8ba-be97ff5e075f","Type":"ContainerStarted","Data":"be74e09ce6245faf88d23040644f83d62856be0f37a6161e54a651dec7f3d02c"}
Jul 07 18:51:05.567552 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:05.567506    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f5gzx" podStartSLOduration=2.800505931 podStartE2EDuration="13.567490597s" totalImagesPullingTime="10.766984666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:05.567171746 +0000 UTC m=+14.726511606" watchObservedRunningTime="2026-07-07 18:51:05.567490597 +0000 UTC m=+14.726830424"
Jul 07 18:51:05.609616 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:05.609571    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jhfcr" podStartSLOduration=2.611988807 podStartE2EDuration="13.609554823s" totalImagesPullingTime="10.997566016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:05.609341973 +0000 UTC m=+14.768681802" watchObservedRunningTime="2026-07-07 18:51:05.609554823 +0000 UTC m=+14.768894653"
Jul 07 18:51:05.624409 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:05.624369    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bd6mt" podStartSLOduration=2.912156021 podStartE2EDuration="13.624353834s" totalImagesPullingTime="10.712197813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:05.624240409 +0000 UTC m=+14.783580237" watchObservedRunningTime="2026-07-07 18:51:05.624353834 +0000 UTC m=+14.783693661"
Jul 07 18:51:05.639175 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:05.639133    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-118.ec2.internal" podStartSLOduration=12.639121781 podStartE2EDuration="12.639121781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:05.638874515 +0000 UTC m=+14.798214367" watchObservedRunningTime="2026-07-07 18:51:05.639121781 +0000 UTC m=+14.798461609"
Jul 07 18:51:05.662244 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:05.662201    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bbt8z" podStartSLOduration=2.926491175 podStartE2EDuration="13.662184061s" totalImagesPullingTime="10.735692886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:05.662103148 +0000 UTC m=+14.821443010" watchObservedRunningTime="2026-07-07 18:51:05.662184061 +0000 UTC m=+14.821523888"
Jul 07 18:51:06.161710 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:06.161672    2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 18:51:06.297064 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:06.296937    2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T18:51:06.161693912Z","UUID":"ce1c58f2-461d-4ebc-acec-35fcbb6f615d","Handler":null,"Name":"","Endpoint":""}
Jul 07 18:51:06.298751 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:06.298726    2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 18:51:06.298880 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:06.298773    2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 18:51:06.468348 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:06.468316    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:06.468502 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:06.468442    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:06.468768 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:06.468743    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:06.468920 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:06.468892    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:06.570319 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:06.570236    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6" event={"ID":"35b51a62-f49b-476f-b8ba-be97ff5e075f","Type":"ContainerStarted","Data":"dab4d8fb153a12eb8241e277e228bb6a9cec11a0fbe81bdb9392aa0fcc0db67f"}
Jul 07 18:51:06.573907 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:06.573873    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qkvjx" event={"ID":"85ef9f9d-7b7d-4153-9b73-575bec23fffd","Type":"ContainerStarted","Data":"561ca3e2257cd8af92e73fd2a59b50b514047fd97fc832a7a794553b12c11041"}
Jul 07 18:51:06.592475 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:06.592165    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qkvjx" podStartSLOduration=3.863352615 podStartE2EDuration="14.592146597s" totalImagesPullingTime="10.728793982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:06.591294576 +0000 UTC m=+15.750634403" watchObservedRunningTime="2026-07-07 18:51:06.592146597 +0000 UTC m=+15.751486424"
Jul 07 18:51:06.964902 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:06.964814    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bd6mt"
Jul 07 18:51:06.965904 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:06.965879    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bd6mt"
Jul 07 18:51:07.469079 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:07.469049    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:07.469234 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:07.469179    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:07.578743 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:07.578608    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6" event={"ID":"35b51a62-f49b-476f-b8ba-be97ff5e075f","Type":"ContainerStarted","Data":"fc4cff30c2f8d145e92f15956945bb2a1d1e28a328a36f72a68414d8cda03289"}
Jul 07 18:51:07.598735 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:07.598372    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p8gg6" podStartSLOduration=2.499540613 podStartE2EDuration="15.59834853s" totalImagesPullingTime="13.098807917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:07.597505381 +0000 UTC m=+16.756845229" watchObservedRunningTime="2026-07-07 18:51:07.59834853 +0000 UTC m=+16.757688351"
Jul 07 18:51:08.468224 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:08.468190    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:08.468449 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:08.468230    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:08.468449 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:08.468342    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:08.468570 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:08.468449    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:08.580411 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:08.580380    2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 18:51:08.977464 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:08.977418    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:08.977643 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:08.977580    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:51:08.977708 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:08.977659    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret podName:9467a0f3-0b26-4d87-b1de-0fcf62a224ec nodeName:}" failed. No retries permitted until 2026-07-07 18:51:24.977637155 +0000 UTC m=+34.136976963 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret") pod "global-pull-secret-syncer-f76tc" (UID: "9467a0f3-0b26-4d87-b1de-0fcf62a224ec") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:51:09.078089 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:09.078056    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs\") pod \"network-metrics-daemon-jm9g5\" (UID: \"eb453689-3272-4296-8339-269354e1dd6f\") " pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:09.078247 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:09.078097    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvwx6\" (UniqueName: \"kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6\") pod \"network-check-target-tjsjj\" (UID: \"10195eeb-1db4-4853-98c9-dc7f19a59df0\") " pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:09.078305 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:09.078284    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:51:09.078369 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:09.078321    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:51:09.078369 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:09.078344    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:51:09.078369 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:09.078357    2554 projected.go:196] Error preparing data for projected volume kube-api-access-nvwx6 for pod openshift-network-diagnostics/network-check-target-tjsjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:51:09.078514 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:09.078378    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs podName:eb453689-3272-4296-8339-269354e1dd6f nodeName:}" failed. No retries permitted until 2026-07-07 18:51:25.078354939 +0000 UTC m=+34.237694757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs") pod "network-metrics-daemon-jm9g5" (UID: "eb453689-3272-4296-8339-269354e1dd6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:51:09.078514 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:09.078406    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6 podName:10195eeb-1db4-4853-98c9-dc7f19a59df0 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:25.078390034 +0000 UTC m=+34.237729854 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvwx6" (UniqueName: "kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6") pod "network-check-target-tjsjj" (UID: "10195eeb-1db4-4853-98c9-dc7f19a59df0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:51:09.469071 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:09.468857    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:09.469071 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:09.468995    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:10.468938 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:10.468909    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:10.469524 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:10.468947    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:10.469524 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:10.469017    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:10.469524 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:10.469137    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:11.469530 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:11.469344    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:11.469991 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:11.469592    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:12.468097 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:12.468063    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:12.468268 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:12.468070    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:12.468268 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:12.468185    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:12.468397 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:12.468305    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:12.906736 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:12.903493    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bd6mt_41ccf198-2ae4-4b4d-908b-dcdff0614253/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:13.027430 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:13.027393    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bd6mt_41ccf198-2ae4-4b4d-908b-dcdff0614253/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:13.471927 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:13.471899    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:13.472115 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:13.472007    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:14.148034 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:14.147979    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bd6mt_41ccf198-2ae4-4b4d-908b-dcdff0614253/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:14.210063 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:14.210026    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bd6mt_41ccf198-2ae4-4b4d-908b-dcdff0614253/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:14.468471 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:14.468389    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:14.468736 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:14.468394    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:14.468736 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:14.468504    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:14.468736 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:14.468613    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:15.468591 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:15.468553    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:15.469081 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:15.468676    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:16.468706 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:16.468669    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:16.469175 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:16.468714    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:16.469175 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:16.468828    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:16.469175 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:16.468898    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:17.469174 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:17.469140    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:17.469544 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:17.469291    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:17.601429 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:17.601397    2554 generic.go:356] "Generic (PLEG): container finished" podID="02314617-8ae9-46ef-bccc-536660fadb9b" containerID="fe586473e8fc6385504630c11024489867bd24cbf11a921ddd5201af9d46769e" exitCode=0
Jul 07 18:51:17.601540 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:17.601470    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf5t6" event={"ID":"02314617-8ae9-46ef-bccc-536660fadb9b","Type":"ContainerDied","Data":"fe586473e8fc6385504630c11024489867bd24cbf11a921ddd5201af9d46769e"}
Jul 07 18:51:17.602980 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:17.602965    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 18:51:17.603301 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:17.603281    2554 generic.go:356] "Generic (PLEG): container finished" podID="423f17ea-41e4-4dd9-91a0-5ce6d13f31ee" containerID="ef1e9e64b811dbf15bf2c03f72fac88be5c7ca4bcd59c351133c8284dc55d540" exitCode=1
Jul 07 18:51:17.603375 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:17.603353    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg" event={"ID":"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee","Type":"ContainerDied","Data":"ef1e9e64b811dbf15bf2c03f72fac88be5c7ca4bcd59c351133c8284dc55d540"}
Jul 07 18:51:17.603452 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:17.603435    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg" event={"ID":"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee","Type":"ContainerStarted","Data":"f502bd578a60b3ea154d2d737215534a806a72aa189524c50f51c81e28d6b608"}
Jul 07 18:51:17.604678 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:17.604657    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mdwzs" event={"ID":"359eeb92-ae77-4fc6-8a25-b9cdedeb731e","Type":"ContainerStarted","Data":"61b74a1a9c51777f1f601c4b3e8431894c8bf0ac5743591125d55ad96eb7f99d"}
Jul 07 18:51:17.765223 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:17.765195    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bd6mt_41ccf198-2ae4-4b4d-908b-dcdff0614253/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:17.867026 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:17.867000    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bd6mt_41ccf198-2ae4-4b4d-908b-dcdff0614253/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:18.017613 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:18.017576    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bd6mt_41ccf198-2ae4-4b4d-908b-dcdff0614253/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:18.468869 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:18.468837    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:18.469059 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:18.468837    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:18.469059 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:18.468955    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:18.469059 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:18.469027    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:18.609076 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:18.609012    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 18:51:18.609566 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:18.609346    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg" event={"ID":"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee","Type":"ContainerStarted","Data":"988154890c5c192a4ea3f8af4c3f2649d96c0ee1c0100441782c8b1f75a72ffa"}
Jul 07 18:51:18.609566 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:18.609419    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg" event={"ID":"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee","Type":"ContainerStarted","Data":"79b65455e27b679caceb104727493082da4bcfa847ad430a030d9b14a58a2351"}
Jul 07 18:51:18.609566 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:18.609453    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg" event={"ID":"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee","Type":"ContainerStarted","Data":"535b68b65998c698a55f9f9a97e59ac7c1bc8faee3d21d290c9791120082b11f"}
Jul 07 18:51:18.609566 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:18.609486    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg" event={"ID":"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee","Type":"ContainerStarted","Data":"a2073afa1d87607d3c536c890827c83ccc7cd6f017963631282935a5999c9f8e"}
Jul 07 18:51:19.468506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:19.468470    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:19.468740 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:19.468583    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:19.613901 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:19.613865    2554 generic.go:356] "Generic (PLEG): container finished" podID="02314617-8ae9-46ef-bccc-536660fadb9b" containerID="e1bb464f6a7b96657c825b815e4316b036ce329191479decf5084120b552659c" exitCode=0
Jul 07 18:51:19.614286 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:19.613920    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf5t6" event={"ID":"02314617-8ae9-46ef-bccc-536660fadb9b","Type":"ContainerDied","Data":"e1bb464f6a7b96657c825b815e4316b036ce329191479decf5084120b552659c"}
Jul 07 18:51:19.651937 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:19.651885    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mdwzs" podStartSLOduration=3.934316767 podStartE2EDuration="27.651870019s" totalImagesPullingTime="23.717553252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:17.644254302 +0000 UTC m=+26.803594128" watchObservedRunningTime="2026-07-07 18:51:19.651870019 +0000 UTC m=+28.811209849"
Jul 07 18:51:20.468199 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:20.468169    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:20.468199 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:20.468206    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:20.468392 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:20.468279    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:20.468444 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:20.468414    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:20.618930 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:20.618907    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 18:51:20.619376 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:20.619347    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg" event={"ID":"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee","Type":"ContainerStarted","Data":"777c8b0e60e3c1090aaa7b864fa607d0d4420d9a61743dc6d066dc2bf2f4e4ff"}
Jul 07 18:51:20.621516 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:20.621488    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf5t6" event={"ID":"02314617-8ae9-46ef-bccc-536660fadb9b","Type":"ContainerStarted","Data":"9a77de7b30aeb632f08c7261d317c6e4138366afa5f0d81375e7dc612ad335e9"}
Jul 07 18:51:20.863691 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:20.863651    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bd6mt_41ccf198-2ae4-4b4d-908b-dcdff0614253/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:20.963757 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:20.963727    2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bd6mt_41ccf198-2ae4-4b4d-908b-dcdff0614253/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:21.473930 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:21.473903    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:21.474106 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:21.474006    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:21.625737 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:21.625696    2554 generic.go:356] "Generic (PLEG): container finished" podID="02314617-8ae9-46ef-bccc-536660fadb9b" containerID="9a77de7b30aeb632f08c7261d317c6e4138366afa5f0d81375e7dc612ad335e9" exitCode=0
Jul 07 18:51:21.626220 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:21.625760    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf5t6" event={"ID":"02314617-8ae9-46ef-bccc-536660fadb9b","Type":"ContainerDied","Data":"9a77de7b30aeb632f08c7261d317c6e4138366afa5f0d81375e7dc612ad335e9"}
Jul 07 18:51:22.468760 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:22.468498    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:22.468760 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:22.468566    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:22.469010 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:22.468813    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:22.469010 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:22.468864    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:22.632942 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:22.632919    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 18:51:22.633383 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:22.633293    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg" event={"ID":"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee","Type":"ContainerStarted","Data":"31b87448eab2dc789161e511fa224f206618d46be13dc146be6d12452ed7d825"}
Jul 07 18:51:22.633777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:22.633571    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:51:22.633777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:22.633640    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:51:22.633777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:22.633691    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:51:22.633986 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:22.633856    2554 scope.go:117] "RemoveContainer" containerID="ef1e9e64b811dbf15bf2c03f72fac88be5c7ca4bcd59c351133c8284dc55d540"
Jul 07 18:51:22.654534 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:22.654513    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:51:22.654767 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:22.654755    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:51:22.828364 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:22.828332    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bd6mt"
Jul 07 18:51:22.828531 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:22.828471    2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 18:51:22.828958 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:22.828938    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bd6mt"
Jul 07 18:51:23.468727 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:23.468692    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:23.468936 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:23.468840    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:23.640424 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:23.640392    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 18:51:23.640864 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:23.640837    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg" event={"ID":"423f17ea-41e4-4dd9-91a0-5ce6d13f31ee","Type":"ContainerStarted","Data":"02407d17013efa65febab573c2350a2619c610f9c406f8f0b54a91df7f69e091"}
Jul 07 18:51:23.674377 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:23.674323    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg" podStartSLOduration=7.894711177 podStartE2EDuration="31.674307953s" totalImagesPullingTime="23.779596776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:23.672933 +0000 UTC m=+32.832272845" watchObservedRunningTime="2026-07-07 18:51:23.674307953 +0000 UTC m=+32.833647780"
Jul 07 18:51:24.468595 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:24.468560    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:24.468595 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:24.468580    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:24.468818 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:24.468774    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:24.468922 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:24.468897    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:24.549314 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:24.549281    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f76tc"]
Jul 07 18:51:24.549458 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:24.549391    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:24.549497 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:24.549479    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:24.553212 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:24.553188    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jm9g5"]
Jul 07 18:51:24.565759 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:24.565733    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tjsjj"]
Jul 07 18:51:24.643930 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:24.643822    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:24.643930 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:24.643835    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:24.644445 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:24.643939    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:24.644509 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:24.644461    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:25.001099 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:25.001063    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:25.001326 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:25.001205    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:51:25.001326 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:25.001267    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret podName:9467a0f3-0b26-4d87-b1de-0fcf62a224ec nodeName:}" failed. No retries permitted until 2026-07-07 18:51:57.001246908 +0000 UTC m=+66.160586712 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret") pod "global-pull-secret-syncer-f76tc" (UID: "9467a0f3-0b26-4d87-b1de-0fcf62a224ec") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:51:25.102229 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:25.102190    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs\") pod \"network-metrics-daemon-jm9g5\" (UID: \"eb453689-3272-4296-8339-269354e1dd6f\") " pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:25.102229 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:25.102241    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvwx6\" (UniqueName: \"kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6\") pod \"network-check-target-tjsjj\" (UID: \"10195eeb-1db4-4853-98c9-dc7f19a59df0\") " pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:25.102471 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:25.102353    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:51:25.102471 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:25.102388    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:51:25.102471 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:25.102409    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:51:25.102471 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:25.102421    2554 projected.go:196] Error preparing data for projected volume kube-api-access-nvwx6 for pod openshift-network-diagnostics/network-check-target-tjsjj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:51:25.102471 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:25.102430    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs podName:eb453689-3272-4296-8339-269354e1dd6f nodeName:}" failed. No retries permitted until 2026-07-07 18:51:57.102403737 +0000 UTC m=+66.261743551 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs") pod "network-metrics-daemon-jm9g5" (UID: "eb453689-3272-4296-8339-269354e1dd6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:51:25.102471 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:25.102459    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6 podName:10195eeb-1db4-4853-98c9-dc7f19a59df0 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:57.102448301 +0000 UTC m=+66.261788105 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nvwx6" (UniqueName: "kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6") pod "network-check-target-tjsjj" (UID: "10195eeb-1db4-4853-98c9-dc7f19a59df0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:51:26.468890 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:26.468851    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:26.469286 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:26.468862    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:26.469286 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:26.468986    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:26.469286 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:26.468862    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:26.469286 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:26.469048    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:26.469286 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:26.469133    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:27.652757 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:27.652726    2554 generic.go:356] "Generic (PLEG): container finished" podID="02314617-8ae9-46ef-bccc-536660fadb9b" containerID="bda93f932c80c65e2bd451a7f5094142f5b9ff71a49c772181e2b195cdcebafb" exitCode=0
Jul 07 18:51:27.653244 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:27.652788    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf5t6" event={"ID":"02314617-8ae9-46ef-bccc-536660fadb9b","Type":"ContainerDied","Data":"bda93f932c80c65e2bd451a7f5094142f5b9ff71a49c772181e2b195cdcebafb"}
Jul 07 18:51:28.468931 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:28.468850    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:28.469104 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:28.468939    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:28.469104 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:28.468944    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:28.469104 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:28.468951    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:28.469104 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:28.469023    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:28.469104 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:28.469088    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:28.657367 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:28.657336    2554 generic.go:356] "Generic (PLEG): container finished" podID="02314617-8ae9-46ef-bccc-536660fadb9b" containerID="01dd30407eb88ad8fff8f960c63ab9cd155efead998b889d1413efd1ba901964" exitCode=0
Jul 07 18:51:28.657815 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:28.657387    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf5t6" event={"ID":"02314617-8ae9-46ef-bccc-536660fadb9b","Type":"ContainerDied","Data":"01dd30407eb88ad8fff8f960c63ab9cd155efead998b889d1413efd1ba901964"}
Jul 07 18:51:29.662314 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:29.662275    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mf5t6" event={"ID":"02314617-8ae9-46ef-bccc-536660fadb9b","Type":"ContainerStarted","Data":"af48dd70a3e2b2dcbbcfd6f91675f4e4f312a703511af71ca7258532ef521b5c"}
Jul 07 18:51:29.687510 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:29.687455    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mf5t6" podStartSLOduration=7.697523331 podStartE2EDuration="37.687441504s" totalImagesPullingTime="29.989918173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:29.687229247 +0000 UTC m=+38.846569085" watchObservedRunningTime="2026-07-07 18:51:29.687441504 +0000 UTC m=+38.846781329"
Jul 07 18:51:30.468544 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:30.468510    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:30.468707 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:30.468510    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:30.468707 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:30.468602    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tjsjj" podUID="10195eeb-1db4-4853-98c9-dc7f19a59df0"
Jul 07 18:51:30.468707 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:30.468675    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76tc" podUID="9467a0f3-0b26-4d87-b1de-0fcf62a224ec"
Jul 07 18:51:30.468707 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:30.468510    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:30.468850 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:30.468747    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jm9g5" podUID="eb453689-3272-4296-8339-269354e1dd6f"
Jul 07 18:51:31.071612 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.071587    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-118.ec2.internal" event="NodeReady"
Jul 07 18:51:31.072087 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.071724    2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 18:51:31.106435 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.106411    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65d4cf4b84-qzhjn"]
Jul 07 18:51:31.120112 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.120082    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z4g8n"]
Jul 07 18:51:31.120248 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.120204    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.123834 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.123806    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 18:51:31.124108 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.124088    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 18:51:31.124379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.124360    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rtr89\""
Jul 07 18:51:31.124379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.124377    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 18:51:31.133086 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.133062    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 18:51:31.134130 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.134110    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-44ls7"]
Jul 07 18:51:31.134236 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.134219    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:31.137186 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.137069    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 18:51:31.137186 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.137082    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 18:51:31.137379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.137364    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-crmbz\""
Jul 07 18:51:31.156237 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.156221    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65d4cf4b84-qzhjn"]
Jul 07 18:51:31.156330 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.156246    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-44ls7"]
Jul 07 18:51:31.156330 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.156259    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z4g8n"]
Jul 07 18:51:31.156400 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.156329    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-44ls7"
Jul 07 18:51:31.159487 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.159471    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 18:51:31.159723 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.159704    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 18:51:31.159872 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.159856    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 18:51:31.159949 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.159918    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zsh2j\""
Jul 07 18:51:31.252355 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.252310    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8400145-1a5f-4af0-9788-2220d231366b-cert\") pod \"ingress-canary-44ls7\" (UID: \"c8400145-1a5f-4af0-9788-2220d231366b\") " pod="openshift-ingress-canary/ingress-canary-44ls7"
Jul 07 18:51:31.252506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.252368    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efc607-8f96-4303-85d3-b9fc7d708d4e-installation-pull-secrets\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.252506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.252392    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efc607-8f96-4303-85d3-b9fc7d708d4e-trusted-ca\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.252506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.252463    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efc607-8f96-4303-85d3-b9fc7d708d4e-ca-trust-extracted\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.252506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.252486    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:31.252506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.252504    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhx5s\" (UniqueName: \"kubernetes.io/projected/c8400145-1a5f-4af0-9788-2220d231366b-kube-api-access-bhx5s\") pod \"ingress-canary-44ls7\" (UID: \"c8400145-1a5f-4af0-9788-2220d231366b\") " pod="openshift-ingress-canary/ingress-canary-44ls7"
Jul 07 18:51:31.252662 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.252524    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6511f0b7-aea0-4426-94dc-005303e704a9-tmp-dir\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:31.252662 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.252551    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efc607-8f96-4303-85d3-b9fc7d708d4e-image-registry-private-configuration\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.252662 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.252567    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.252662 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.252597    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-certificates\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.252662 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.252632    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-bound-sa-token\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.252662 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.252646    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbdtj\" (UniqueName: \"kubernetes.io/projected/6511f0b7-aea0-4426-94dc-005303e704a9-kube-api-access-xbdtj\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:31.252862 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.252720    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlcrx\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-kube-api-access-nlcrx\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.252862 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.252764    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6511f0b7-aea0-4426-94dc-005303e704a9-config-volume\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:31.353429 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353361    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efc607-8f96-4303-85d3-b9fc7d708d4e-ca-trust-extracted\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.353429 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353395    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:31.353429 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353413    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhx5s\" (UniqueName: \"kubernetes.io/projected/c8400145-1a5f-4af0-9788-2220d231366b-kube-api-access-bhx5s\") pod \"ingress-canary-44ls7\" (UID: \"c8400145-1a5f-4af0-9788-2220d231366b\") " pod="openshift-ingress-canary/ingress-canary-44ls7"
Jul 07 18:51:31.353625 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:31.353497    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:51:31.353625 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353536    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6511f0b7-aea0-4426-94dc-005303e704a9-tmp-dir\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:31.353625 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:31.353556    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls podName:6511f0b7-aea0-4426-94dc-005303e704a9 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:31.853541164 +0000 UTC m=+41.012880971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls") pod "dns-default-z4g8n" (UID: "6511f0b7-aea0-4426-94dc-005303e704a9") : secret "dns-default-metrics-tls" not found
Jul 07 18:51:31.353625 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353586    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efc607-8f96-4303-85d3-b9fc7d708d4e-image-registry-private-configuration\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.353625 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353605    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.353625 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353622    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-certificates\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.353950 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353647    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-bound-sa-token\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.353950 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353671    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbdtj\" (UniqueName: \"kubernetes.io/projected/6511f0b7-aea0-4426-94dc-005303e704a9-kube-api-access-xbdtj\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:31.353950 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353718    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlcrx\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-kube-api-access-nlcrx\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.353950 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:31.353723    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:51:31.353950 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:31.353738    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d4cf4b84-qzhjn: secret "image-registry-tls" not found
Jul 07 18:51:31.353950 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353737    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efc607-8f96-4303-85d3-b9fc7d708d4e-ca-trust-extracted\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.353950 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353747    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6511f0b7-aea0-4426-94dc-005303e704a9-config-volume\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:31.353950 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:31.353788    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls podName:a7efc607-8f96-4303-85d3-b9fc7d708d4e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:31.853772826 +0000 UTC m=+41.013112636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls") pod "image-registry-65d4cf4b84-qzhjn" (UID: "a7efc607-8f96-4303-85d3-b9fc7d708d4e") : secret "image-registry-tls" not found
Jul 07 18:51:31.353950 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353820    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6511f0b7-aea0-4426-94dc-005303e704a9-tmp-dir\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:31.353950 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353845    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8400145-1a5f-4af0-9788-2220d231366b-cert\") pod \"ingress-canary-44ls7\" (UID: \"c8400145-1a5f-4af0-9788-2220d231366b\") " pod="openshift-ingress-canary/ingress-canary-44ls7"
Jul 07 18:51:31.353950 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353867    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efc607-8f96-4303-85d3-b9fc7d708d4e-installation-pull-secrets\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.353950 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.353903    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efc607-8f96-4303-85d3-b9fc7d708d4e-trusted-ca\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.354493 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.354301    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-certificates\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.354493 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.354335    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6511f0b7-aea0-4426-94dc-005303e704a9-config-volume\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:31.354737 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.354710    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efc607-8f96-4303-85d3-b9fc7d708d4e-trusted-ca\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.357602 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.357577    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efc607-8f96-4303-85d3-b9fc7d708d4e-image-registry-private-configuration\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.357697 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.357603    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8400145-1a5f-4af0-9788-2220d231366b-cert\") pod \"ingress-canary-44ls7\" (UID: \"c8400145-1a5f-4af0-9788-2220d231366b\") " pod="openshift-ingress-canary/ingress-canary-44ls7"
Jul 07 18:51:31.357697 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.357633    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efc607-8f96-4303-85d3-b9fc7d708d4e-installation-pull-secrets\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.371088 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.371065    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbdtj\" (UniqueName: \"kubernetes.io/projected/6511f0b7-aea0-4426-94dc-005303e704a9-kube-api-access-xbdtj\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:31.371088 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.371083    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhx5s\" (UniqueName: \"kubernetes.io/projected/c8400145-1a5f-4af0-9788-2220d231366b-kube-api-access-bhx5s\") pod \"ingress-canary-44ls7\" (UID: \"c8400145-1a5f-4af0-9788-2220d231366b\") " pod="openshift-ingress-canary/ingress-canary-44ls7"
Jul 07 18:51:31.371222 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.371086    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-bound-sa-token\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.371255 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.371219    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlcrx\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-kube-api-access-nlcrx\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.463658 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.463623    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-44ls7"
Jul 07 18:51:31.670521 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.670352    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-44ls7"]
Jul 07 18:51:31.674194 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:51:31.674167    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8400145_1a5f_4af0_9788_2220d231366b.slice/crio-9bb734c6901f21896589c46aaccbad9657491f76407b235bbc8c9c2277c7513c WatchSource:0}: Error finding container 9bb734c6901f21896589c46aaccbad9657491f76407b235bbc8c9c2277c7513c: Status 404 returned error can't find the container with id 9bb734c6901f21896589c46aaccbad9657491f76407b235bbc8c9c2277c7513c
Jul 07 18:51:31.857372 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.857338    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:31.857543 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:31.857443    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:31.857543 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:31.857488    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:51:31.857543 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:31.857504    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d4cf4b84-qzhjn: secret "image-registry-tls" not found
Jul 07 18:51:31.857543 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:31.857525    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:51:31.857675 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:31.857571    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls podName:a7efc607-8f96-4303-85d3-b9fc7d708d4e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:32.857556169 +0000 UTC m=+42.016895977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls") pod "image-registry-65d4cf4b84-qzhjn" (UID: "a7efc607-8f96-4303-85d3-b9fc7d708d4e") : secret "image-registry-tls" not found
Jul 07 18:51:31.857675 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:31.857586    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls podName:6511f0b7-aea0-4426-94dc-005303e704a9 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:32.857580446 +0000 UTC m=+42.016920250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls") pod "dns-default-z4g8n" (UID: "6511f0b7-aea0-4426-94dc-005303e704a9") : secret "dns-default-metrics-tls" not found
Jul 07 18:51:32.468956 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:32.468923    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:32.469506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:32.468931    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:32.469506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:32.468931    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:32.472193 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:32.472156    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 18:51:32.472325 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:32.472235    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 18:51:32.472511 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:32.472488    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 18:51:32.473377 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:32.473355    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nk7wp\""
Jul 07 18:51:32.473527 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:32.473395    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 18:51:32.473527 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:32.473451    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9524g\""
Jul 07 18:51:32.669987 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:32.669936    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-44ls7" event={"ID":"c8400145-1a5f-4af0-9788-2220d231366b","Type":"ContainerStarted","Data":"9bb734c6901f21896589c46aaccbad9657491f76407b235bbc8c9c2277c7513c"}
Jul 07 18:51:32.865327 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:32.865298    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:32.865469 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:32.865336    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:32.865539 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:32.865465    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:51:32.865539 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:32.865483    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:51:32.865539 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:32.865494    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d4cf4b84-qzhjn: secret "image-registry-tls" not found
Jul 07 18:51:32.865664 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:32.865566    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls podName:a7efc607-8f96-4303-85d3-b9fc7d708d4e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:34.865546142 +0000 UTC m=+44.024885962 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls") pod "image-registry-65d4cf4b84-qzhjn" (UID: "a7efc607-8f96-4303-85d3-b9fc7d708d4e") : secret "image-registry-tls" not found
Jul 07 18:51:32.865664 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:32.865584    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls podName:6511f0b7-aea0-4426-94dc-005303e704a9 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:34.865575632 +0000 UTC m=+44.024915441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls") pod "dns-default-z4g8n" (UID: "6511f0b7-aea0-4426-94dc-005303e704a9") : secret "dns-default-metrics-tls" not found
Jul 07 18:51:34.320047 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.320016    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qk2v2"]
Jul 07 18:51:34.343275 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.343240    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qk2v2"]
Jul 07 18:51:34.343407 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.343360    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.348363 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.348339    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 18:51:34.348647 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.348631    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 18:51:34.349533 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.349501    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xkh4b\""
Jul 07 18:51:34.349602 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.349574    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 18:51:34.349846 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.349829    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 18:51:34.380163 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.380134    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/50cd60eb-0be0-44ce-bfc4-924b7be73740-data-volume\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.380163 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.380166    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.380333 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.380186    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/50cd60eb-0be0-44ce-bfc4-924b7be73740-crio-socket\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.380333 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.380202    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn97z\" (UniqueName: \"kubernetes.io/projected/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-api-access-dn97z\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.380333 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.380317    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.480698 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.480663    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.480914 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.480720    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/50cd60eb-0be0-44ce-bfc4-924b7be73740-data-volume\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.480914 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.480744    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.480914 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.480773    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/50cd60eb-0be0-44ce-bfc4-924b7be73740-crio-socket\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.480914 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:34.480790    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:51:34.480914 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:34.480871    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:34.480914 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:34.480902    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm podName:50cd60eb-0be0-44ce-bfc4-924b7be73740 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:34.980880262 +0000 UTC m=+44.140220082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qk2v2" (UID: "50cd60eb-0be0-44ce-bfc4-924b7be73740") : configmap "kube-rbac-proxy" not found
Jul 07 18:51:34.481158 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:34.480938    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls podName:50cd60eb-0be0-44ce-bfc4-924b7be73740 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:34.980927811 +0000 UTC m=+44.140267618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qk2v2" (UID: "50cd60eb-0be0-44ce-bfc4-924b7be73740") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:34.481158 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.480816    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn97z\" (UniqueName: \"kubernetes.io/projected/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-api-access-dn97z\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.481158 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.480997    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/50cd60eb-0be0-44ce-bfc4-924b7be73740-crio-socket\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.481158 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.481070    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/50cd60eb-0be0-44ce-bfc4-924b7be73740-data-volume\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.490691 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.490665    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn97z\" (UniqueName: \"kubernetes.io/projected/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-api-access-dn97z\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.884136 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.883937    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:34.884303 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.884152    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:34.884303 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:34.884108    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:51:34.884303 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:34.884272    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls podName:6511f0b7-aea0-4426-94dc-005303e704a9 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:38.884245797 +0000 UTC m=+48.043585607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls") pod "dns-default-z4g8n" (UID: "6511f0b7-aea0-4426-94dc-005303e704a9") : secret "dns-default-metrics-tls" not found
Jul 07 18:51:34.884432 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:34.884304    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:51:34.884432 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:34.884315    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d4cf4b84-qzhjn: secret "image-registry-tls" not found
Jul 07 18:51:34.884432 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:34.884356    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls podName:a7efc607-8f96-4303-85d3-b9fc7d708d4e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:38.884341499 +0000 UTC m=+48.043681307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls") pod "image-registry-65d4cf4b84-qzhjn" (UID: "a7efc607-8f96-4303-85d3-b9fc7d708d4e") : secret "image-registry-tls" not found
Jul 07 18:51:34.985084 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.985046    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.985265 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:34.985122    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:34.985265 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:34.985170    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:51:34.985265 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:34.985233    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:34.985381 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:34.985239    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm podName:50cd60eb-0be0-44ce-bfc4-924b7be73740 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:35.985222736 +0000 UTC m=+45.144562541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qk2v2" (UID: "50cd60eb-0be0-44ce-bfc4-924b7be73740") : configmap "kube-rbac-proxy" not found
Jul 07 18:51:34.985381 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:34.985292    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls podName:50cd60eb-0be0-44ce-bfc4-924b7be73740 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:35.985276805 +0000 UTC m=+45.144616616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qk2v2" (UID: "50cd60eb-0be0-44ce-bfc4-924b7be73740") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:35.677170 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:35.677131    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-44ls7" event={"ID":"c8400145-1a5f-4af0-9788-2220d231366b","Type":"ContainerStarted","Data":"e65b339c33567fb52a874022f50bb746cfc999e36e67e313027dfc75a6733448"}
Jul 07 18:51:35.709009 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:35.708961    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-44ls7" podStartSLOduration=1.719637611 podStartE2EDuration="4.708943427s" totalImagesPullingTime="2.989305816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:35.70790488 +0000 UTC m=+44.867244706" watchObservedRunningTime="2026-07-07 18:51:35.708943427 +0000 UTC m=+44.868283265"
Jul 07 18:51:35.877590 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:35.877561    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f5gzx_19bf2468-4a15-4e76-9c66-6d26e6a73d93/dns-node-resolver/0.log"
Jul 07 18:51:35.993608 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:35.993571    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:35.993789 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:35.993680    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:35.993789 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:35.993717    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:35.993789 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:35.993780    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls podName:50cd60eb-0be0-44ce-bfc4-924b7be73740 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:37.993764842 +0000 UTC m=+47.153104646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qk2v2" (UID: "50cd60eb-0be0-44ce-bfc4-924b7be73740") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:35.993789 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:35.993785    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:51:35.993981 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:35.993858    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm podName:50cd60eb-0be0-44ce-bfc4-924b7be73740 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:37.993841368 +0000 UTC m=+47.153181191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qk2v2" (UID: "50cd60eb-0be0-44ce-bfc4-924b7be73740") : configmap "kube-rbac-proxy" not found
Jul 07 18:51:36.877890 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:36.877862    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bbt8z_eddf68ee-cdbb-4e8e-8b32-b86fb51faaec/node-ca/0.log"
Jul 07 18:51:37.480311 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:37.480282    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-44ls7_c8400145-1a5f-4af0-9788-2220d231366b/serve-healthcheck-canary/0.log"
Jul 07 18:51:38.009505 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:38.009462    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:38.009910 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:38.009527    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:38.009910 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:38.009594    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:51:38.009910 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:38.009624    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:38.009910 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:38.009659    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm podName:50cd60eb-0be0-44ce-bfc4-924b7be73740 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:42.009641794 +0000 UTC m=+51.168981597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qk2v2" (UID: "50cd60eb-0be0-44ce-bfc4-924b7be73740") : configmap "kube-rbac-proxy" not found
Jul 07 18:51:38.009910 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:38.009674    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls podName:50cd60eb-0be0-44ce-bfc4-924b7be73740 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:42.009668372 +0000 UTC m=+51.169008176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qk2v2" (UID: "50cd60eb-0be0-44ce-bfc4-924b7be73740") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:38.917532 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:38.917493    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:38.917709 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:38.917675    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:51:38.917709 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:38.917701    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d4cf4b84-qzhjn: secret "image-registry-tls" not found
Jul 07 18:51:38.917870 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:38.917687    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:38.917870 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:38.917757    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:51:38.917870 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:38.917768    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls podName:a7efc607-8f96-4303-85d3-b9fc7d708d4e nodeName:}" failed. No retries permitted until 2026-07-07 18:51:46.917746761 +0000 UTC m=+56.077086584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls") pod "image-registry-65d4cf4b84-qzhjn" (UID: "a7efc607-8f96-4303-85d3-b9fc7d708d4e") : secret "image-registry-tls" not found
Jul 07 18:51:38.917870 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:38.917854    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls podName:6511f0b7-aea0-4426-94dc-005303e704a9 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:46.917838926 +0000 UTC m=+56.077178730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls") pod "dns-default-z4g8n" (UID: "6511f0b7-aea0-4426-94dc-005303e704a9") : secret "dns-default-metrics-tls" not found
Jul 07 18:51:42.040881 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:42.040843    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:42.041406 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:42.040902    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:42.041406 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:42.040957    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:51:42.041406 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:42.041000    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:42.041406 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:42.041018    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm podName:50cd60eb-0be0-44ce-bfc4-924b7be73740 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:50.041002189 +0000 UTC m=+59.200341992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qk2v2" (UID: "50cd60eb-0be0-44ce-bfc4-924b7be73740") : configmap "kube-rbac-proxy" not found
Jul 07 18:51:42.041406 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:42.041037    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls podName:50cd60eb-0be0-44ce-bfc4-924b7be73740 nodeName:}" failed. No retries permitted until 2026-07-07 18:51:50.041025695 +0000 UTC m=+59.200365499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qk2v2" (UID: "50cd60eb-0be0-44ce-bfc4-924b7be73740") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:46.981337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:46.981285    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls\") pod \"image-registry-65d4cf4b84-qzhjn\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") " pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:51:46.981829 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:46.981396    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:51:46.981829 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:46.981441    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:51:46.981829 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:46.981463    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65d4cf4b84-qzhjn: secret "image-registry-tls" not found
Jul 07 18:51:46.981829 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:46.981479    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:51:46.981829 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:46.981513    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls podName:a7efc607-8f96-4303-85d3-b9fc7d708d4e nodeName:}" failed. No retries permitted until 2026-07-07 18:52:02.981499206 +0000 UTC m=+72.140839009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls") pod "image-registry-65d4cf4b84-qzhjn" (UID: "a7efc607-8f96-4303-85d3-b9fc7d708d4e") : secret "image-registry-tls" not found
Jul 07 18:51:46.981829 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:46.981527    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls podName:6511f0b7-aea0-4426-94dc-005303e704a9 nodeName:}" failed. No retries permitted until 2026-07-07 18:52:02.981521123 +0000 UTC m=+72.140860927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls") pod "dns-default-z4g8n" (UID: "6511f0b7-aea0-4426-94dc-005303e704a9") : secret "dns-default-metrics-tls" not found
Jul 07 18:51:50.103416 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:50.103374    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:50.103818 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:50.103445    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:50.103818 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:50.103554    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:50.103818 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:51:50.103620    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls podName:50cd60eb-0be0-44ce-bfc4-924b7be73740 nodeName:}" failed. No retries permitted until 2026-07-07 18:52:06.103602353 +0000 UTC m=+75.262942159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qk2v2" (UID: "50cd60eb-0be0-44ce-bfc4-924b7be73740") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:51:50.104126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:50.104105    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50cd60eb-0be0-44ce-bfc4-924b7be73740-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:51:54.654219 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:54.654192    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6nshg"
Jul 07 18:51:57.054035 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.053992    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:57.057187 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.057170    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 18:51:57.067203 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.067178    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9467a0f3-0b26-4d87-b1de-0fcf62a224ec-original-pull-secret\") pod \"global-pull-secret-syncer-f76tc\" (UID: \"9467a0f3-0b26-4d87-b1de-0fcf62a224ec\") " pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:57.082204 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.082184    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76tc"
Jul 07 18:51:57.155169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.155071    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs\") pod \"network-metrics-daemon-jm9g5\" (UID: \"eb453689-3272-4296-8339-269354e1dd6f\") " pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:57.155169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.155108    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvwx6\" (UniqueName: \"kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6\") pod \"network-check-target-tjsjj\" (UID: \"10195eeb-1db4-4853-98c9-dc7f19a59df0\") " pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:57.164664 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.164640    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 18:51:57.165607 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.165588    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 18:51:57.168124 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.168105    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 18:51:57.177598 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.177575    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb453689-3272-4296-8339-269354e1dd6f-metrics-certs\") pod \"network-metrics-daemon-jm9g5\" (UID: \"eb453689-3272-4296-8339-269354e1dd6f\") " pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:57.177995 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.177973    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvwx6\" (UniqueName: \"kubernetes.io/projected/10195eeb-1db4-4853-98c9-dc7f19a59df0-kube-api-access-nvwx6\") pod \"network-check-target-tjsjj\" (UID: \"10195eeb-1db4-4853-98c9-dc7f19a59df0\") " pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:57.206651 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.206628    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f76tc"]
Jul 07 18:51:57.208274 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:51:57.208250    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9467a0f3_0b26_4d87_b1de_0fcf62a224ec.slice/crio-98dc91edceedb761d56428db34e1d3be4184b822812ce68b52bf9568fcc93554 WatchSource:0}: Error finding container 98dc91edceedb761d56428db34e1d3be4184b822812ce68b52bf9568fcc93554: Status 404 returned error can't find the container with id 98dc91edceedb761d56428db34e1d3be4184b822812ce68b52bf9568fcc93554
Jul 07 18:51:57.396490 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.396411    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nk7wp\""
Jul 07 18:51:57.400367 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.400350    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jm9g5"
Jul 07 18:51:57.401841 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.401828    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9524g\""
Jul 07 18:51:57.410162 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.410145    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:51:57.537637 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.537609    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jm9g5"]
Jul 07 18:51:57.542507 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:51:57.542483    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb453689_3272_4296_8339_269354e1dd6f.slice/crio-8e9b5d04a6aedc6f2d03ec7d3caec42333d1469584ed3206510e45424ee1f413 WatchSource:0}: Error finding container 8e9b5d04a6aedc6f2d03ec7d3caec42333d1469584ed3206510e45424ee1f413: Status 404 returned error can't find the container with id 8e9b5d04a6aedc6f2d03ec7d3caec42333d1469584ed3206510e45424ee1f413
Jul 07 18:51:57.557551 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.557526    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tjsjj"]
Jul 07 18:51:57.560540 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:51:57.560512    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10195eeb_1db4_4853_98c9_dc7f19a59df0.slice/crio-0c4fb3e85c2bcc7af5af74d82ff06ac847a2826d725aada66f0ad5adb52dd3b9 WatchSource:0}: Error finding container 0c4fb3e85c2bcc7af5af74d82ff06ac847a2826d725aada66f0ad5adb52dd3b9: Status 404 returned error can't find the container with id 0c4fb3e85c2bcc7af5af74d82ff06ac847a2826d725aada66f0ad5adb52dd3b9
Jul 07 18:51:57.727322 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.727290    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tjsjj" event={"ID":"10195eeb-1db4-4853-98c9-dc7f19a59df0","Type":"ContainerStarted","Data":"0c4fb3e85c2bcc7af5af74d82ff06ac847a2826d725aada66f0ad5adb52dd3b9"}
Jul 07 18:51:57.728342 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.728318    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jm9g5" event={"ID":"eb453689-3272-4296-8339-269354e1dd6f","Type":"ContainerStarted","Data":"8e9b5d04a6aedc6f2d03ec7d3caec42333d1469584ed3206510e45424ee1f413"}
Jul 07 18:51:57.729358 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:57.729336    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f76tc" event={"ID":"9467a0f3-0b26-4d87-b1de-0fcf62a224ec","Type":"ContainerStarted","Data":"98dc91edceedb761d56428db34e1d3be4184b822812ce68b52bf9568fcc93554"}
Jul 07 18:51:59.737859 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:59.737820    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jm9g5" event={"ID":"eb453689-3272-4296-8339-269354e1dd6f","Type":"ContainerStarted","Data":"d5fc72da2a5a6f64210ec5ced980e101f07a1566718fc7dd796991d32773bcce"}
Jul 07 18:51:59.738303 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:59.737907    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jm9g5" event={"ID":"eb453689-3272-4296-8339-269354e1dd6f","Type":"ContainerStarted","Data":"afc84ceabf66f7eef44b0866d14138f0cf56ebae782ea854d8c1fef89638f377"}
Jul 07 18:51:59.760592 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:51:59.760534    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jm9g5" podStartSLOduration=66.207904596 podStartE2EDuration="1m7.760513746s" totalImagesPullingTime="1.55260915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:51:59.759828865 +0000 UTC m=+68.919168712" watchObservedRunningTime="2026-07-07 18:51:59.760513746 +0000 UTC m=+68.919853574"
Jul 07 18:52:00.787460 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.787432    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65d4cf4b84-qzhjn"]
Jul 07 18:52:00.787838 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:52:00.787637    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn" podUID="a7efc607-8f96-4303-85d3-b9fc7d708d4e"
Jul 07 18:52:00.814335 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.814302    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-hzff8"]
Jul 07 18:52:00.816462 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.816430    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"]
Jul 07 18:52:00.816594 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.816559    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hzff8"
Jul 07 18:52:00.818240 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.818217    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"]
Jul 07 18:52:00.818366 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.818347    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"
Jul 07 18:52:00.819195 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.819172    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 18:52:00.819451 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.819428    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w4prd\""
Jul 07 18:52:00.819617 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.819472    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 18:52:00.820038 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.820015    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.822558 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.822538    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 18:52:00.822836 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.822770    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 18:52:00.823017 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.822997    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 18:52:00.824091 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.824006    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 18:52:00.828057 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.825103    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 18:52:00.828057 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.825164    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 18:52:00.828057 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.825389    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 18:52:00.828057 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.825963    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 18:52:00.831458 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.831440    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-hzff8"]
Jul 07 18:52:00.832385 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.832362    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"]
Jul 07 18:52:00.833137 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.833117    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"]
Jul 07 18:52:00.883449 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.883411    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eeb2baf4-79a8-484f-980a-b304a8a0f627-klusterlet-config\") pod \"klusterlet-addon-workmgr-6458665f44-ksf2n\" (UID: \"eeb2baf4-79a8-484f-980a-b304a8a0f627\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"
Jul 07 18:52:00.883449 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.883451    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/900582c4-2a8c-4726-8b02-1122b40c49ec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.883751 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.883477    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc458f9c-4c0f-40f0-84c3-b14b7daa7c08-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hzff8\" (UID: \"dc458f9c-4c0f-40f0-84c3-b14b7daa7c08\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hzff8"
Jul 07 18:52:00.883751 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.883570    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/900582c4-2a8c-4726-8b02-1122b40c49ec-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.883751 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.883610    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv622\" (UniqueName: \"kubernetes.io/projected/900582c4-2a8c-4726-8b02-1122b40c49ec-kube-api-access-lv622\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.883751 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.883642    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/900582c4-2a8c-4726-8b02-1122b40c49ec-hub\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.883751 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.883662    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/900582c4-2a8c-4726-8b02-1122b40c49ec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.883751 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.883679    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc458f9c-4c0f-40f0-84c3-b14b7daa7c08-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-hzff8\" (UID: \"dc458f9c-4c0f-40f0-84c3-b14b7daa7c08\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hzff8"
Jul 07 18:52:00.883751 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.883713    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs5rk\" (UniqueName: \"kubernetes.io/projected/eeb2baf4-79a8-484f-980a-b304a8a0f627-kube-api-access-gs5rk\") pod \"klusterlet-addon-workmgr-6458665f44-ksf2n\" (UID: \"eeb2baf4-79a8-484f-980a-b304a8a0f627\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"
Jul 07 18:52:00.884085 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.883790    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/900582c4-2a8c-4726-8b02-1122b40c49ec-ca\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.884085 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.883836    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eeb2baf4-79a8-484f-980a-b304a8a0f627-tmp\") pod \"klusterlet-addon-workmgr-6458665f44-ksf2n\" (UID: \"eeb2baf4-79a8-484f-980a-b304a8a0f627\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"
Jul 07 18:52:00.984771 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.984733    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/900582c4-2a8c-4726-8b02-1122b40c49ec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.984972 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.984777    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc458f9c-4c0f-40f0-84c3-b14b7daa7c08-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hzff8\" (UID: \"dc458f9c-4c0f-40f0-84c3-b14b7daa7c08\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hzff8"
Jul 07 18:52:00.984972 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.984835    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/900582c4-2a8c-4726-8b02-1122b40c49ec-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.984972 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.984867    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv622\" (UniqueName: \"kubernetes.io/projected/900582c4-2a8c-4726-8b02-1122b40c49ec-kube-api-access-lv622\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.984972 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.984898    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/900582c4-2a8c-4726-8b02-1122b40c49ec-hub\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.984972 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.984919    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/900582c4-2a8c-4726-8b02-1122b40c49ec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.984972 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.984945    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc458f9c-4c0f-40f0-84c3-b14b7daa7c08-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-hzff8\" (UID: \"dc458f9c-4c0f-40f0-84c3-b14b7daa7c08\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hzff8"
Jul 07 18:52:00.985932 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.985346    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs5rk\" (UniqueName: \"kubernetes.io/projected/eeb2baf4-79a8-484f-980a-b304a8a0f627-kube-api-access-gs5rk\") pod \"klusterlet-addon-workmgr-6458665f44-ksf2n\" (UID: \"eeb2baf4-79a8-484f-980a-b304a8a0f627\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"
Jul 07 18:52:00.985932 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.985421    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/900582c4-2a8c-4726-8b02-1122b40c49ec-ca\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.985932 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.985453    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eeb2baf4-79a8-484f-980a-b304a8a0f627-tmp\") pod \"klusterlet-addon-workmgr-6458665f44-ksf2n\" (UID: \"eeb2baf4-79a8-484f-980a-b304a8a0f627\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"
Jul 07 18:52:00.985932 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.985531    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eeb2baf4-79a8-484f-980a-b304a8a0f627-klusterlet-config\") pod \"klusterlet-addon-workmgr-6458665f44-ksf2n\" (UID: \"eeb2baf4-79a8-484f-980a-b304a8a0f627\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"
Jul 07 18:52:00.985932 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.985669    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc458f9c-4c0f-40f0-84c3-b14b7daa7c08-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-hzff8\" (UID: \"dc458f9c-4c0f-40f0-84c3-b14b7daa7c08\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hzff8"
Jul 07 18:52:00.986262 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.985961    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/900582c4-2a8c-4726-8b02-1122b40c49ec-additional-service-ca\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.986262 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.986055    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eeb2baf4-79a8-484f-980a-b304a8a0f627-tmp\") pod \"klusterlet-addon-workmgr-6458665f44-ksf2n\" (UID: \"eeb2baf4-79a8-484f-980a-b304a8a0f627\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"
Jul 07 18:52:00.988212 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.988180    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/900582c4-2a8c-4726-8b02-1122b40c49ec-ca\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.988504 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.988459    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/900582c4-2a8c-4726-8b02-1122b40c49ec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.988611 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.988513    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/900582c4-2a8c-4726-8b02-1122b40c49ec-hub\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.988944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.988892    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dc458f9c-4c0f-40f0-84c3-b14b7daa7c08-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-hzff8\" (UID: \"dc458f9c-4c0f-40f0-84c3-b14b7daa7c08\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-hzff8"
Jul 07 18:52:00.988944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.988916    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eeb2baf4-79a8-484f-980a-b304a8a0f627-klusterlet-config\") pod \"klusterlet-addon-workmgr-6458665f44-ksf2n\" (UID: \"eeb2baf4-79a8-484f-980a-b304a8a0f627\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"
Jul 07 18:52:00.989146 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.989124    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/900582c4-2a8c-4726-8b02-1122b40c49ec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.993614 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.993594    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv622\" (UniqueName: \"kubernetes.io/projected/900582c4-2a8c-4726-8b02-1122b40c49ec-kube-api-access-lv622\") pod \"cluster-proxy-proxy-agent-69cb85c976-z76jf\" (UID: \"900582c4-2a8c-4726-8b02-1122b40c49ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:00.994089 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:00.994054    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs5rk\" (UniqueName: \"kubernetes.io/projected/eeb2baf4-79a8-484f-980a-b304a8a0f627-kube-api-access-gs5rk\") pod \"klusterlet-addon-workmgr-6458665f44-ksf2n\" (UID: \"eeb2baf4-79a8-484f-980a-b304a8a0f627\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"
Jul 07 18:52:01.131561 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.131480    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hzff8"
Jul 07 18:52:01.139290 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.139257    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"
Jul 07 18:52:01.153228 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.153208    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"
Jul 07 18:52:01.743157 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.743114    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:52:01.749763 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.749740    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:52:01.792074 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.792043    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlcrx\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-kube-api-access-nlcrx\") pod \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") "
Jul 07 18:52:01.792469 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.792083    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efc607-8f96-4303-85d3-b9fc7d708d4e-image-registry-private-configuration\") pod \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") "
Jul 07 18:52:01.792469 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.792115    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efc607-8f96-4303-85d3-b9fc7d708d4e-trusted-ca\") pod \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") "
Jul 07 18:52:01.792469 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.792160    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-bound-sa-token\") pod \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") "
Jul 07 18:52:01.792469 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.792202    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efc607-8f96-4303-85d3-b9fc7d708d4e-ca-trust-extracted\") pod \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") "
Jul 07 18:52:01.792469 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.792233    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efc607-8f96-4303-85d3-b9fc7d708d4e-installation-pull-secrets\") pod \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") "
Jul 07 18:52:01.792469 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.792272    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-certificates\") pod \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\" (UID: \"a7efc607-8f96-4303-85d3-b9fc7d708d4e\") "
Jul 07 18:52:01.792901 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.792838    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a7efc607-8f96-4303-85d3-b9fc7d708d4e" (UID: "a7efc607-8f96-4303-85d3-b9fc7d708d4e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:52:01.792901 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.792851    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7efc607-8f96-4303-85d3-b9fc7d708d4e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a7efc607-8f96-4303-85d3-b9fc7d708d4e" (UID: "a7efc607-8f96-4303-85d3-b9fc7d708d4e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:52:01.793243 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.793218    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7efc607-8f96-4303-85d3-b9fc7d708d4e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a7efc607-8f96-4303-85d3-b9fc7d708d4e" (UID: "a7efc607-8f96-4303-85d3-b9fc7d708d4e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:52:01.795241 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.795205    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7efc607-8f96-4303-85d3-b9fc7d708d4e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a7efc607-8f96-4303-85d3-b9fc7d708d4e" (UID: "a7efc607-8f96-4303-85d3-b9fc7d708d4e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:52:01.795906 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.795878    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a7efc607-8f96-4303-85d3-b9fc7d708d4e" (UID: "a7efc607-8f96-4303-85d3-b9fc7d708d4e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:52:01.796053 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.796022    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-kube-api-access-nlcrx" (OuterVolumeSpecName: "kube-api-access-nlcrx") pod "a7efc607-8f96-4303-85d3-b9fc7d708d4e" (UID: "a7efc607-8f96-4303-85d3-b9fc7d708d4e"). InnerVolumeSpecName "kube-api-access-nlcrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:52:01.796379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.796353    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7efc607-8f96-4303-85d3-b9fc7d708d4e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a7efc607-8f96-4303-85d3-b9fc7d708d4e" (UID: "a7efc607-8f96-4303-85d3-b9fc7d708d4e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:52:01.893004 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.892975    2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efc607-8f96-4303-85d3-b9fc7d708d4e-ca-trust-extracted\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:52:01.893004 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.893000    2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efc607-8f96-4303-85d3-b9fc7d708d4e-installation-pull-secrets\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:52:01.893004 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.893009    2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-certificates\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:52:01.893004 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.893018    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlcrx\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-kube-api-access-nlcrx\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:52:01.893252 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.893031    2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efc607-8f96-4303-85d3-b9fc7d708d4e-image-registry-private-configuration\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:52:01.893252 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.893045    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efc607-8f96-4303-85d3-b9fc7d708d4e-trusted-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:52:01.893252 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:01.893053    2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-bound-sa-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:52:02.468611 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.468275    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf"]
Jul 07 18:52:02.475705 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:52:02.475673    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod900582c4_2a8c_4726_8b02_1122b40c49ec.slice/crio-e89e821f8627520bc9db9fcdb77b71d3d8edb6392dfd3d7326ef9fb4fe35c307 WatchSource:0}: Error finding container e89e821f8627520bc9db9fcdb77b71d3d8edb6392dfd3d7326ef9fb4fe35c307: Status 404 returned error can't find the container with id e89e821f8627520bc9db9fcdb77b71d3d8edb6392dfd3d7326ef9fb4fe35c307
Jul 07 18:52:02.682756 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.682729    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"]
Jul 07 18:52:02.685030 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:52:02.684998    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb2baf4_79a8_484f_980a_b304a8a0f627.slice/crio-dcd65e4b4dc3c60ea1153d46bdba41ce55ee6ced777cfe8635b63edd90c4c1f1 WatchSource:0}: Error finding container dcd65e4b4dc3c60ea1153d46bdba41ce55ee6ced777cfe8635b63edd90c4c1f1: Status 404 returned error can't find the container with id dcd65e4b4dc3c60ea1153d46bdba41ce55ee6ced777cfe8635b63edd90c4c1f1
Jul 07 18:52:02.685166 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.685101    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-hzff8"]
Jul 07 18:52:02.687761 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:52:02.687741    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc458f9c_4c0f_40f0_84c3_b14b7daa7c08.slice/crio-c61be389775b58a557aa91f42a8d6f7fac9b957c6359a4d497d07dfd5ecb023a WatchSource:0}: Error finding container c61be389775b58a557aa91f42a8d6f7fac9b957c6359a4d497d07dfd5ecb023a: Status 404 returned error can't find the container with id c61be389775b58a557aa91f42a8d6f7fac9b957c6359a4d497d07dfd5ecb023a
Jul 07 18:52:02.747545 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.747513    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n" event={"ID":"eeb2baf4-79a8-484f-980a-b304a8a0f627","Type":"ContainerStarted","Data":"dcd65e4b4dc3c60ea1153d46bdba41ce55ee6ced777cfe8635b63edd90c4c1f1"}
Jul 07 18:52:02.748612 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.748586    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hzff8" event={"ID":"dc458f9c-4c0f-40f0-84c3-b14b7daa7c08","Type":"ContainerStarted","Data":"c61be389775b58a557aa91f42a8d6f7fac9b957c6359a4d497d07dfd5ecb023a"}
Jul 07 18:52:02.749580 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.749556    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf" event={"ID":"900582c4-2a8c-4726-8b02-1122b40c49ec","Type":"ContainerStarted","Data":"e89e821f8627520bc9db9fcdb77b71d3d8edb6392dfd3d7326ef9fb4fe35c307"}
Jul 07 18:52:02.750879 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.750855    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f76tc" event={"ID":"9467a0f3-0b26-4d87-b1de-0fcf62a224ec","Type":"ContainerStarted","Data":"9ac45631d61d4e12e313c803c778e2a8df4259ff8213965169bb59086f73290c"}
Jul 07 18:52:02.752186 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.752156    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tjsjj" event={"ID":"10195eeb-1db4-4853-98c9-dc7f19a59df0","Type":"ContainerStarted","Data":"cb4875f4f1d78f6aa2a13816d8bf0fe123289b1fe45e9f8ba7347011645fc256"}
Jul 07 18:52:02.752275 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.752199    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65d4cf4b84-qzhjn"
Jul 07 18:52:02.752373 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.752357    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:52:02.774387 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.774342    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f76tc" podStartSLOduration=65.660362907 podStartE2EDuration="1m10.77432725s" totalImagesPullingTime="5.113964343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:02.773230508 +0000 UTC m=+71.932570334" watchObservedRunningTime="2026-07-07 18:52:02.77432725 +0000 UTC m=+71.933667077"
Jul 07 18:52:02.815154 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.815131    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65d4cf4b84-qzhjn"]
Jul 07 18:52:02.819239 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.819219    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65d4cf4b84-qzhjn"]
Jul 07 18:52:02.842214 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.842171    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tjsjj" podStartSLOduration=66.09364924 podStartE2EDuration="1m10.84215877s" totalImagesPullingTime="4.74850953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:02.841071739 +0000 UTC m=+72.000411581" watchObservedRunningTime="2026-07-07 18:52:02.84215877 +0000 UTC m=+72.001498620"
Jul 07 18:52:02.901210 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:02.901181    2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efc607-8f96-4303-85d3-b9fc7d708d4e-registry-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:52:03.001710 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:03.001594    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:52:03.004807 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:03.004777    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6511f0b7-aea0-4426-94dc-005303e704a9-metrics-tls\") pod \"dns-default-z4g8n\" (UID: \"6511f0b7-aea0-4426-94dc-005303e704a9\") " pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:52:03.251140 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:03.251108    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-crmbz\""
Jul 07 18:52:03.253226 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:03.253126    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:52:03.409439 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:03.409247    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z4g8n"]
Jul 07 18:52:03.414321 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:52:03.414288    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6511f0b7_aea0_4426_94dc_005303e704a9.slice/crio-c722de0af9023f16d62668ff940c31fb935c1df4943d274522639ff5a7475ef6 WatchSource:0}: Error finding container c722de0af9023f16d62668ff940c31fb935c1df4943d274522639ff5a7475ef6: Status 404 returned error can't find the container with id c722de0af9023f16d62668ff940c31fb935c1df4943d274522639ff5a7475ef6
Jul 07 18:52:03.474299 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:03.474102    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7efc607-8f96-4303-85d3-b9fc7d708d4e" path="/var/lib/kubelet/pods/a7efc607-8f96-4303-85d3-b9fc7d708d4e/volumes"
Jul 07 18:52:03.758565 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:03.758532    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z4g8n" event={"ID":"6511f0b7-aea0-4426-94dc-005303e704a9","Type":"ContainerStarted","Data":"c722de0af9023f16d62668ff940c31fb935c1df4943d274522639ff5a7475ef6"}
Jul 07 18:52:06.130778 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:06.130747    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:52:06.133817 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:06.133780    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50cd60eb-0be0-44ce-bfc4-924b7be73740-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2v2\" (UID: \"50cd60eb-0be0-44ce-bfc4-924b7be73740\") " pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:52:06.157273 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:06.157244    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xkh4b\""
Jul 07 18:52:06.162039 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:06.162013    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qk2v2"
Jul 07 18:52:06.742912 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:06.742888    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qk2v2"]
Jul 07 18:52:06.745490 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:52:06.745466    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50cd60eb_0be0_44ce_bfc4_924b7be73740.slice/crio-44ec6abc8ca700f844c08ad982599589e244cec1206274f524d9e599d109134e WatchSource:0}: Error finding container 44ec6abc8ca700f844c08ad982599589e244cec1206274f524d9e599d109134e: Status 404 returned error can't find the container with id 44ec6abc8ca700f844c08ad982599589e244cec1206274f524d9e599d109134e
Jul 07 18:52:06.771252 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:06.771147    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qk2v2" event={"ID":"50cd60eb-0be0-44ce-bfc4-924b7be73740","Type":"ContainerStarted","Data":"44ec6abc8ca700f844c08ad982599589e244cec1206274f524d9e599d109134e"}
Jul 07 18:52:06.773792 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:06.773106    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hzff8" event={"ID":"dc458f9c-4c0f-40f0-84c3-b14b7daa7c08","Type":"ContainerStarted","Data":"d0693570e14768f25d631734fc75dd63dbfa69a0319d50bdf4918ea8c19901d5"}
Jul 07 18:52:06.777961 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:06.777933    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z4g8n" event={"ID":"6511f0b7-aea0-4426-94dc-005303e704a9","Type":"ContainerStarted","Data":"6206804133e36a908bef2faa49ecbf074d74f4caf32b235c3dc91f576aef54c1"}
Jul 07 18:52:06.782541 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:06.782474    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf" event={"ID":"900582c4-2a8c-4726-8b02-1122b40c49ec","Type":"ContainerStarted","Data":"8d48be342032caadfd411cd0c2ac18ae46b788d32f1c44d1689a3e9202649821"}
Jul 07 18:52:06.782541 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:06.782516    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf" event={"ID":"900582c4-2a8c-4726-8b02-1122b40c49ec","Type":"ContainerStarted","Data":"ce37bb3ebc7e03e6212de323c4e5c7f21ec6c83fc58216e7ac8cae382fcd7e91"}
Jul 07 18:52:06.798749 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:06.798699    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-hzff8" podStartSLOduration=3.476756152 podStartE2EDuration="6.79868061s" totalImagesPullingTime="3.321924458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:06.797605343 +0000 UTC m=+75.956945177" watchObservedRunningTime="2026-07-07 18:52:06.79868061 +0000 UTC m=+75.958020436"
Jul 07 18:52:07.791872 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:07.791833    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z4g8n" event={"ID":"6511f0b7-aea0-4426-94dc-005303e704a9","Type":"ContainerStarted","Data":"a0e9ba5eb52a771bdeb1017a4f1cf22d826be502ae2427978071d269a257aea1"}
Jul 07 18:52:07.792331 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:07.792037    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:52:07.796184 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:07.796129    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf" event={"ID":"900582c4-2a8c-4726-8b02-1122b40c49ec","Type":"ContainerStarted","Data":"a8787c440e7f053f313b3faa2fc74f45f31e88660ff58107fec526c610c69bb9"}
Jul 07 18:52:07.845427 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:07.845372    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-69cb85c976-z76jf" podStartSLOduration=3.737366145 podStartE2EDuration="7.84535108s" totalImagesPullingTime="4.107984935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:07.844428916 +0000 UTC m=+77.003768743" watchObservedRunningTime="2026-07-07 18:52:07.84535108 +0000 UTC m=+77.004690907"
Jul 07 18:52:07.846547 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:07.845853    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z4g8n" podStartSLOduration=33.617281409 podStartE2EDuration="36.845840838s" totalImagesPullingTime="3.228559429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:07.818825749 +0000 UTC m=+76.978165602" watchObservedRunningTime="2026-07-07 18:52:07.845840838 +0000 UTC m=+77.005180665"
Jul 07 18:52:11.814107 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:11.814073    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qk2v2" event={"ID":"50cd60eb-0be0-44ce-bfc4-924b7be73740","Type":"ContainerStarted","Data":"cbe320b99360841559d916a4703684bd0f7967ba319d7c20ea4f6774090d3931"}
Jul 07 18:52:11.815575 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:11.815545    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n" event={"ID":"eeb2baf4-79a8-484f-980a-b304a8a0f627","Type":"ContainerStarted","Data":"dc70e5c1069c16e886eb4f6f6b27f1389be7b1c9f5294a2a3c06a2cce9b44cda"}
Jul 07 18:52:11.815761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:11.815744    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"
Jul 07 18:52:11.817391 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:11.817372    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n"
Jul 07 18:52:11.832692 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:11.832649    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6458665f44-ksf2n" podStartSLOduration=3.123406473 podStartE2EDuration="11.832637244s" totalImagesPullingTime="8.709230771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:11.83192551 +0000 UTC m=+80.991265350" watchObservedRunningTime="2026-07-07 18:52:11.832637244 +0000 UTC m=+80.991977061"
Jul 07 18:52:12.822055 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:12.822010    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qk2v2" event={"ID":"50cd60eb-0be0-44ce-bfc4-924b7be73740","Type":"ContainerStarted","Data":"8b8775860e1ed3b14c04e8b274da471f3ca18a4dfda652534a0ba79e058135b9"}
Jul 07 18:52:13.396755 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.396717    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tqwmx"]
Jul 07 18:52:13.400119 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.400095    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.402849 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.402816    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 18:52:13.402998 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.402969    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 18:52:13.403123 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.403051    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5s2bl\""
Jul 07 18:52:13.404066 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.404047    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 18:52:13.404170 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.404110    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 18:52:13.404228 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.404166    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 18:52:13.404228 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.404053    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 18:52:13.489056 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.489023    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb4wg\" (UniqueName: \"kubernetes.io/projected/9c674a43-baea-4422-897d-2c3d3c9add1e-kube-api-access-nb4wg\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.489292 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.489069    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-tls\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.489292 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.489091    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-wtmp\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.489292 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.489172    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c674a43-baea-4422-897d-2c3d3c9add1e-sys\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.489292 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.489233    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9c674a43-baea-4422-897d-2c3d3c9add1e-root\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.489292 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.489262    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-textfile\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.489574 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.489301    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.489574 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.489330    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.489574 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.489380    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c674a43-baea-4422-897d-2c3d3c9add1e-metrics-client-ca\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.590252 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.590223    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c674a43-baea-4422-897d-2c3d3c9add1e-sys\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.590423 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.590278    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9c674a43-baea-4422-897d-2c3d3c9add1e-root\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.590423 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.590338    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9c674a43-baea-4422-897d-2c3d3c9add1e-root\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.590423 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.590340    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c674a43-baea-4422-897d-2c3d3c9add1e-sys\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.590423 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.590383    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-textfile\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.590580 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.590432    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.590580 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.590463    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.590580 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.590501    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c674a43-baea-4422-897d-2c3d3c9add1e-metrics-client-ca\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.590580 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.590551    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb4wg\" (UniqueName: \"kubernetes.io/projected/9c674a43-baea-4422-897d-2c3d3c9add1e-kube-api-access-nb4wg\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.590752 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.590578    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-tls\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.590752 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.590603    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-wtmp\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.590752 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.590683    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-textfile\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.590876 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.590751    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-wtmp\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.591097 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:52:13.591056    2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 18:52:13.591238 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:52:13.591139    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-tls podName:9c674a43-baea-4422-897d-2c3d3c9add1e nodeName:}" failed. No retries permitted until 2026-07-07 18:52:14.091118031 +0000 UTC m=+83.250457838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-tls") pod "node-exporter-tqwmx" (UID: "9c674a43-baea-4422-897d-2c3d3c9add1e") : secret "node-exporter-tls" not found
Jul 07 18:52:13.591238 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.591229    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c674a43-baea-4422-897d-2c3d3c9add1e-metrics-client-ca\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.591447 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.591414    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.593456 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.593433    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:13.604994 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:13.604972    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb4wg\" (UniqueName: \"kubernetes.io/projected/9c674a43-baea-4422-897d-2c3d3c9add1e-kube-api-access-nb4wg\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:14.094506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:14.094466    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-tls\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:14.096775 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:14.096754    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9c674a43-baea-4422-897d-2c3d3c9add1e-node-exporter-tls\") pod \"node-exporter-tqwmx\" (UID: \"9c674a43-baea-4422-897d-2c3d3c9add1e\") " pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:14.311409 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:14.311376    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tqwmx"
Jul 07 18:52:14.586148 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:52:14.586112    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c674a43_baea_4422_897d_2c3d3c9add1e.slice/crio-7b367e0cbedd8d75cb7cf18a1bc4b5e067dd16826549121a25916aba75c0e8a5 WatchSource:0}: Error finding container 7b367e0cbedd8d75cb7cf18a1bc4b5e067dd16826549121a25916aba75c0e8a5: Status 404 returned error can't find the container with id 7b367e0cbedd8d75cb7cf18a1bc4b5e067dd16826549121a25916aba75c0e8a5
Jul 07 18:52:14.830540 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:14.830502    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qk2v2" event={"ID":"50cd60eb-0be0-44ce-bfc4-924b7be73740","Type":"ContainerStarted","Data":"0f16ed43eabdaca5d53f341cbd356b49fe47bb96e48f728d19bae6aa9da3b82c"}
Jul 07 18:52:14.832056 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:14.832032    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqwmx" event={"ID":"9c674a43-baea-4422-897d-2c3d3c9add1e","Type":"ContainerStarted","Data":"7b367e0cbedd8d75cb7cf18a1bc4b5e067dd16826549121a25916aba75c0e8a5"}
Jul 07 18:52:14.851611 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:14.851537    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qk2v2" podStartSLOduration=33.075187796 podStartE2EDuration="40.851523058s" totalImagesPullingTime="7.776335262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:51:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:14.849786054 +0000 UTC m=+84.009125883" watchObservedRunningTime="2026-07-07 18:52:14.851523058 +0000 UTC m=+84.010862883"
Jul 07 18:52:15.442723 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.442690    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"]
Jul 07 18:52:15.445981 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.445959    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.449103 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.449082    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 07 18:52:15.449189 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.449166    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 07 18:52:15.453113 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.449692    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 07 18:52:15.453113 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.449736    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4pc557enb1oms\""
Jul 07 18:52:15.453113 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.450018    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 07 18:52:15.453113 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.450057    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kfxcn\""
Jul 07 18:52:15.453113 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.450140    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 07 18:52:15.460498 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.460475    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"]
Jul 07 18:52:15.606219 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.606192    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.606350 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.606232    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-tls\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.606350 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.606256    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.606350 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.606335    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.606508 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.606384    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-grpc-tls\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.606508 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.606413    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.606508 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.606490    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl9qd\" (UniqueName: \"kubernetes.io/projected/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-kube-api-access-xl9qd\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.606654 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.606528    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-metrics-client-ca\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.707417 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.707345    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-metrics-client-ca\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.707417 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.707387    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.707417 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.707408    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-tls\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.707653 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.707426    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.707653 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.707443    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.707653 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.707462    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-grpc-tls\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.707653 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.707487    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.707653 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.707530    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl9qd\" (UniqueName: \"kubernetes.io/projected/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-kube-api-access-xl9qd\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.708232 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.708175    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-metrics-client-ca\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.709991 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.709961    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-tls\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.710073 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.710050    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.710357 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.710341    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.710401 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.710379    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-grpc-tls\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.710446 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.710430    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.710647 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.710632    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.716882 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.716864    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl9qd\" (UniqueName: \"kubernetes.io/projected/c8c8a24c-43b5-46d6-8647-0cd74c0110e0-kube-api-access-xl9qd\") pod \"thanos-querier-67587cbcb6-6hlnj\" (UID: \"c8c8a24c-43b5-46d6-8647-0cd74c0110e0\") " pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.758226 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.758189    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:15.838456 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.838421    2554 generic.go:356] "Generic (PLEG): container finished" podID="9c674a43-baea-4422-897d-2c3d3c9add1e" containerID="c85681ec2167aa847a05e9826328154f18634c13cb09a1a2e51f73a8b42a1f33" exitCode=0
Jul 07 18:52:15.838560 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.838508    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqwmx" event={"ID":"9c674a43-baea-4422-897d-2c3d3c9add1e","Type":"ContainerDied","Data":"c85681ec2167aa847a05e9826328154f18634c13cb09a1a2e51f73a8b42a1f33"}
Jul 07 18:52:15.893559 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:15.893530    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"]
Jul 07 18:52:15.895841 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:52:15.895819    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c8a24c_43b5_46d6_8647_0cd74c0110e0.slice/crio-5fa40e045cd82d334e9ddb7ad61ef98f5dd6ad5e3bedd6bd2979451d2af563df WatchSource:0}: Error finding container 5fa40e045cd82d334e9ddb7ad61ef98f5dd6ad5e3bedd6bd2979451d2af563df: Status 404 returned error can't find the container with id 5fa40e045cd82d334e9ddb7ad61ef98f5dd6ad5e3bedd6bd2979451d2af563df
Jul 07 18:52:16.844759 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:16.844714    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqwmx" event={"ID":"9c674a43-baea-4422-897d-2c3d3c9add1e","Type":"ContainerStarted","Data":"ebe99563bb66aee2ba4238c362a3f4530babdeda62614efcdc6e82f6a7965db9"}
Jul 07 18:52:16.845238 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:16.844787    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqwmx" event={"ID":"9c674a43-baea-4422-897d-2c3d3c9add1e","Type":"ContainerStarted","Data":"0bcc55562cb2144c4c8df75e1f0144b267f303cb40db6eeb99dec00944ce31a7"}
Jul 07 18:52:16.846239 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:16.846215    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj" event={"ID":"c8c8a24c-43b5-46d6-8647-0cd74c0110e0","Type":"ContainerStarted","Data":"5fa40e045cd82d334e9ddb7ad61ef98f5dd6ad5e3bedd6bd2979451d2af563df"}
Jul 07 18:52:16.868031 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:16.867988    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tqwmx" podStartSLOduration=2.897853313 podStartE2EDuration="3.867970358s" totalImagesPullingTime="908.887695ms" totalInitContainerRuntime="61.22935ms" isStatefulPod=true podCreationTimestamp="2026-07-07 18:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:16.866511179 +0000 UTC m=+86.025851006" watchObservedRunningTime="2026-07-07 18:52:16.867970358 +0000 UTC m=+86.027310183"
Jul 07 18:52:17.802860 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:17.802826    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z4g8n"
Jul 07 18:52:18.129457 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.129370    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn"]
Jul 07 18:52:18.133485 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.133466    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn"
Jul 07 18:52:18.136346 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.136328    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8nfvd\""
Jul 07 18:52:18.137078 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.137063    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 07 18:52:18.143534 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.143492    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn"]
Jul 07 18:52:18.229793 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.229765    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttwjv\" (UniqueName: \"kubernetes.io/projected/3c92739e-dfff-4707-a4e0-a59624579add-kube-api-access-ttwjv\") pod \"monitoring-plugin-d5dcff7cf-pfdjn\" (UID: \"3c92739e-dfff-4707-a4e0-a59624579add\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn"
Jul 07 18:52:18.229968 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.229946    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c92739e-dfff-4707-a4e0-a59624579add-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-pfdjn\" (UID: \"3c92739e-dfff-4707-a4e0-a59624579add\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn"
Jul 07 18:52:18.330747 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.330722    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttwjv\" (UniqueName: \"kubernetes.io/projected/3c92739e-dfff-4707-a4e0-a59624579add-kube-api-access-ttwjv\") pod \"monitoring-plugin-d5dcff7cf-pfdjn\" (UID: \"3c92739e-dfff-4707-a4e0-a59624579add\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn"
Jul 07 18:52:18.330860 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.330782    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c92739e-dfff-4707-a4e0-a59624579add-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-pfdjn\" (UID: \"3c92739e-dfff-4707-a4e0-a59624579add\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn"
Jul 07 18:52:18.333363 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.333316    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c92739e-dfff-4707-a4e0-a59624579add-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-pfdjn\" (UID: \"3c92739e-dfff-4707-a4e0-a59624579add\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn"
Jul 07 18:52:18.341097 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.341073    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttwjv\" (UniqueName: \"kubernetes.io/projected/3c92739e-dfff-4707-a4e0-a59624579add-kube-api-access-ttwjv\") pod \"monitoring-plugin-d5dcff7cf-pfdjn\" (UID: \"3c92739e-dfff-4707-a4e0-a59624579add\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn"
Jul 07 18:52:18.446633 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.446562    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn"
Jul 07 18:52:18.579215 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.579180    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn"]
Jul 07 18:52:18.582138 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:52:18.582106    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c92739e_dfff_4707_a4e0_a59624579add.slice/crio-d808e4c944a17005bc9fa825a08b4178ba37f7ec8ee49b302b9be3d91e7b535b WatchSource:0}: Error finding container d808e4c944a17005bc9fa825a08b4178ba37f7ec8ee49b302b9be3d91e7b535b: Status 404 returned error can't find the container with id d808e4c944a17005bc9fa825a08b4178ba37f7ec8ee49b302b9be3d91e7b535b
Jul 07 18:52:18.854433 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.854395    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj" event={"ID":"c8c8a24c-43b5-46d6-8647-0cd74c0110e0","Type":"ContainerStarted","Data":"22ec0668a24d8e5196ba1018b00f2241a4abb81d64dd71e905d66cae0c5792be"}
Jul 07 18:52:18.854585 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.854466    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj" event={"ID":"c8c8a24c-43b5-46d6-8647-0cd74c0110e0","Type":"ContainerStarted","Data":"12edc3793c63ab3caf49674bcd47762e96044b5ca9d3b1ad645bf40751d78d6b"}
Jul 07 18:52:18.854585 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.854494    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj" event={"ID":"c8c8a24c-43b5-46d6-8647-0cd74c0110e0","Type":"ContainerStarted","Data":"9cb5a24ca2a22c6cb841c95eef3b7d687c5d87109a4ac6e9d0f2772c736318e9"}
Jul 07 18:52:18.855448 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:18.855427    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn" event={"ID":"3c92739e-dfff-4707-a4e0-a59624579add","Type":"ContainerStarted","Data":"d808e4c944a17005bc9fa825a08b4178ba37f7ec8ee49b302b9be3d91e7b535b"}
Jul 07 18:52:19.863759 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:19.863720    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj" event={"ID":"c8c8a24c-43b5-46d6-8647-0cd74c0110e0","Type":"ContainerStarted","Data":"2316466b43a530cba42a891b0095b4d062b46ffe6e17c5f0f30a2dbaace781ea"}
Jul 07 18:52:19.864204 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:19.863837    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj" event={"ID":"c8c8a24c-43b5-46d6-8647-0cd74c0110e0","Type":"ContainerStarted","Data":"35897c04247ae5e31237610131cf33a1a532b88cf4be6e90c1e8ba5809d27d70"}
Jul 07 18:52:19.864204 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:19.863893    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:19.864204 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:19.863936    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj" event={"ID":"c8c8a24c-43b5-46d6-8647-0cd74c0110e0","Type":"ContainerStarted","Data":"41d854c94c17ffb647cb0524238c5136d1e9757383de93b0bc98e86672f05429"}
Jul 07 18:52:19.914892 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:19.914837    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj" podStartSLOduration=1.793174147 podStartE2EDuration="4.914818274s" totalImagesPullingTime="3.121644127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:19.909315462 +0000 UTC m=+89.068655353" watchObservedRunningTime="2026-07-07 18:52:19.914818274 +0000 UTC m=+89.074158100"
Jul 07 18:52:20.868229 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:20.868188    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn" event={"ID":"3c92739e-dfff-4707-a4e0-a59624579add","Type":"ContainerStarted","Data":"d8f6c7e0ad1a883dd1a7db512952bdb93c259b0a0098658c724275fe8022c71f"}
Jul 07 18:52:20.868585 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:20.868563    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn"
Jul 07 18:52:20.872822 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:20.872784    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn"
Jul 07 18:52:20.890196 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:20.890150    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-pfdjn" podStartSLOduration=1.403247999 podStartE2EDuration="2.890137429s" totalImagesPullingTime="1.48688943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:20.888682023 +0000 UTC m=+90.048021849" watchObservedRunningTime="2026-07-07 18:52:20.890137429 +0000 UTC m=+90.049477277"
Jul 07 18:52:25.873877 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:25.873849    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-67587cbcb6-6hlnj"
Jul 07 18:52:25.971429 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:25.971400    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-zsqss"]
Jul 07 18:52:25.975525 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:25.975508    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-zsqss"
Jul 07 18:52:25.979254 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:25.979229    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 18:52:25.979389 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:25.979273    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 18:52:25.979389 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:25.979274    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qnmhk\""
Jul 07 18:52:25.989659 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:25.989639    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-zsqss"]
Jul 07 18:52:26.085506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:26.085473    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-858r5\" (UniqueName: \"kubernetes.io/projected/bba9d0d3-22b2-4b68-9e09-18900df3c331-kube-api-access-858r5\") pod \"downloads-685bfb5f64-zsqss\" (UID: \"bba9d0d3-22b2-4b68-9e09-18900df3c331\") " pod="openshift-console/downloads-685bfb5f64-zsqss"
Jul 07 18:52:26.186700 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:26.186626    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-858r5\" (UniqueName: \"kubernetes.io/projected/bba9d0d3-22b2-4b68-9e09-18900df3c331-kube-api-access-858r5\") pod \"downloads-685bfb5f64-zsqss\" (UID: \"bba9d0d3-22b2-4b68-9e09-18900df3c331\") " pod="openshift-console/downloads-685bfb5f64-zsqss"
Jul 07 18:52:26.198944 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:26.198917    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-858r5\" (UniqueName: \"kubernetes.io/projected/bba9d0d3-22b2-4b68-9e09-18900df3c331-kube-api-access-858r5\") pod \"downloads-685bfb5f64-zsqss\" (UID: \"bba9d0d3-22b2-4b68-9e09-18900df3c331\") " pod="openshift-console/downloads-685bfb5f64-zsqss"
Jul 07 18:52:26.284538 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:26.284506    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-zsqss"
Jul 07 18:52:26.408544 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:26.408523    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-zsqss"]
Jul 07 18:52:26.410703 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:52:26.410681    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba9d0d3_22b2_4b68_9e09_18900df3c331.slice/crio-865791c5de65c02fbc9e16b1d83d970b4336decc41535b3ed677c874e4c6529f WatchSource:0}: Error finding container 865791c5de65c02fbc9e16b1d83d970b4336decc41535b3ed677c874e4c6529f: Status 404 returned error can't find the container with id 865791c5de65c02fbc9e16b1d83d970b4336decc41535b3ed677c874e4c6529f
Jul 07 18:52:26.889604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:26.889573    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-zsqss" event={"ID":"bba9d0d3-22b2-4b68-9e09-18900df3c331","Type":"ContainerStarted","Data":"865791c5de65c02fbc9e16b1d83d970b4336decc41535b3ed677c874e4c6529f"}
Jul 07 18:52:33.761391 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:33.761348    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tjsjj"
Jul 07 18:52:36.140541 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.140505    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-687dd44574-z4l2r"]
Jul 07 18:52:36.184413 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.184310    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687dd44574-z4l2r"]
Jul 07 18:52:36.184591 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.184461    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.188563 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.188501    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 18:52:36.188788 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.188768    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7lr7m\""
Jul 07 18:52:36.188906 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.188827    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 18:52:36.189878 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.189860    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 18:52:36.190039 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.189889    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 18:52:36.190039 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.189900    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 18:52:36.267479 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.267444    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af17d116-5e55-4479-93b9-31ef9584f21b-console-oauth-config\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.267644 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.267489    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-oauth-serving-cert\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.267644 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.267521    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-console-config\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.267644 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.267584    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-service-ca\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.267847 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.267678    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzj7v\" (UniqueName: \"kubernetes.io/projected/af17d116-5e55-4479-93b9-31ef9584f21b-kube-api-access-qzj7v\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.267847 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.267715    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af17d116-5e55-4479-93b9-31ef9584f21b-console-serving-cert\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.368809 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.368775    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af17d116-5e55-4479-93b9-31ef9584f21b-console-oauth-config\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.368970 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.368825    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-oauth-serving-cert\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.369022 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.368963    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-console-config\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.369022 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.369009    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-service-ca\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.369085 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.369042    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzj7v\" (UniqueName: \"kubernetes.io/projected/af17d116-5e55-4479-93b9-31ef9584f21b-kube-api-access-qzj7v\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.369085 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.369071    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af17d116-5e55-4479-93b9-31ef9584f21b-console-serving-cert\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.369595 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.369567    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-oauth-serving-cert\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.369720 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.369696    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-service-ca\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.369831 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.369787    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-console-config\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.371777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.371753    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af17d116-5e55-4479-93b9-31ef9584f21b-console-oauth-config\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.371971 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.371952    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af17d116-5e55-4479-93b9-31ef9584f21b-console-serving-cert\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.379940 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.379916    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzj7v\" (UniqueName: \"kubernetes.io/projected/af17d116-5e55-4479-93b9-31ef9584f21b-kube-api-access-qzj7v\") pod \"console-687dd44574-z4l2r\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") " pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.495976 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.495947    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:36.680943 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.680910    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687dd44574-z4l2r"]
Jul 07 18:52:36.684584 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:52:36.684556    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf17d116_5e55_4479_93b9_31ef9584f21b.slice/crio-61b57d8a80e9a60934d8ad97db399a32bfc6bcd630a1d758397b6a2ee1886ecf WatchSource:0}: Error finding container 61b57d8a80e9a60934d8ad97db399a32bfc6bcd630a1d758397b6a2ee1886ecf: Status 404 returned error can't find the container with id 61b57d8a80e9a60934d8ad97db399a32bfc6bcd630a1d758397b6a2ee1886ecf
Jul 07 18:52:36.928980 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:36.928901    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dd44574-z4l2r" event={"ID":"af17d116-5e55-4479-93b9-31ef9584f21b","Type":"ContainerStarted","Data":"61b57d8a80e9a60934d8ad97db399a32bfc6bcd630a1d758397b6a2ee1886ecf"}
Jul 07 18:52:44.299316 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.299265    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54f7b5fb74-htjlh"]
Jul 07 18:52:44.402546 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.402503    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f7b5fb74-htjlh"]
Jul 07 18:52:44.402706 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.402644    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.411952 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.411923    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 18:52:44.434342 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.434307    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-oauth-config\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.434506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.434352    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-config\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.434506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.434369    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29gbb\" (UniqueName: \"kubernetes.io/projected/1fe83610-aff0-44a2-ae1a-96a8caaddea2-kube-api-access-29gbb\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.434506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.434398    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-serving-cert\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.434506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.434475    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-trusted-ca-bundle\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.434668 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.434537    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-oauth-serving-cert\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.434668 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.434567    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-service-ca\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.535355 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.535314    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-oauth-serving-cert\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.535355 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.535368    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-service-ca\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.535625 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.535422    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-oauth-config\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.535625 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.535456    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-config\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.535625 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.535483    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29gbb\" (UniqueName: \"kubernetes.io/projected/1fe83610-aff0-44a2-ae1a-96a8caaddea2-kube-api-access-29gbb\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.535625 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.535523    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-serving-cert\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.535625 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.535559    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-trusted-ca-bundle\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.536369 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.536332    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-oauth-serving-cert\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.536369 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.536359    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-trusted-ca-bundle\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.536545 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.536358    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-config\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.536677 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.536648    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-service-ca\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.538449 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.538392    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-oauth-config\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.538449 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.538420    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-serving-cert\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.548344 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.548317    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29gbb\" (UniqueName: \"kubernetes.io/projected/1fe83610-aff0-44a2-ae1a-96a8caaddea2-kube-api-access-29gbb\") pod \"console-54f7b5fb74-htjlh\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") " pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:44.714024 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:44.713928    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:47.066661 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:47.066633    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f7b5fb74-htjlh"]
Jul 07 18:52:47.069540 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:52:47.069511    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fe83610_aff0_44a2_ae1a_96a8caaddea2.slice/crio-0cc967eed928d82fd5303bd3b993e581f584364602e50401af6ff6ac48b0cbba WatchSource:0}: Error finding container 0cc967eed928d82fd5303bd3b993e581f584364602e50401af6ff6ac48b0cbba: Status 404 returned error can't find the container with id 0cc967eed928d82fd5303bd3b993e581f584364602e50401af6ff6ac48b0cbba
Jul 07 18:52:47.977213 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:47.977172    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f7b5fb74-htjlh" event={"ID":"1fe83610-aff0-44a2-ae1a-96a8caaddea2","Type":"ContainerStarted","Data":"61e360ce09cdeee9c9f09950ec4285b8c1d3f9e45ae8ee1e3889155f375d365f"}
Jul 07 18:52:47.977430 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:47.977235    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f7b5fb74-htjlh" event={"ID":"1fe83610-aff0-44a2-ae1a-96a8caaddea2","Type":"ContainerStarted","Data":"0cc967eed928d82fd5303bd3b993e581f584364602e50401af6ff6ac48b0cbba"}
Jul 07 18:52:47.979345 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:47.979308    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dd44574-z4l2r" event={"ID":"af17d116-5e55-4479-93b9-31ef9584f21b","Type":"ContainerStarted","Data":"4c8f27ea868fcf19ecd856f9c33a9862c19ee45a86a6fbdc6c07ba4962f8bbd7"}
Jul 07 18:52:47.981102 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:47.981071    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-zsqss" event={"ID":"bba9d0d3-22b2-4b68-9e09-18900df3c331","Type":"ContainerStarted","Data":"b65ddf42c5ea16d9fae01a3e7d8819c0837ead2480925d55b178f06d4e9b1902"}
Jul 07 18:52:47.981433 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:47.981378    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-zsqss"
Jul 07 18:52:47.997368 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:47.997334    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-zsqss"
Jul 07 18:52:47.998642 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:47.998586    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54f7b5fb74-htjlh" podStartSLOduration=3.998564863 podStartE2EDuration="3.998564863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:47.997645247 +0000 UTC m=+117.156985095" watchObservedRunningTime="2026-07-07 18:52:47.998564863 +0000 UTC m=+117.157904786"
Jul 07 18:52:48.017815 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:48.017754    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-zsqss" podStartSLOduration=2.460540515 podStartE2EDuration="23.017735418s" totalImagesPullingTime="20.557194903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:48.017040933 +0000 UTC m=+117.176380788" watchObservedRunningTime="2026-07-07 18:52:48.017735418 +0000 UTC m=+117.177075244"
Jul 07 18:52:48.042669 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:48.042600    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-687dd44574-z4l2r" podStartSLOduration=1.7985743379999999 podStartE2EDuration="12.042581508s" totalImagesPullingTime="10.24400717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:48.040864761 +0000 UTC m=+117.200204614" watchObservedRunningTime="2026-07-07 18:52:48.042581508 +0000 UTC m=+117.201921335"
Jul 07 18:52:52.135735 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:52.135692    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-pfdjn_3c92739e-dfff-4707-a4e0-a59624579add/monitoring-plugin/0.log"
Jul 07 18:52:53.536075 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:53.536043    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqwmx_9c674a43-baea-4422-897d-2c3d3c9add1e/init-textfile/0.log"
Jul 07 18:52:53.737443 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:53.737412    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqwmx_9c674a43-baea-4422-897d-2c3d3c9add1e/node-exporter/0.log"
Jul 07 18:52:53.936067 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:53.935992    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqwmx_9c674a43-baea-4422-897d-2c3d3c9add1e/kube-rbac-proxy/0.log"
Jul 07 18:52:54.714424 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:54.714370    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:54.714895 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:54.714470    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:54.720085 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:54.720057    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:55.015603 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:55.015571    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:52:55.091615 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:55.091577    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687dd44574-z4l2r"]
Jul 07 18:52:56.496871 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:56.496836    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:52:57.336199 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:57.336168    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67587cbcb6-6hlnj_c8c8a24c-43b5-46d6-8647-0cd74c0110e0/thanos-query/0.log"
Jul 07 18:52:57.535307 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:57.535277    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67587cbcb6-6hlnj_c8c8a24c-43b5-46d6-8647-0cd74c0110e0/kube-rbac-proxy-web/0.log"
Jul 07 18:52:57.737835 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:57.736314    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67587cbcb6-6hlnj_c8c8a24c-43b5-46d6-8647-0cd74c0110e0/kube-rbac-proxy/0.log"
Jul 07 18:52:57.939067 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:57.939036    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67587cbcb6-6hlnj_c8c8a24c-43b5-46d6-8647-0cd74c0110e0/prom-label-proxy/0.log"
Jul 07 18:52:58.137310 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:58.137226    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67587cbcb6-6hlnj_c8c8a24c-43b5-46d6-8647-0cd74c0110e0/kube-rbac-proxy-rules/0.log"
Jul 07 18:52:58.334866 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:58.334836    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67587cbcb6-6hlnj_c8c8a24c-43b5-46d6-8647-0cd74c0110e0/kube-rbac-proxy-metrics/0.log"
Jul 07 18:52:58.536099 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:58.536054    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-hzff8_dc458f9c-4c0f-40f0-84c3-b14b7daa7c08/networking-console-plugin/0.log"
Jul 07 18:52:59.135221 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:59.135190    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54f7b5fb74-htjlh_1fe83610-aff0-44a2-ae1a-96a8caaddea2/console/0.log"
Jul 07 18:52:59.335719 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:59.335694    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-687dd44574-z4l2r_af17d116-5e55-4479-93b9-31ef9584f21b/console/0.log"
Jul 07 18:52:59.538201 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:52:59.538166    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-zsqss_bba9d0d3-22b2-4b68-9e09-18900df3c331/download-server/0.log"
Jul 07 18:53:20.115348 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.115292    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-687dd44574-z4l2r" podUID="af17d116-5e55-4479-93b9-31ef9584f21b" containerName="console" containerID="cri-o://4c8f27ea868fcf19ecd856f9c33a9862c19ee45a86a6fbdc6c07ba4962f8bbd7" gracePeriod=15
Jul 07 18:53:20.397370 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.397341    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:53:20.544109 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.544070    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af17d116-5e55-4479-93b9-31ef9584f21b-console-oauth-config\") pod \"af17d116-5e55-4479-93b9-31ef9584f21b\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") "
Jul 07 18:53:20.544109 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.544115    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-console-config\") pod \"af17d116-5e55-4479-93b9-31ef9584f21b\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") "
Jul 07 18:53:20.544337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.544181    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-service-ca\") pod \"af17d116-5e55-4479-93b9-31ef9584f21b\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") "
Jul 07 18:53:20.544337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.544221    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af17d116-5e55-4479-93b9-31ef9584f21b-console-serving-cert\") pod \"af17d116-5e55-4479-93b9-31ef9584f21b\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") "
Jul 07 18:53:20.544337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.544252    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzj7v\" (UniqueName: \"kubernetes.io/projected/af17d116-5e55-4479-93b9-31ef9584f21b-kube-api-access-qzj7v\") pod \"af17d116-5e55-4479-93b9-31ef9584f21b\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") "
Jul 07 18:53:20.544337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.544288    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-oauth-serving-cert\") pod \"af17d116-5e55-4479-93b9-31ef9584f21b\" (UID: \"af17d116-5e55-4479-93b9-31ef9584f21b\") "
Jul 07 18:53:20.544681 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.544641    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-console-config" (OuterVolumeSpecName: "console-config") pod "af17d116-5e55-4479-93b9-31ef9584f21b" (UID: "af17d116-5e55-4479-93b9-31ef9584f21b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:53:20.544838 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.544792    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-service-ca" (OuterVolumeSpecName: "service-ca") pod "af17d116-5e55-4479-93b9-31ef9584f21b" (UID: "af17d116-5e55-4479-93b9-31ef9584f21b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:53:20.544891 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.544814    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "af17d116-5e55-4479-93b9-31ef9584f21b" (UID: "af17d116-5e55-4479-93b9-31ef9584f21b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:53:20.546383 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.546354    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af17d116-5e55-4479-93b9-31ef9584f21b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "af17d116-5e55-4479-93b9-31ef9584f21b" (UID: "af17d116-5e55-4479-93b9-31ef9584f21b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:53:20.546751 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.546732    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af17d116-5e55-4479-93b9-31ef9584f21b-kube-api-access-qzj7v" (OuterVolumeSpecName: "kube-api-access-qzj7v") pod "af17d116-5e55-4479-93b9-31ef9584f21b" (UID: "af17d116-5e55-4479-93b9-31ef9584f21b"). InnerVolumeSpecName "kube-api-access-qzj7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:53:20.546894 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.546732    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af17d116-5e55-4479-93b9-31ef9584f21b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "af17d116-5e55-4479-93b9-31ef9584f21b" (UID: "af17d116-5e55-4479-93b9-31ef9584f21b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:53:20.645371 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.645292    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af17d116-5e55-4479-93b9-31ef9584f21b-console-oauth-config\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:53:20.645371 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.645321    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-console-config\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:53:20.645371 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.645330    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:53:20.645371 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.645338    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af17d116-5e55-4479-93b9-31ef9584f21b-console-serving-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:53:20.645371 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.645347    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzj7v\" (UniqueName: \"kubernetes.io/projected/af17d116-5e55-4479-93b9-31ef9584f21b-kube-api-access-qzj7v\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:53:20.645371 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:20.645355    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af17d116-5e55-4479-93b9-31ef9584f21b-oauth-serving-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:53:21.110077 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:21.110045    2554 generic.go:356] "Generic (PLEG): container finished" podID="af17d116-5e55-4479-93b9-31ef9584f21b" containerID="4c8f27ea868fcf19ecd856f9c33a9862c19ee45a86a6fbdc6c07ba4962f8bbd7" exitCode=0
Jul 07 18:53:21.110253 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:21.110090    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dd44574-z4l2r"
Jul 07 18:53:21.110253 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:21.110106    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dd44574-z4l2r" event={"ID":"af17d116-5e55-4479-93b9-31ef9584f21b","Type":"ContainerDied","Data":"4c8f27ea868fcf19ecd856f9c33a9862c19ee45a86a6fbdc6c07ba4962f8bbd7"}
Jul 07 18:53:21.110253 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:21.110145    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dd44574-z4l2r" event={"ID":"af17d116-5e55-4479-93b9-31ef9584f21b","Type":"ContainerDied","Data":"61b57d8a80e9a60934d8ad97db399a32bfc6bcd630a1d758397b6a2ee1886ecf"}
Jul 07 18:53:21.110253 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:21.110165    2554 scope.go:117] "RemoveContainer" containerID="4c8f27ea868fcf19ecd856f9c33a9862c19ee45a86a6fbdc6c07ba4962f8bbd7"
Jul 07 18:53:21.119134 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:21.118999    2554 scope.go:117] "RemoveContainer" containerID="4c8f27ea868fcf19ecd856f9c33a9862c19ee45a86a6fbdc6c07ba4962f8bbd7"
Jul 07 18:53:21.119358 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:53:21.119257    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c8f27ea868fcf19ecd856f9c33a9862c19ee45a86a6fbdc6c07ba4962f8bbd7\": container with ID starting with 4c8f27ea868fcf19ecd856f9c33a9862c19ee45a86a6fbdc6c07ba4962f8bbd7 not found: ID does not exist" containerID="4c8f27ea868fcf19ecd856f9c33a9862c19ee45a86a6fbdc6c07ba4962f8bbd7"
Jul 07 18:53:21.119358 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:21.119285    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8f27ea868fcf19ecd856f9c33a9862c19ee45a86a6fbdc6c07ba4962f8bbd7"} err="failed to get container status \"4c8f27ea868fcf19ecd856f9c33a9862c19ee45a86a6fbdc6c07ba4962f8bbd7\": rpc error: code = NotFound desc = could not find container \"4c8f27ea868fcf19ecd856f9c33a9862c19ee45a86a6fbdc6c07ba4962f8bbd7\": container with ID starting with 4c8f27ea868fcf19ecd856f9c33a9862c19ee45a86a6fbdc6c07ba4962f8bbd7 not found: ID does not exist"
Jul 07 18:53:21.149305 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:21.149274    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687dd44574-z4l2r"]
Jul 07 18:53:21.152138 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:21.152116    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-687dd44574-z4l2r"]
Jul 07 18:53:21.473764 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:21.473687    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af17d116-5e55-4479-93b9-31ef9584f21b" path="/var/lib/kubelet/pods/af17d116-5e55-4479-93b9-31ef9584f21b/volumes"
Jul 07 18:53:31.474729 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.474697    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-ff6c6d876-clbg9"]
Jul 07 18:53:31.475239 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.474968    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af17d116-5e55-4479-93b9-31ef9584f21b" containerName="console"
Jul 07 18:53:31.475239 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.474980    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="af17d116-5e55-4479-93b9-31ef9584f21b" containerName="console"
Jul 07 18:53:31.475239 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.475030    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="af17d116-5e55-4479-93b9-31ef9584f21b" containerName="console"
Jul 07 18:53:31.504207 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.504180    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ff6c6d876-clbg9"]
Jul 07 18:53:31.504362 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.504273    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.525241 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.525210    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-console-config\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.525241 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.525240    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-service-ca\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.525440 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.525273    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6663035b-3e91-4757-942d-ca13b925356f-console-oauth-config\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.525440 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.525317    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-trusted-ca-bundle\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.525440 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.525370    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-oauth-serving-cert\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.525440 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.525399    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6663035b-3e91-4757-942d-ca13b925356f-console-serving-cert\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.525440 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.525413    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2x69\" (UniqueName: \"kubernetes.io/projected/6663035b-3e91-4757-942d-ca13b925356f-kube-api-access-c2x69\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.626033 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.625996    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-console-config\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.626033 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.626029    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-service-ca\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.626284 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.626059    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6663035b-3e91-4757-942d-ca13b925356f-console-oauth-config\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.626284 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.626080    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-trusted-ca-bundle\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.626284 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.626112    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-oauth-serving-cert\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.626284 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.626162    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6663035b-3e91-4757-942d-ca13b925356f-console-serving-cert\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.626284 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.626185    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2x69\" (UniqueName: \"kubernetes.io/projected/6663035b-3e91-4757-942d-ca13b925356f-kube-api-access-c2x69\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.626778 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.626753    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-console-config\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.626916 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.626895    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-service-ca\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.626999 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.626975    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-oauth-serving-cert\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.627047 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.627030    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-trusted-ca-bundle\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.628467 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.628446    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6663035b-3e91-4757-942d-ca13b925356f-console-oauth-config\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.628745 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.628723    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6663035b-3e91-4757-942d-ca13b925356f-console-serving-cert\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.636874 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.636849    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2x69\" (UniqueName: \"kubernetes.io/projected/6663035b-3e91-4757-942d-ca13b925356f-kube-api-access-c2x69\") pod \"console-ff6c6d876-clbg9\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") " pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.813287 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.813250    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:31.981762 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:31.981730    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ff6c6d876-clbg9"]
Jul 07 18:53:31.985687 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:53:31.985663    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6663035b_3e91_4757_942d_ca13b925356f.slice/crio-9644ae97fbe08fbd046d532de1d33d1a4983e26680a2fa8247d36988c1f5bc89 WatchSource:0}: Error finding container 9644ae97fbe08fbd046d532de1d33d1a4983e26680a2fa8247d36988c1f5bc89: Status 404 returned error can't find the container with id 9644ae97fbe08fbd046d532de1d33d1a4983e26680a2fa8247d36988c1f5bc89
Jul 07 18:53:32.153752 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:32.153708    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff6c6d876-clbg9" event={"ID":"6663035b-3e91-4757-942d-ca13b925356f","Type":"ContainerStarted","Data":"b2b7c219b0f79ed74e4f6b3eee112e78cb2222e6a19b3342a2c0caee085d13e1"}
Jul 07 18:53:32.153934 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:32.153773    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff6c6d876-clbg9" event={"ID":"6663035b-3e91-4757-942d-ca13b925356f","Type":"ContainerStarted","Data":"9644ae97fbe08fbd046d532de1d33d1a4983e26680a2fa8247d36988c1f5bc89"}
Jul 07 18:53:32.174135 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:32.174084    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-ff6c6d876-clbg9" podStartSLOduration=1.174067788 podStartE2EDuration="1.174067788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:53:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:53:32.172728287 +0000 UTC m=+161.332068150" watchObservedRunningTime="2026-07-07 18:53:32.174067788 +0000 UTC m=+161.333407613"
Jul 07 18:53:41.814376 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:41.814342    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:41.814892 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:41.814585    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:41.819167 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:41.819145    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:42.193127 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:42.193051    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:53:42.244057 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:53:42.244025    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f7b5fb74-htjlh"]
Jul 07 18:54:07.270252 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.270183    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54f7b5fb74-htjlh" podUID="1fe83610-aff0-44a2-ae1a-96a8caaddea2" containerName="console" containerID="cri-o://61e360ce09cdeee9c9f09950ec4285b8c1d3f9e45ae8ee1e3889155f375d365f" gracePeriod=15
Jul 07 18:54:07.509479 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.509453    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:54:07.585633 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.585559    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-serving-cert\") pod \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") "
Jul 07 18:54:07.585633 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.585603    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-trusted-ca-bundle\") pod \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") "
Jul 07 18:54:07.585844 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.585651    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-config\") pod \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") "
Jul 07 18:54:07.585844 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.585675    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29gbb\" (UniqueName: \"kubernetes.io/projected/1fe83610-aff0-44a2-ae1a-96a8caaddea2-kube-api-access-29gbb\") pod \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") "
Jul 07 18:54:07.585844 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.585699    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-oauth-config\") pod \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") "
Jul 07 18:54:07.585844 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.585744    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-oauth-serving-cert\") pod \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") "
Jul 07 18:54:07.586070 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.585849    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-service-ca\") pod \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\" (UID: \"1fe83610-aff0-44a2-ae1a-96a8caaddea2\") "
Jul 07 18:54:07.586216 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.586176    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1fe83610-aff0-44a2-ae1a-96a8caaddea2" (UID: "1fe83610-aff0-44a2-ae1a-96a8caaddea2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:54:07.586216 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.586174    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1fe83610-aff0-44a2-ae1a-96a8caaddea2" (UID: "1fe83610-aff0-44a2-ae1a-96a8caaddea2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:54:07.586216 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.586078    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-config" (OuterVolumeSpecName: "console-config") pod "1fe83610-aff0-44a2-ae1a-96a8caaddea2" (UID: "1fe83610-aff0-44a2-ae1a-96a8caaddea2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:54:07.586416 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.586266    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-service-ca" (OuterVolumeSpecName: "service-ca") pod "1fe83610-aff0-44a2-ae1a-96a8caaddea2" (UID: "1fe83610-aff0-44a2-ae1a-96a8caaddea2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:54:07.586416 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.586326    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:54:07.586416 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.586343    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-trusted-ca-bundle\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:54:07.586416 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.586358    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-config\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:54:07.586416 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.586375    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1fe83610-aff0-44a2-ae1a-96a8caaddea2-oauth-serving-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:54:07.587737 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.587711    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1fe83610-aff0-44a2-ae1a-96a8caaddea2" (UID: "1fe83610-aff0-44a2-ae1a-96a8caaddea2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:54:07.588153 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.588127    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1fe83610-aff0-44a2-ae1a-96a8caaddea2" (UID: "1fe83610-aff0-44a2-ae1a-96a8caaddea2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:54:07.588153 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.588128    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fe83610-aff0-44a2-ae1a-96a8caaddea2-kube-api-access-29gbb" (OuterVolumeSpecName: "kube-api-access-29gbb") pod "1fe83610-aff0-44a2-ae1a-96a8caaddea2" (UID: "1fe83610-aff0-44a2-ae1a-96a8caaddea2"). InnerVolumeSpecName "kube-api-access-29gbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:54:07.687528 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.687488    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-serving-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:54:07.687528 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.687525    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29gbb\" (UniqueName: \"kubernetes.io/projected/1fe83610-aff0-44a2-ae1a-96a8caaddea2-kube-api-access-29gbb\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:54:07.687528 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:07.687534    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1fe83610-aff0-44a2-ae1a-96a8caaddea2-console-oauth-config\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:54:08.281321 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:08.281289    2554 generic.go:356] "Generic (PLEG): container finished" podID="1fe83610-aff0-44a2-ae1a-96a8caaddea2" containerID="61e360ce09cdeee9c9f09950ec4285b8c1d3f9e45ae8ee1e3889155f375d365f" exitCode=0
Jul 07 18:54:08.281714 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:08.281337    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f7b5fb74-htjlh"
Jul 07 18:54:08.281714 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:08.281340    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f7b5fb74-htjlh" event={"ID":"1fe83610-aff0-44a2-ae1a-96a8caaddea2","Type":"ContainerDied","Data":"61e360ce09cdeee9c9f09950ec4285b8c1d3f9e45ae8ee1e3889155f375d365f"}
Jul 07 18:54:08.281714 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:08.281466    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f7b5fb74-htjlh" event={"ID":"1fe83610-aff0-44a2-ae1a-96a8caaddea2","Type":"ContainerDied","Data":"0cc967eed928d82fd5303bd3b993e581f584364602e50401af6ff6ac48b0cbba"}
Jul 07 18:54:08.281714 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:08.281494    2554 scope.go:117] "RemoveContainer" containerID="61e360ce09cdeee9c9f09950ec4285b8c1d3f9e45ae8ee1e3889155f375d365f"
Jul 07 18:54:08.289942 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:08.289924    2554 scope.go:117] "RemoveContainer" containerID="61e360ce09cdeee9c9f09950ec4285b8c1d3f9e45ae8ee1e3889155f375d365f"
Jul 07 18:54:08.290181 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:54:08.290164    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61e360ce09cdeee9c9f09950ec4285b8c1d3f9e45ae8ee1e3889155f375d365f\": container with ID starting with 61e360ce09cdeee9c9f09950ec4285b8c1d3f9e45ae8ee1e3889155f375d365f not found: ID does not exist" containerID="61e360ce09cdeee9c9f09950ec4285b8c1d3f9e45ae8ee1e3889155f375d365f"
Jul 07 18:54:08.290234 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:08.290188    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61e360ce09cdeee9c9f09950ec4285b8c1d3f9e45ae8ee1e3889155f375d365f"} err="failed to get container status \"61e360ce09cdeee9c9f09950ec4285b8c1d3f9e45ae8ee1e3889155f375d365f\": rpc error: code = NotFound desc = could not find container \"61e360ce09cdeee9c9f09950ec4285b8c1d3f9e45ae8ee1e3889155f375d365f\": container with ID starting with 61e360ce09cdeee9c9f09950ec4285b8c1d3f9e45ae8ee1e3889155f375d365f not found: ID does not exist"
Jul 07 18:54:08.302039 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:08.302016    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f7b5fb74-htjlh"]
Jul 07 18:54:08.306432 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:08.306407    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54f7b5fb74-htjlh"]
Jul 07 18:54:09.473087 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:09.473047    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fe83610-aff0-44a2-ae1a-96a8caaddea2" path="/var/lib/kubelet/pods/1fe83610-aff0-44a2-ae1a-96a8caaddea2/volumes"
Jul 07 18:54:58.241176 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.241140    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-n5nv5"]
Jul 07 18:54:58.241617 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.241407    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe83610-aff0-44a2-ae1a-96a8caaddea2" containerName="console"
Jul 07 18:54:58.241617 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.241423    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe83610-aff0-44a2-ae1a-96a8caaddea2" containerName="console"
Jul 07 18:54:58.241617 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.241479    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fe83610-aff0-44a2-ae1a-96a8caaddea2" containerName="console"
Jul 07 18:54:58.243483 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.243463    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-n5nv5"
Jul 07 18:54:58.246124 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.246099    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 18:54:58.246228 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.246100    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4mcp8\""
Jul 07 18:54:58.247133 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.247114    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 18:54:58.256070 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.256045    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-n5nv5"]
Jul 07 18:54:58.360464 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.360429    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2k5s\" (UniqueName: \"kubernetes.io/projected/5667a5ab-b768-4d48-a01b-743dca70d60b-kube-api-access-t2k5s\") pod \"cert-manager-55b4d954d5-n5nv5\" (UID: \"5667a5ab-b768-4d48-a01b-743dca70d60b\") " pod="cert-manager/cert-manager-55b4d954d5-n5nv5"
Jul 07 18:54:58.360623 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.360483    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5667a5ab-b768-4d48-a01b-743dca70d60b-bound-sa-token\") pod \"cert-manager-55b4d954d5-n5nv5\" (UID: \"5667a5ab-b768-4d48-a01b-743dca70d60b\") " pod="cert-manager/cert-manager-55b4d954d5-n5nv5"
Jul 07 18:54:58.461735 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.461703    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5667a5ab-b768-4d48-a01b-743dca70d60b-bound-sa-token\") pod \"cert-manager-55b4d954d5-n5nv5\" (UID: \"5667a5ab-b768-4d48-a01b-743dca70d60b\") " pod="cert-manager/cert-manager-55b4d954d5-n5nv5"
Jul 07 18:54:58.461879 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.461759    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2k5s\" (UniqueName: \"kubernetes.io/projected/5667a5ab-b768-4d48-a01b-743dca70d60b-kube-api-access-t2k5s\") pod \"cert-manager-55b4d954d5-n5nv5\" (UID: \"5667a5ab-b768-4d48-a01b-743dca70d60b\") " pod="cert-manager/cert-manager-55b4d954d5-n5nv5"
Jul 07 18:54:58.474416 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.474386    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5667a5ab-b768-4d48-a01b-743dca70d60b-bound-sa-token\") pod \"cert-manager-55b4d954d5-n5nv5\" (UID: \"5667a5ab-b768-4d48-a01b-743dca70d60b\") " pod="cert-manager/cert-manager-55b4d954d5-n5nv5"
Jul 07 18:54:58.475692 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.475670    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2k5s\" (UniqueName: \"kubernetes.io/projected/5667a5ab-b768-4d48-a01b-743dca70d60b-kube-api-access-t2k5s\") pod \"cert-manager-55b4d954d5-n5nv5\" (UID: \"5667a5ab-b768-4d48-a01b-743dca70d60b\") " pod="cert-manager/cert-manager-55b4d954d5-n5nv5"
Jul 07 18:54:58.552400 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.552313    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-n5nv5"
Jul 07 18:54:58.681834 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:58.681809    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-n5nv5"]
Jul 07 18:54:58.686039 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:54:58.684622    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5667a5ab_b768_4d48_a01b_743dca70d60b.slice/crio-7eee390764c9dbf0908b2deb729ef6221a4c9e825a26c19e292830590b0b36bf WatchSource:0}: Error finding container 7eee390764c9dbf0908b2deb729ef6221a4c9e825a26c19e292830590b0b36bf: Status 404 returned error can't find the container with id 7eee390764c9dbf0908b2deb729ef6221a4c9e825a26c19e292830590b0b36bf
Jul 07 18:54:59.458778 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:54:59.458741    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-n5nv5" event={"ID":"5667a5ab-b768-4d48-a01b-743dca70d60b","Type":"ContainerStarted","Data":"7eee390764c9dbf0908b2deb729ef6221a4c9e825a26c19e292830590b0b36bf"}
Jul 07 18:55:02.472781 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:02.472688    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-n5nv5" event={"ID":"5667a5ab-b768-4d48-a01b-743dca70d60b","Type":"ContainerStarted","Data":"4a7bb05cf4a86ce931cfc8234e43e69ac6ed1a7290fa30d97b74174a06bb7729"}
Jul 07 18:55:02.491143 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:02.491089    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-n5nv5" podStartSLOduration=0.992798089 podStartE2EDuration="4.491074134s" totalImagesPullingTime="3.498276045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:02.490307923 +0000 UTC m=+251.649647739" watchObservedRunningTime="2026-07-07 18:55:02.491074134 +0000 UTC m=+251.650413961"
Jul 07 18:55:23.747195 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.747047    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"]
Jul 07 18:55:23.749356 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.749335    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:23.756221 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:55:23.756197    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="54277aa2-6b22-4c76-a7b0-1c8173aef939" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:23.756515 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:55:23.756497    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-6rxgb\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6rxgb\"" type="*v1.Secret"
Jul 07 18:55:23.756560 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:55:23.756515    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 07 18:55:23.756560 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:55:23.756516    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret"
Jul 07 18:55:23.757059 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:55:23.757032    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret"
Jul 07 18:55:23.757103 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:55:23.757083    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 07 18:55:23.798185 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.798162    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"]
Jul 07 18:55:23.838876 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.838850    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54277aa2-6b22-4c76-a7b0-1c8173aef939-tmp\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:23.838989 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.838897    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/54277aa2-6b22-4c76-a7b0-1c8173aef939-manifests\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:23.838989 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.838920    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrbjc\" (UniqueName: \"kubernetes.io/projected/54277aa2-6b22-4c76-a7b0-1c8173aef939-kube-api-access-lrbjc\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:23.838989 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.838939    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54277aa2-6b22-4c76-a7b0-1c8173aef939-webhook-cert\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:23.838989 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.838986    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/54277aa2-6b22-4c76-a7b0-1c8173aef939-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:23.939993 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.939958    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/54277aa2-6b22-4c76-a7b0-1c8173aef939-manifests\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:23.939993 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.939997    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrbjc\" (UniqueName: \"kubernetes.io/projected/54277aa2-6b22-4c76-a7b0-1c8173aef939-kube-api-access-lrbjc\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:23.940209 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.940016    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54277aa2-6b22-4c76-a7b0-1c8173aef939-webhook-cert\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:23.940209 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.940056    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/54277aa2-6b22-4c76-a7b0-1c8173aef939-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:23.940209 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.940097    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54277aa2-6b22-4c76-a7b0-1c8173aef939-tmp\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:23.940427 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.940402    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/54277aa2-6b22-4c76-a7b0-1c8173aef939-manifests\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:23.942112 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:23.942095    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54277aa2-6b22-4c76-a7b0-1c8173aef939-tmp\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:24.580778 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:24.580749    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 18:55:24.817457 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:24.817427    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 18:55:24.837084 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:24.837036    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6rxgb\""
Jul 07 18:55:24.857410 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:24.857389    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 18:55:24.863136 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:24.863112    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/54277aa2-6b22-4c76-a7b0-1c8173aef939-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:24.863232 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:24.863112    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/54277aa2-6b22-4c76-a7b0-1c8173aef939-webhook-cert\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:24.971673 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:55:24.971649    2554 projected.go:291] Couldn't get configMap opendatahub/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 07 18:55:24.971780 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:55:24.971682    2554 projected.go:196] Error preparing data for projected volume kube-api-access-lrbjc for pod opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84: failed to sync configmap cache: timed out waiting for the condition
Jul 07 18:55:24.971780 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:55:24.971750    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54277aa2-6b22-4c76-a7b0-1c8173aef939-kube-api-access-lrbjc podName:54277aa2-6b22-4c76-a7b0-1c8173aef939 nodeName:}" failed. No retries permitted until 2026-07-07 18:55:25.471730629 +0000 UTC m=+274.631070450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lrbjc" (UniqueName: "kubernetes.io/projected/54277aa2-6b22-4c76-a7b0-1c8173aef939-kube-api-access-lrbjc") pod "opendatahub-operator-controller-manager-6465cd6bcf-d2r84" (UID: "54277aa2-6b22-4c76-a7b0-1c8173aef939") : failed to sync configmap cache: timed out waiting for the condition
Jul 07 18:55:25.234251 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:25.234229    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 18:55:25.551289 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:25.551214    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrbjc\" (UniqueName: \"kubernetes.io/projected/54277aa2-6b22-4c76-a7b0-1c8173aef939-kube-api-access-lrbjc\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:25.553634 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:25.553617    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrbjc\" (UniqueName: \"kubernetes.io/projected/54277aa2-6b22-4c76-a7b0-1c8173aef939-kube-api-access-lrbjc\") pod \"opendatahub-operator-controller-manager-6465cd6bcf-d2r84\" (UID: \"54277aa2-6b22-4c76-a7b0-1c8173aef939\") " pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:25.558444 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:25.558422    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:25.693397 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:25.693373    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"]
Jul 07 18:55:25.695845 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:55:25.695820    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54277aa2_6b22_4c76_a7b0_1c8173aef939.slice/crio-34856c4400d5574476978f45e064ec5495781dd9bea10a82a394cf05511e9ac9 WatchSource:0}: Error finding container 34856c4400d5574476978f45e064ec5495781dd9bea10a82a394cf05511e9ac9: Status 404 returned error can't find the container with id 34856c4400d5574476978f45e064ec5495781dd9bea10a82a394cf05511e9ac9
Jul 07 18:55:26.553685 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:26.553644    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84" event={"ID":"54277aa2-6b22-4c76-a7b0-1c8173aef939","Type":"ContainerStarted","Data":"34856c4400d5574476978f45e064ec5495781dd9bea10a82a394cf05511e9ac9"}
Jul 07 18:55:28.565661 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:28.565624    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84" event={"ID":"54277aa2-6b22-4c76-a7b0-1c8173aef939","Type":"ContainerStarted","Data":"51f1858125896b9fee77a4777ac515f546490837fa84d1076082a1a90adb426d"}
Jul 07 18:55:30.575073 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:30.575039    2554 generic.go:356] "Generic (PLEG): container finished" podID="54277aa2-6b22-4c76-a7b0-1c8173aef939" containerID="51f1858125896b9fee77a4777ac515f546490837fa84d1076082a1a90adb426d" exitCode=0
Jul 07 18:55:30.575073 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:30.575082    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84" event={"ID":"54277aa2-6b22-4c76-a7b0-1c8173aef939","Type":"ContainerDied","Data":"51f1858125896b9fee77a4777ac515f546490837fa84d1076082a1a90adb426d"}
Jul 07 18:55:31.579829 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:31.579777    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84" event={"ID":"54277aa2-6b22-4c76-a7b0-1c8173aef939","Type":"ContainerStarted","Data":"af8e7f0d552757928c288b0c375fa4a443f8db5f626a34da4adf8786e41f28bb"}
Jul 07 18:55:31.580299 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:31.580027    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:31.613584 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:31.613537    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84" podStartSLOduration=4.431535581 podStartE2EDuration="8.613522462s" totalImagesPullingTime="3.108922866s" totalInitContainerRuntime="1.073064015s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:31.612969983 +0000 UTC m=+280.772309826" watchObservedRunningTime="2026-07-07 18:55:31.613522462 +0000 UTC m=+280.772862287"
Jul 07 18:55:42.586104 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:42.586071    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6465cd6bcf-d2r84"
Jul 07 18:55:51.238840 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.238792    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 18:55:51.241963 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.241940    2554 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 18:55:51.245469 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.245447    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 18:55:51.264769 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.264745    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-566bc96858-pn7fs"]
Jul 07 18:55:51.269255 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.269236    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-566bc96858-pn7fs"
Jul 07 18:55:51.272687 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.272665    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 18:55:51.273939 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.273914    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 18:55:51.274050 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.273917    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 18:55:51.274050 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.273965    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 18:55:51.274050 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.273973    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dx98f\""
Jul 07 18:55:51.283018 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.282997    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-566bc96858-pn7fs"]
Jul 07 18:55:51.345862 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.345837    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46e8bd7d-5903-4ca0-a985-fb0dd1dc7168-tls-certs\") pod \"kube-auth-proxy-566bc96858-pn7fs\" (UID: \"46e8bd7d-5903-4ca0-a985-fb0dd1dc7168\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-pn7fs"
Jul 07 18:55:51.346016 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.345868    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xm2f\" (UniqueName: \"kubernetes.io/projected/46e8bd7d-5903-4ca0-a985-fb0dd1dc7168-kube-api-access-4xm2f\") pod \"kube-auth-proxy-566bc96858-pn7fs\" (UID: \"46e8bd7d-5903-4ca0-a985-fb0dd1dc7168\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-pn7fs"
Jul 07 18:55:51.346016 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.345888    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46e8bd7d-5903-4ca0-a985-fb0dd1dc7168-tmp\") pod \"kube-auth-proxy-566bc96858-pn7fs\" (UID: \"46e8bd7d-5903-4ca0-a985-fb0dd1dc7168\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-pn7fs"
Jul 07 18:55:51.447220 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.447060    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46e8bd7d-5903-4ca0-a985-fb0dd1dc7168-tls-certs\") pod \"kube-auth-proxy-566bc96858-pn7fs\" (UID: \"46e8bd7d-5903-4ca0-a985-fb0dd1dc7168\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-pn7fs"
Jul 07 18:55:51.447220 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.447100    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xm2f\" (UniqueName: \"kubernetes.io/projected/46e8bd7d-5903-4ca0-a985-fb0dd1dc7168-kube-api-access-4xm2f\") pod \"kube-auth-proxy-566bc96858-pn7fs\" (UID: \"46e8bd7d-5903-4ca0-a985-fb0dd1dc7168\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-pn7fs"
Jul 07 18:55:51.447220 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.447118    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46e8bd7d-5903-4ca0-a985-fb0dd1dc7168-tmp\") pod \"kube-auth-proxy-566bc96858-pn7fs\" (UID: \"46e8bd7d-5903-4ca0-a985-fb0dd1dc7168\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-pn7fs"
Jul 07 18:55:51.455378 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.449319    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46e8bd7d-5903-4ca0-a985-fb0dd1dc7168-tmp\") pod \"kube-auth-proxy-566bc96858-pn7fs\" (UID: \"46e8bd7d-5903-4ca0-a985-fb0dd1dc7168\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-pn7fs"
Jul 07 18:55:51.455378 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.449453    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46e8bd7d-5903-4ca0-a985-fb0dd1dc7168-tls-certs\") pod \"kube-auth-proxy-566bc96858-pn7fs\" (UID: \"46e8bd7d-5903-4ca0-a985-fb0dd1dc7168\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-pn7fs"
Jul 07 18:55:51.461106 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.461084    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xm2f\" (UniqueName: \"kubernetes.io/projected/46e8bd7d-5903-4ca0-a985-fb0dd1dc7168-kube-api-access-4xm2f\") pod \"kube-auth-proxy-566bc96858-pn7fs\" (UID: \"46e8bd7d-5903-4ca0-a985-fb0dd1dc7168\") " pod="openshift-ingress/kube-auth-proxy-566bc96858-pn7fs"
Jul 07 18:55:51.583662 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.583563    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-566bc96858-pn7fs"
Jul 07 18:55:51.712943 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:51.712910    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-566bc96858-pn7fs"]
Jul 07 18:55:51.716829 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:55:51.716783    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46e8bd7d_5903_4ca0_a985_fb0dd1dc7168.slice/crio-8115296c602a3f467d855af91c18b9945c5469e259f3b13f8dc1152bc744b71d WatchSource:0}: Error finding container 8115296c602a3f467d855af91c18b9945c5469e259f3b13f8dc1152bc744b71d: Status 404 returned error can't find the container with id 8115296c602a3f467d855af91c18b9945c5469e259f3b13f8dc1152bc744b71d
Jul 07 18:55:52.664042 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:52.664008    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-566bc96858-pn7fs" event={"ID":"46e8bd7d-5903-4ca0-a985-fb0dd1dc7168","Type":"ContainerStarted","Data":"8115296c602a3f467d855af91c18b9945c5469e259f3b13f8dc1152bc744b71d"}
Jul 07 18:55:53.129252 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.129218    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"]
Jul 07 18:55:53.132298 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.132281    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.138861 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.138735    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 18:55:53.138933 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.138910    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 18:55:53.138933 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.138915    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 18:55:53.139032 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.139024    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 18:55:53.139360 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.139341    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h5tm7\""
Jul 07 18:55:53.162108 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.162081    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"]
Jul 07 18:55:53.260767 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.260732    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-cacerts\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.260953 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.260830    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66x4k\" (UniqueName: \"kubernetes.io/projected/fa566303-f9d4-42d5-8062-57dcb16428c9-kube-api-access-66x4k\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.260953 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.260901    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-token\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.260953 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.260949    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.261107 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.260999    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.261107 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.261029    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa566303-f9d4-42d5-8062-57dcb16428c9-local-certs\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.261107 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.261085    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.361602 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.361564    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.361783 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.361610    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.361783 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.361629    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa566303-f9d4-42d5-8062-57dcb16428c9-local-certs\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.361783 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.361647    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.361783 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.361687    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-cacerts\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.361783 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.361704    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66x4k\" (UniqueName: \"kubernetes.io/projected/fa566303-f9d4-42d5-8062-57dcb16428c9-kube-api-access-66x4k\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.361783 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.361735    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-token\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.362349 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.362317    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.363960 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.363939    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa566303-f9d4-42d5-8062-57dcb16428c9-local-certs\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.364061 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.363989    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-cacerts\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.364364 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.364347    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.364422 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.364406    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.382610 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.382552    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-token\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.382898 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.382880    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66x4k\" (UniqueName: \"kubernetes.io/projected/fa566303-f9d4-42d5-8062-57dcb16428c9-kube-api-access-66x4k\") pod \"istiod-openshift-gateway-7574459656-kzjg2\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.441265 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.441232    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:53.644364 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.644282    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"]
Jul 07 18:55:53.647706 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:55:53.647597    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa566303_f9d4_42d5_8062_57dcb16428c9.slice/crio-82b0956a8727bfd6099edbb9eeed22ce69afd2399f822cd243d398c620b4d0ba WatchSource:0}: Error finding container 82b0956a8727bfd6099edbb9eeed22ce69afd2399f822cd243d398c620b4d0ba: Status 404 returned error can't find the container with id 82b0956a8727bfd6099edbb9eeed22ce69afd2399f822cd243d398c620b4d0ba
Jul 07 18:55:53.650069 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.650046    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:55:53.672041 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:53.672005    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2" event={"ID":"fa566303-f9d4-42d5-8062-57dcb16428c9","Type":"ContainerStarted","Data":"82b0956a8727bfd6099edbb9eeed22ce69afd2399f822cd243d398c620b4d0ba"}
Jul 07 18:55:55.683134 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:55.683086    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-566bc96858-pn7fs" event={"ID":"46e8bd7d-5903-4ca0-a985-fb0dd1dc7168","Type":"ContainerStarted","Data":"c1a8c3fdb6eed46150c352783d109507fdc8c68246a1064e20721dc2a1d230ec"}
Jul 07 18:55:55.711276 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:55.711225    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-566bc96858-pn7fs" podStartSLOduration=1.767946083 podStartE2EDuration="4.711205988s" totalImagesPullingTime="2.943259905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:55.709252514 +0000 UTC m=+304.868592342" watchObservedRunningTime="2026-07-07 18:55:55.711205988 +0000 UTC m=+304.870545815"
Jul 07 18:55:56.436083 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:56.436042    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 18:55:56.436217 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:56.436123    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 18:55:56.690514 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:56.690423    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2" event={"ID":"fa566303-f9d4-42d5-8062-57dcb16428c9","Type":"ContainerStarted","Data":"4c95e993779cacb113338233ce9d4f2e3e9891a77cc1593c332d15cd9b3182a9"}
Jul 07 18:55:56.690892 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:56.690509    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:55:56.717814 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:56.717751    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2" podStartSLOduration=0.932123634 podStartE2EDuration="3.717737142s" totalImagesPullingTime="2.785613508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:56.715604895 +0000 UTC m=+305.874944712" watchObservedRunningTime="2026-07-07 18:55:56.717737142 +0000 UTC m=+305.877076967"
Jul 07 18:55:57.697048 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:57.697010    2554 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-kzjg2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 18:55:57.697405 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:57.697065    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2" podUID="fa566303-f9d4-42d5-8062-57dcb16428c9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 18:55:59.420072 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.420036    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gj85x"]
Jul 07 18:55:59.423651 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.423630    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gj85x"
Jul 07 18:55:59.431216 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.431195    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 18:55:59.437030 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.437013    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mrft5\""
Jul 07 18:55:59.454259 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.454240    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gj85x"]
Jul 07 18:55:59.502639 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.502614    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm"]
Jul 07 18:55:59.505138 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.505122    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm"
Jul 07 18:55:59.519962 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.519940    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l57n\" (UniqueName: \"kubernetes.io/projected/113732e4-4b05-4049-b144-2338272e3a23-kube-api-access-4l57n\") pod \"kserve-controller-manager-d6f4b65b8-gj85x\" (UID: \"113732e4-4b05-4049-b144-2338272e3a23\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gj85x"
Jul 07 18:55:59.520043 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.519973    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/113732e4-4b05-4049-b144-2338272e3a23-cert\") pod \"kserve-controller-manager-d6f4b65b8-gj85x\" (UID: \"113732e4-4b05-4049-b144-2338272e3a23\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gj85x"
Jul 07 18:55:59.520984 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.520965    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 18:55:59.521121 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.521107    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8lrpn\""
Jul 07 18:55:59.525712 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.525693    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm"]
Jul 07 18:55:59.620667 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.620641    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fed60534-9655-4759-ab42-f722b1bf1f20-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hf5jm\" (UID: \"fed60534-9655-4759-ab42-f722b1bf1f20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm"
Jul 07 18:55:59.620829 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.620679    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l57n\" (UniqueName: \"kubernetes.io/projected/113732e4-4b05-4049-b144-2338272e3a23-kube-api-access-4l57n\") pod \"kserve-controller-manager-d6f4b65b8-gj85x\" (UID: \"113732e4-4b05-4049-b144-2338272e3a23\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gj85x"
Jul 07 18:55:59.620829 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.620711    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwv2g\" (UniqueName: \"kubernetes.io/projected/fed60534-9655-4759-ab42-f722b1bf1f20-kube-api-access-qwv2g\") pod \"llmisvc-controller-manager-777c6bd7d5-hf5jm\" (UID: \"fed60534-9655-4759-ab42-f722b1bf1f20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm"
Jul 07 18:55:59.620829 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.620734    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/113732e4-4b05-4049-b144-2338272e3a23-cert\") pod \"kserve-controller-manager-d6f4b65b8-gj85x\" (UID: \"113732e4-4b05-4049-b144-2338272e3a23\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gj85x"
Jul 07 18:55:59.623041 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.623022    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/113732e4-4b05-4049-b144-2338272e3a23-cert\") pod \"kserve-controller-manager-d6f4b65b8-gj85x\" (UID: \"113732e4-4b05-4049-b144-2338272e3a23\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gj85x"
Jul 07 18:55:59.640609 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.640583    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l57n\" (UniqueName: \"kubernetes.io/projected/113732e4-4b05-4049-b144-2338272e3a23-kube-api-access-4l57n\") pod \"kserve-controller-manager-d6f4b65b8-gj85x\" (UID: \"113732e4-4b05-4049-b144-2338272e3a23\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-gj85x"
Jul 07 18:55:59.722050 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.721963    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fed60534-9655-4759-ab42-f722b1bf1f20-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hf5jm\" (UID: \"fed60534-9655-4759-ab42-f722b1bf1f20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm"
Jul 07 18:55:59.722050 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.722018    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwv2g\" (UniqueName: \"kubernetes.io/projected/fed60534-9655-4759-ab42-f722b1bf1f20-kube-api-access-qwv2g\") pod \"llmisvc-controller-manager-777c6bd7d5-hf5jm\" (UID: \"fed60534-9655-4759-ab42-f722b1bf1f20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm"
Jul 07 18:55:59.724224 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.724204    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fed60534-9655-4759-ab42-f722b1bf1f20-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hf5jm\" (UID: \"fed60534-9655-4759-ab42-f722b1bf1f20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm"
Jul 07 18:55:59.733088 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.733069    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gj85x"
Jul 07 18:55:59.739763 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.739742    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwv2g\" (UniqueName: \"kubernetes.io/projected/fed60534-9655-4759-ab42-f722b1bf1f20-kube-api-access-qwv2g\") pod \"llmisvc-controller-manager-777c6bd7d5-hf5jm\" (UID: \"fed60534-9655-4759-ab42-f722b1bf1f20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm"
Jul 07 18:55:59.814133 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.814093    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm"
Jul 07 18:55:59.908354 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.902652    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-gj85x"]
Jul 07 18:55:59.910025 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:55:59.909998    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113732e4_4b05_4049_b144_2338272e3a23.slice/crio-a691e8f63ad806615c3719905aa5c8ea442e293000908227988d4a5bc6b08c21 WatchSource:0}: Error finding container a691e8f63ad806615c3719905aa5c8ea442e293000908227988d4a5bc6b08c21: Status 404 returned error can't find the container with id a691e8f63ad806615c3719905aa5c8ea442e293000908227988d4a5bc6b08c21
Jul 07 18:55:59.974605 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:55:59.974530    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm"]
Jul 07 18:55:59.977558 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:55:59.977529    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfed60534_9655_4759_ab42_f722b1bf1f20.slice/crio-f19df62f0bedba748b6c3f3eb4889931b2a90790ba8a807ca1f956df11ee9949 WatchSource:0}: Error finding container f19df62f0bedba748b6c3f3eb4889931b2a90790ba8a807ca1f956df11ee9949: Status 404 returned error can't find the container with id f19df62f0bedba748b6c3f3eb4889931b2a90790ba8a807ca1f956df11ee9949
Jul 07 18:56:00.696814 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.696767    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"]
Jul 07 18:56:00.700387 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.700366    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:56:00.700535 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.700487    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.710054 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.710023    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm" event={"ID":"fed60534-9655-4759-ab42-f722b1bf1f20","Type":"ContainerStarted","Data":"f19df62f0bedba748b6c3f3eb4889931b2a90790ba8a807ca1f956df11ee9949"}
Jul 07 18:56:00.710977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.710953    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hsk45\""
Jul 07 18:56:00.711613 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.711422    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gj85x" event={"ID":"113732e4-4b05-4049-b144-2338272e3a23","Type":"ContainerStarted","Data":"a691e8f63ad806615c3719905aa5c8ea442e293000908227988d4a5bc6b08c21"}
Jul 07 18:56:00.731186 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.731142    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"]
Jul 07 18:56:00.833030 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.832996    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqknn\" (UniqueName: \"kubernetes.io/projected/d5f842c3-1411-4252-bccd-2cb4fd9b0296-kube-api-access-kqknn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.833209 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.833050    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.833209 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.833080    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.833209 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.833177    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.833209 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.833200    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.833425 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.833231    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.833425 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.833331    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.833761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.833541    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.833761 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.833632    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.934923 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.934429    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqknn\" (UniqueName: \"kubernetes.io/projected/d5f842c3-1411-4252-bccd-2cb4fd9b0296-kube-api-access-kqknn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.934923 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.934481    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.934923 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.934509    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.934923 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.934554    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.934923 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.934578    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.934923 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.934609    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.934923 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.934662    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.934923 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.934700    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.934923 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.934735    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.935525 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.935184    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.935525 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.935465    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.935525 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.935512    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.935696 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.935651    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.935809 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.935771    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.937925 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.937882    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.939790 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.939602    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.951558 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.951466    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5f842c3-1411-4252-bccd-2cb4fd9b0296-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:00.960551 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:00.960516    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqknn\" (UniqueName: \"kubernetes.io/projected/d5f842c3-1411-4252-bccd-2cb4fd9b0296-kube-api-access-kqknn\") pod \"data-science-gateway-data-science-gateway-class-6576859cf458g9b\" (UID: \"d5f842c3-1411-4252-bccd-2cb4fd9b0296\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:01.014286 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:01.014249    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:01.332547 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:01.332507    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"]
Jul 07 18:56:01.337474 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:56:01.337426    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f842c3_1411_4252_bccd_2cb4fd9b0296.slice/crio-93857622d20618a88acd89a26c2fcd8bb1fbd4f00f888bcef1aa561893a79b5b WatchSource:0}: Error finding container 93857622d20618a88acd89a26c2fcd8bb1fbd4f00f888bcef1aa561893a79b5b: Status 404 returned error can't find the container with id 93857622d20618a88acd89a26c2fcd8bb1fbd4f00f888bcef1aa561893a79b5b
Jul 07 18:56:01.717904 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:01.717868    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b" event={"ID":"d5f842c3-1411-4252-bccd-2cb4fd9b0296","Type":"ContainerStarted","Data":"93857622d20618a88acd89a26c2fcd8bb1fbd4f00f888bcef1aa561893a79b5b"}
Jul 07 18:56:02.403466 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:02.403428    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"]
Jul 07 18:56:02.403669 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:02.403646    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2" podUID="fa566303-f9d4-42d5-8062-57dcb16428c9" containerName="discovery" containerID="cri-o://4c95e993779cacb113338233ce9d4f2e3e9891a77cc1593c332d15cd9b3182a9" gracePeriod=30
Jul 07 18:56:03.100081 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.100056    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:56:03.256502 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.256469    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-kubeconfig\") pod \"fa566303-f9d4-42d5-8062-57dcb16428c9\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") "
Jul 07 18:56:03.256672 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.256524    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-csr-ca-configmap\") pod \"fa566303-f9d4-42d5-8062-57dcb16428c9\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") "
Jul 07 18:56:03.256739 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.256686    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-cacerts\") pod \"fa566303-f9d4-42d5-8062-57dcb16428c9\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") "
Jul 07 18:56:03.256739 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.256729    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66x4k\" (UniqueName: \"kubernetes.io/projected/fa566303-f9d4-42d5-8062-57dcb16428c9-kube-api-access-66x4k\") pod \"fa566303-f9d4-42d5-8062-57dcb16428c9\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") "
Jul 07 18:56:03.256857 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.256812    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-token\") pod \"fa566303-f9d4-42d5-8062-57dcb16428c9\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") "
Jul 07 18:56:03.256857 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.256838    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-csr-dns-cert\") pod \"fa566303-f9d4-42d5-8062-57dcb16428c9\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") "
Jul 07 18:56:03.256963 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.256889    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa566303-f9d4-42d5-8062-57dcb16428c9-local-certs\") pod \"fa566303-f9d4-42d5-8062-57dcb16428c9\" (UID: \"fa566303-f9d4-42d5-8062-57dcb16428c9\") "
Jul 07 18:56:03.256963 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.256904    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "fa566303-f9d4-42d5-8062-57dcb16428c9" (UID: "fa566303-f9d4-42d5-8062-57dcb16428c9"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:56:03.257997 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.257966    2554 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-csr-ca-configmap\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:56:03.266717 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.266680    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-cacerts" (OuterVolumeSpecName: "cacerts") pod "fa566303-f9d4-42d5-8062-57dcb16428c9" (UID: "fa566303-f9d4-42d5-8062-57dcb16428c9"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:56:03.269843 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.266696    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-token" (OuterVolumeSpecName: "istio-token") pod "fa566303-f9d4-42d5-8062-57dcb16428c9" (UID: "fa566303-f9d4-42d5-8062-57dcb16428c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:56:03.269843 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.267792    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "fa566303-f9d4-42d5-8062-57dcb16428c9" (UID: "fa566303-f9d4-42d5-8062-57dcb16428c9"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:56:03.269843 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.267856    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa566303-f9d4-42d5-8062-57dcb16428c9-local-certs" (OuterVolumeSpecName: "local-certs") pod "fa566303-f9d4-42d5-8062-57dcb16428c9" (UID: "fa566303-f9d4-42d5-8062-57dcb16428c9"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:56:03.269843 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.268550    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa566303-f9d4-42d5-8062-57dcb16428c9-kube-api-access-66x4k" (OuterVolumeSpecName: "kube-api-access-66x4k") pod "fa566303-f9d4-42d5-8062-57dcb16428c9" (UID: "fa566303-f9d4-42d5-8062-57dcb16428c9"). InnerVolumeSpecName "kube-api-access-66x4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:56:03.269843 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.269528    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "fa566303-f9d4-42d5-8062-57dcb16428c9" (UID: "fa566303-f9d4-42d5-8062-57dcb16428c9"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:56:03.359355 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.359310    2554 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-kubeconfig\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:56:03.359355 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.359342    2554 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-cacerts\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:56:03.359355 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.359359    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66x4k\" (UniqueName: \"kubernetes.io/projected/fa566303-f9d4-42d5-8062-57dcb16428c9-kube-api-access-66x4k\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:56:03.359643 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.359375    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:56:03.359643 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.359389    2554 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fa566303-f9d4-42d5-8062-57dcb16428c9-istio-csr-dns-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:56:03.359643 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.359403    2554 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa566303-f9d4-42d5-8062-57dcb16428c9-local-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:56:03.728805 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.728770    2554 generic.go:356] "Generic (PLEG): container finished" podID="fa566303-f9d4-42d5-8062-57dcb16428c9" containerID="4c95e993779cacb113338233ce9d4f2e3e9891a77cc1593c332d15cd9b3182a9" exitCode=0
Jul 07 18:56:03.728997 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.728849    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"
Jul 07 18:56:03.728997 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.728860    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2" event={"ID":"fa566303-f9d4-42d5-8062-57dcb16428c9","Type":"ContainerDied","Data":"4c95e993779cacb113338233ce9d4f2e3e9891a77cc1593c332d15cd9b3182a9"}
Jul 07 18:56:03.728997 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.728920    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2" event={"ID":"fa566303-f9d4-42d5-8062-57dcb16428c9","Type":"ContainerDied","Data":"82b0956a8727bfd6099edbb9eeed22ce69afd2399f822cd243d398c620b4d0ba"}
Jul 07 18:56:03.728997 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.728946    2554 scope.go:117] "RemoveContainer" containerID="4c95e993779cacb113338233ce9d4f2e3e9891a77cc1593c332d15cd9b3182a9"
Jul 07 18:56:03.731051 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.731025    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm" event={"ID":"fed60534-9655-4759-ab42-f722b1bf1f20","Type":"ContainerStarted","Data":"979e97ea0f11fb9df8be59f298c634a23b03379e3111ffa6fb8c7fe15513b450"}
Jul 07 18:56:03.731253 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.731219    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm"
Jul 07 18:56:03.733094 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.733036    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gj85x" event={"ID":"113732e4-4b05-4049-b144-2338272e3a23","Type":"ContainerStarted","Data":"016eaa0ea996385cd024e452a6edfb0e94044a4ccb4e3963d786063fecf8fe13"}
Jul 07 18:56:03.733210 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.733176    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gj85x"
Jul 07 18:56:03.738643 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.738617    2554 scope.go:117] "RemoveContainer" containerID="4c95e993779cacb113338233ce9d4f2e3e9891a77cc1593c332d15cd9b3182a9"
Jul 07 18:56:03.738938 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:56:03.738916    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c95e993779cacb113338233ce9d4f2e3e9891a77cc1593c332d15cd9b3182a9\": container with ID starting with 4c95e993779cacb113338233ce9d4f2e3e9891a77cc1593c332d15cd9b3182a9 not found: ID does not exist" containerID="4c95e993779cacb113338233ce9d4f2e3e9891a77cc1593c332d15cd9b3182a9"
Jul 07 18:56:03.739006 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.738945    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c95e993779cacb113338233ce9d4f2e3e9891a77cc1593c332d15cd9b3182a9"} err="failed to get container status \"4c95e993779cacb113338233ce9d4f2e3e9891a77cc1593c332d15cd9b3182a9\": rpc error: code = NotFound desc = could not find container \"4c95e993779cacb113338233ce9d4f2e3e9891a77cc1593c332d15cd9b3182a9\": container with ID starting with 4c95e993779cacb113338233ce9d4f2e3e9891a77cc1593c332d15cd9b3182a9 not found: ID does not exist"
Jul 07 18:56:03.767373 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.767324    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gj85x" podStartSLOduration=1.725741908 podStartE2EDuration="4.767307926s" totalImagesPullingTime="3.041566018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:56:03.76614567 +0000 UTC m=+312.925485495" watchObservedRunningTime="2026-07-07 18:56:03.767307926 +0000 UTC m=+312.926647753"
Jul 07 18:56:03.800694 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.800647    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm" podStartSLOduration=1.824774277 podStartE2EDuration="4.800634024s" totalImagesPullingTime="2.975859747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:56:03.799340809 +0000 UTC m=+312.958680636" watchObservedRunningTime="2026-07-07 18:56:03.800634024 +0000 UTC m=+312.959973850"
Jul 07 18:56:03.823777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.823751    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"]
Jul 07 18:56:03.836292 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:03.836269    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-kzjg2"]
Jul 07 18:56:04.895379 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:04.895350    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 18:56:04.895649 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:04.895416    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 18:56:04.895649 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:04.895444    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 18:56:05.473405 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:05.473368    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa566303-f9d4-42d5-8062-57dcb16428c9" path="/var/lib/kubelet/pods/fa566303-f9d4-42d5-8062-57dcb16428c9/volumes"
Jul 07 18:56:05.744221 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:05.744183    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b" event={"ID":"d5f842c3-1411-4252-bccd-2cb4fd9b0296","Type":"ContainerStarted","Data":"a198ff1923b2553dde2bf8241a9028a31be4b613a7201c6c77352bef56010ecf"}
Jul 07 18:56:05.779341 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:05.779291    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b" podStartSLOduration=2.224595197 podStartE2EDuration="5.779277598s" totalImagesPullingTime="3.554682401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:56:05.778833729 +0000 UTC m=+314.938173584" watchObservedRunningTime="2026-07-07 18:56:05.779277598 +0000 UTC m=+314.938617424"
Jul 07 18:56:06.015221 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:06.015144    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:06.019254 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:06.019233    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:06.748693 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:06.748667    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:06.749506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:06.749488    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf458g9b"
Jul 07 18:56:34.741781 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:34.741750    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hf5jm"
Jul 07 18:56:34.744841 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:34.744792    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-gj85x"
Jul 07 18:56:46.334907 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.334826    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vjg74"]
Jul 07 18:56:46.335424 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.335299    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa566303-f9d4-42d5-8062-57dcb16428c9" containerName="discovery"
Jul 07 18:56:46.335424 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.335319    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa566303-f9d4-42d5-8062-57dcb16428c9" containerName="discovery"
Jul 07 18:56:46.335424 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.335406    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa566303-f9d4-42d5-8062-57dcb16428c9" containerName="discovery"
Jul 07 18:56:46.337569 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.337547    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vjg74"
Jul 07 18:56:46.340688 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.340672    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 18:56:46.341184 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.341160    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 18:56:46.348912 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.348894    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-q8xs2\""
Jul 07 18:56:46.359202 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.359182    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vjg74"]
Jul 07 18:56:46.375763 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.375739    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7jq7\" (UniqueName: \"kubernetes.io/projected/5b01b275-521d-4642-ba10-bdfe1d0260e2-kube-api-access-z7jq7\") pod \"kuadrant-operator-catalog-vjg74\" (UID: \"5b01b275-521d-4642-ba10-bdfe1d0260e2\") " pod="kuadrant-system/kuadrant-operator-catalog-vjg74"
Jul 07 18:56:46.476255 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.476215    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7jq7\" (UniqueName: \"kubernetes.io/projected/5b01b275-521d-4642-ba10-bdfe1d0260e2-kube-api-access-z7jq7\") pod \"kuadrant-operator-catalog-vjg74\" (UID: \"5b01b275-521d-4642-ba10-bdfe1d0260e2\") " pod="kuadrant-system/kuadrant-operator-catalog-vjg74"
Jul 07 18:56:46.493690 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.488839    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7jq7\" (UniqueName: \"kubernetes.io/projected/5b01b275-521d-4642-ba10-bdfe1d0260e2-kube-api-access-z7jq7\") pod \"kuadrant-operator-catalog-vjg74\" (UID: \"5b01b275-521d-4642-ba10-bdfe1d0260e2\") " pod="kuadrant-system/kuadrant-operator-catalog-vjg74"
Jul 07 18:56:46.646687 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.646598    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vjg74"
Jul 07 18:56:46.667679 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.667649    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vjg74"]
Jul 07 18:56:46.775907 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.775876    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vjg74"]
Jul 07 18:56:46.778773 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:56:46.778747    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b01b275_521d_4642_ba10_bdfe1d0260e2.slice/crio-5932dd3ded591ce1e164a7cfe52b8f4afb8541f2d288c2f566101b86806b42b8 WatchSource:0}: Error finding container 5932dd3ded591ce1e164a7cfe52b8f4afb8541f2d288c2f566101b86806b42b8: Status 404 returned error can't find the container with id 5932dd3ded591ce1e164a7cfe52b8f4afb8541f2d288c2f566101b86806b42b8
Jul 07 18:56:46.883204 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.883176    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7kgr"]
Jul 07 18:56:46.886278 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.886259    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c7kgr"
Jul 07 18:56:46.905277 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.905221    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7kgr"]
Jul 07 18:56:46.915459 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.915431    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vjg74" event={"ID":"5b01b275-521d-4642-ba10-bdfe1d0260e2","Type":"ContainerStarted","Data":"5932dd3ded591ce1e164a7cfe52b8f4afb8541f2d288c2f566101b86806b42b8"}
Jul 07 18:56:46.979191 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:46.979164    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-422lg\" (UniqueName: \"kubernetes.io/projected/57d65a96-222f-4361-874d-8d4a2673fdff-kube-api-access-422lg\") pod \"kuadrant-operator-catalog-c7kgr\" (UID: \"57d65a96-222f-4361-874d-8d4a2673fdff\") " pod="kuadrant-system/kuadrant-operator-catalog-c7kgr"
Jul 07 18:56:47.080454 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:47.080423    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-422lg\" (UniqueName: \"kubernetes.io/projected/57d65a96-222f-4361-874d-8d4a2673fdff-kube-api-access-422lg\") pod \"kuadrant-operator-catalog-c7kgr\" (UID: \"57d65a96-222f-4361-874d-8d4a2673fdff\") " pod="kuadrant-system/kuadrant-operator-catalog-c7kgr"
Jul 07 18:56:47.090267 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:47.090239    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-422lg\" (UniqueName: \"kubernetes.io/projected/57d65a96-222f-4361-874d-8d4a2673fdff-kube-api-access-422lg\") pod \"kuadrant-operator-catalog-c7kgr\" (UID: \"57d65a96-222f-4361-874d-8d4a2673fdff\") " pod="kuadrant-system/kuadrant-operator-catalog-c7kgr"
Jul 07 18:56:47.194564 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:47.194498    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c7kgr"
Jul 07 18:56:47.342275 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:47.342248    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c7kgr"]
Jul 07 18:56:47.380740 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:56:47.380710    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d65a96_222f_4361_874d_8d4a2673fdff.slice/crio-fe328424e16f09b2bad8602cf8ce2292eaf413df7a1136c4577a8bf36bd5f409 WatchSource:0}: Error finding container fe328424e16f09b2bad8602cf8ce2292eaf413df7a1136c4577a8bf36bd5f409: Status 404 returned error can't find the container with id fe328424e16f09b2bad8602cf8ce2292eaf413df7a1136c4577a8bf36bd5f409
Jul 07 18:56:47.923084 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:47.923042    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c7kgr" event={"ID":"57d65a96-222f-4361-874d-8d4a2673fdff","Type":"ContainerStarted","Data":"fe328424e16f09b2bad8602cf8ce2292eaf413df7a1136c4577a8bf36bd5f409"}
Jul 07 18:56:48.928490 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:48.928397    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vjg74" event={"ID":"5b01b275-521d-4642-ba10-bdfe1d0260e2","Type":"ContainerStarted","Data":"3a65197f31363e391949e1eaa94050e3f60ee38940fd0189b6bf928154579939"}
Jul 07 18:56:48.928490 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:48.928444    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-vjg74" podUID="5b01b275-521d-4642-ba10-bdfe1d0260e2" containerName="registry-server" containerID="cri-o://3a65197f31363e391949e1eaa94050e3f60ee38940fd0189b6bf928154579939" gracePeriod=2
Jul 07 18:56:48.930087 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:48.930058    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c7kgr" event={"ID":"57d65a96-222f-4361-874d-8d4a2673fdff","Type":"ContainerStarted","Data":"29f9630172bbbe7e50f45f7df39297490e51a54ca756be7eaa1e273c1ee5f4d3"}
Jul 07 18:56:48.949621 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:48.949579    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vjg74" podStartSLOduration=1.130767268 podStartE2EDuration="2.949565044s" totalImagesPullingTime="1.818797776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:56:48.948392253 +0000 UTC m=+358.107732079" watchObservedRunningTime="2026-07-07 18:56:48.949565044 +0000 UTC m=+358.108904870"
Jul 07 18:56:48.964041 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:48.964000    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-c7kgr" podStartSLOduration=1.746082803 podStartE2EDuration="2.963985561s" totalImagesPullingTime="1.217902758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:56:48.963074002 +0000 UTC m=+358.122413841" watchObservedRunningTime="2026-07-07 18:56:48.963985561 +0000 UTC m=+358.123325405"
Jul 07 18:56:49.166868 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:49.166843    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vjg74"
Jul 07 18:56:49.198657 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:49.198594    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7jq7\" (UniqueName: \"kubernetes.io/projected/5b01b275-521d-4642-ba10-bdfe1d0260e2-kube-api-access-z7jq7\") pod \"5b01b275-521d-4642-ba10-bdfe1d0260e2\" (UID: \"5b01b275-521d-4642-ba10-bdfe1d0260e2\") "
Jul 07 18:56:49.200615 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:49.200588    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b01b275-521d-4642-ba10-bdfe1d0260e2-kube-api-access-z7jq7" (OuterVolumeSpecName: "kube-api-access-z7jq7") pod "5b01b275-521d-4642-ba10-bdfe1d0260e2" (UID: "5b01b275-521d-4642-ba10-bdfe1d0260e2"). InnerVolumeSpecName "kube-api-access-z7jq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:56:49.299129 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:49.299099    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7jq7\" (UniqueName: \"kubernetes.io/projected/5b01b275-521d-4642-ba10-bdfe1d0260e2-kube-api-access-z7jq7\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:56:49.935338 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:49.935249    2554 generic.go:356] "Generic (PLEG): container finished" podID="5b01b275-521d-4642-ba10-bdfe1d0260e2" containerID="3a65197f31363e391949e1eaa94050e3f60ee38940fd0189b6bf928154579939" exitCode=0
Jul 07 18:56:49.935338 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:49.935310    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vjg74"
Jul 07 18:56:49.935338 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:49.935328    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vjg74" event={"ID":"5b01b275-521d-4642-ba10-bdfe1d0260e2","Type":"ContainerDied","Data":"3a65197f31363e391949e1eaa94050e3f60ee38940fd0189b6bf928154579939"}
Jul 07 18:56:49.935855 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:49.935395    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vjg74" event={"ID":"5b01b275-521d-4642-ba10-bdfe1d0260e2","Type":"ContainerDied","Data":"5932dd3ded591ce1e164a7cfe52b8f4afb8541f2d288c2f566101b86806b42b8"}
Jul 07 18:56:49.935855 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:49.935415    2554 scope.go:117] "RemoveContainer" containerID="3a65197f31363e391949e1eaa94050e3f60ee38940fd0189b6bf928154579939"
Jul 07 18:56:49.944032 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:49.944017    2554 scope.go:117] "RemoveContainer" containerID="3a65197f31363e391949e1eaa94050e3f60ee38940fd0189b6bf928154579939"
Jul 07 18:56:49.944277 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:56:49.944258    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a65197f31363e391949e1eaa94050e3f60ee38940fd0189b6bf928154579939\": container with ID starting with 3a65197f31363e391949e1eaa94050e3f60ee38940fd0189b6bf928154579939 not found: ID does not exist" containerID="3a65197f31363e391949e1eaa94050e3f60ee38940fd0189b6bf928154579939"
Jul 07 18:56:49.944343 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:49.944288    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a65197f31363e391949e1eaa94050e3f60ee38940fd0189b6bf928154579939"} err="failed to get container status \"3a65197f31363e391949e1eaa94050e3f60ee38940fd0189b6bf928154579939\": rpc error: code = NotFound desc = could not find container \"3a65197f31363e391949e1eaa94050e3f60ee38940fd0189b6bf928154579939\": container with ID starting with 3a65197f31363e391949e1eaa94050e3f60ee38940fd0189b6bf928154579939 not found: ID does not exist"
Jul 07 18:56:49.952410 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:49.952389    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vjg74"]
Jul 07 18:56:49.958403 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:49.958384    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vjg74"]
Jul 07 18:56:51.473670 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:51.473626    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b01b275-521d-4642-ba10-bdfe1d0260e2" path="/var/lib/kubelet/pods/5b01b275-521d-4642-ba10-bdfe1d0260e2/volumes"
Jul 07 18:56:57.194608 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:57.194575    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-c7kgr"
Jul 07 18:56:57.195081 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:57.194650    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-c7kgr"
Jul 07 18:56:57.217045 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:57.217015    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-c7kgr"
Jul 07 18:56:57.991300 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:56:57.991277    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-c7kgr"
Jul 07 18:57:18.119464 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:18.119428    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgnl5"]
Jul 07 18:57:18.119877 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:18.119726    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b01b275-521d-4642-ba10-bdfe1d0260e2" containerName="registry-server"
Jul 07 18:57:18.119877 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:18.119738    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b01b275-521d-4642-ba10-bdfe1d0260e2" containerName="registry-server"
Jul 07 18:57:18.119877 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:18.119819    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b01b275-521d-4642-ba10-bdfe1d0260e2" containerName="registry-server"
Jul 07 18:57:18.121744 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:18.121729    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgnl5"
Jul 07 18:57:18.126303 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:18.126283    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 18:57:18.126830 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:18.126813    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-jl6ts\""
Jul 07 18:57:18.134524 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:18.134504    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgnl5"]
Jul 07 18:57:18.235046 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:18.235019    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dj59\" (UniqueName: \"kubernetes.io/projected/60978477-8e49-453a-ba82-f5e479edd8ea-kube-api-access-2dj59\") pod \"dns-operator-controller-manager-864dd78c4c-cgnl5\" (UID: \"60978477-8e49-453a-ba82-f5e479edd8ea\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgnl5"
Jul 07 18:57:18.335481 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:18.335453    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dj59\" (UniqueName: \"kubernetes.io/projected/60978477-8e49-453a-ba82-f5e479edd8ea-kube-api-access-2dj59\") pod \"dns-operator-controller-manager-864dd78c4c-cgnl5\" (UID: \"60978477-8e49-453a-ba82-f5e479edd8ea\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgnl5"
Jul 07 18:57:18.350867 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:18.350838    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dj59\" (UniqueName: \"kubernetes.io/projected/60978477-8e49-453a-ba82-f5e479edd8ea-kube-api-access-2dj59\") pod \"dns-operator-controller-manager-864dd78c4c-cgnl5\" (UID: \"60978477-8e49-453a-ba82-f5e479edd8ea\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgnl5"
Jul 07 18:57:18.431383 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:18.431319    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgnl5"
Jul 07 18:57:18.569599 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:18.569566    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgnl5"]
Jul 07 18:57:18.572555 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:57:18.572524    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60978477_8e49_453a_ba82_f5e479edd8ea.slice/crio-9f3d7f27c831e3bb3e4a3f1271b5b951fcb4ec4f8c3a264f88523090c32c2b00 WatchSource:0}: Error finding container 9f3d7f27c831e3bb3e4a3f1271b5b951fcb4ec4f8c3a264f88523090c32c2b00: Status 404 returned error can't find the container with id 9f3d7f27c831e3bb3e4a3f1271b5b951fcb4ec4f8c3a264f88523090c32c2b00
Jul 07 18:57:19.056328 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:19.056296    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgnl5" event={"ID":"60978477-8e49-453a-ba82-f5e479edd8ea","Type":"ContainerStarted","Data":"9f3d7f27c831e3bb3e4a3f1271b5b951fcb4ec4f8c3a264f88523090c32c2b00"}
Jul 07 18:57:21.067102 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:21.067066    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgnl5" event={"ID":"60978477-8e49-453a-ba82-f5e479edd8ea","Type":"ContainerStarted","Data":"6cf630a691bf99ee85e44d1cea1d1943687be1d0467077f51e380836ef236987"}
Jul 07 18:57:21.067506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:21.067140    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgnl5"
Jul 07 18:57:21.085297 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:21.085244    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgnl5" podStartSLOduration=1.454437199 podStartE2EDuration="3.085229906s" totalImagesPullingTime="1.630792707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:57:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:21.083445661 +0000 UTC m=+390.242785486" watchObservedRunningTime="2026-07-07 18:57:21.085229906 +0000 UTC m=+390.244569732"
Jul 07 18:57:23.708534 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:23.708496    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"]
Jul 07 18:57:23.716432 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:23.716409    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:23.719035 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:23.719017    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9vzp5\""
Jul 07 18:57:23.727465 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:23.727444    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"]
Jul 07 18:57:23.882765 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:23.882736    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6275cc5a-747f-4413-9a35-e715b63a0b21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7kwhw\" (UID: \"6275cc5a-747f-4413-9a35-e715b63a0b21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:23.882765 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:23.882769    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rr5z\" (UniqueName: \"kubernetes.io/projected/6275cc5a-747f-4413-9a35-e715b63a0b21-kube-api-access-8rr5z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7kwhw\" (UID: \"6275cc5a-747f-4413-9a35-e715b63a0b21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:23.983505 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:23.983479    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6275cc5a-747f-4413-9a35-e715b63a0b21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7kwhw\" (UID: \"6275cc5a-747f-4413-9a35-e715b63a0b21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:23.983651 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:23.983512    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rr5z\" (UniqueName: \"kubernetes.io/projected/6275cc5a-747f-4413-9a35-e715b63a0b21-kube-api-access-8rr5z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7kwhw\" (UID: \"6275cc5a-747f-4413-9a35-e715b63a0b21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:23.983879 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:23.983861    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6275cc5a-747f-4413-9a35-e715b63a0b21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7kwhw\" (UID: \"6275cc5a-747f-4413-9a35-e715b63a0b21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:23.997105 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:23.997082    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rr5z\" (UniqueName: \"kubernetes.io/projected/6275cc5a-747f-4413-9a35-e715b63a0b21-kube-api-access-8rr5z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7kwhw\" (UID: \"6275cc5a-747f-4413-9a35-e715b63a0b21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:24.027137 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:24.027111    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:24.185758 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:24.185727    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"]
Jul 07 18:57:24.186843 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:57:24.186817    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6275cc5a_747f_4413_9a35_e715b63a0b21.slice/crio-f6b9d4caf864262a767a16295e1b1a324bef71db7d681822bf9d1a580681be39 WatchSource:0}: Error finding container f6b9d4caf864262a767a16295e1b1a324bef71db7d681822bf9d1a580681be39: Status 404 returned error can't find the container with id f6b9d4caf864262a767a16295e1b1a324bef71db7d681822bf9d1a580681be39
Jul 07 18:57:25.088917 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:25.088878    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw" event={"ID":"6275cc5a-747f-4413-9a35-e715b63a0b21","Type":"ContainerStarted","Data":"f6b9d4caf864262a767a16295e1b1a324bef71db7d681822bf9d1a580681be39"}
Jul 07 18:57:27.179685 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:27.179648    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qzg7p"]
Jul 07 18:57:27.183295 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:27.183276    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qzg7p"
Jul 07 18:57:27.190254 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:27.190228    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dgn84\""
Jul 07 18:57:27.207097 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:27.207070    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qzg7p"]
Jul 07 18:57:27.313031 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:27.312995    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvjcm\" (UniqueName: \"kubernetes.io/projected/bad913ef-2d27-4444-bb1b-8f6f8b466b86-kube-api-access-zvjcm\") pod \"authorino-operator-75cc8d5cb7-qzg7p\" (UID: \"bad913ef-2d27-4444-bb1b-8f6f8b466b86\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qzg7p"
Jul 07 18:57:27.414011 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:27.413970    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvjcm\" (UniqueName: \"kubernetes.io/projected/bad913ef-2d27-4444-bb1b-8f6f8b466b86-kube-api-access-zvjcm\") pod \"authorino-operator-75cc8d5cb7-qzg7p\" (UID: \"bad913ef-2d27-4444-bb1b-8f6f8b466b86\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qzg7p"
Jul 07 18:57:27.425360 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:27.425331    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvjcm\" (UniqueName: \"kubernetes.io/projected/bad913ef-2d27-4444-bb1b-8f6f8b466b86-kube-api-access-zvjcm\") pod \"authorino-operator-75cc8d5cb7-qzg7p\" (UID: \"bad913ef-2d27-4444-bb1b-8f6f8b466b86\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qzg7p"
Jul 07 18:57:27.495015 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:27.494987    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qzg7p"
Jul 07 18:57:27.650398 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:27.650374    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qzg7p"]
Jul 07 18:57:27.652858 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:57:27.652832    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad913ef_2d27_4444_bb1b_8f6f8b466b86.slice/crio-a12fe0d8201c48b349fe2952f9104e73701aa77ad7ff2795249157aa06557ede WatchSource:0}: Error finding container a12fe0d8201c48b349fe2952f9104e73701aa77ad7ff2795249157aa06557ede: Status 404 returned error can't find the container with id a12fe0d8201c48b349fe2952f9104e73701aa77ad7ff2795249157aa06557ede
Jul 07 18:57:28.104693 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:28.104652    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qzg7p" event={"ID":"bad913ef-2d27-4444-bb1b-8f6f8b466b86","Type":"ContainerStarted","Data":"a12fe0d8201c48b349fe2952f9104e73701aa77ad7ff2795249157aa06557ede"}
Jul 07 18:57:29.677470 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:29.677436    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"]
Jul 07 18:57:29.681069 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:29.681044    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:29.685859 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:29.685835    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-h6x5l\""
Jul 07 18:57:29.702678 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:29.702656    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"]
Jul 07 18:57:29.734632 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:29.734598    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg4x2\" (UniqueName: \"kubernetes.io/projected/d2cc174d-e609-4b67-be2a-a73108f0f1a3-kube-api-access-tg4x2\") pod \"limitador-operator-controller-manager-859d7b78bd-9cwlz\" (UID: \"d2cc174d-e609-4b67-be2a-a73108f0f1a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:29.835878 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:29.835731    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg4x2\" (UniqueName: \"kubernetes.io/projected/d2cc174d-e609-4b67-be2a-a73108f0f1a3-kube-api-access-tg4x2\") pod \"limitador-operator-controller-manager-859d7b78bd-9cwlz\" (UID: \"d2cc174d-e609-4b67-be2a-a73108f0f1a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:29.846901 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:29.846872    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg4x2\" (UniqueName: \"kubernetes.io/projected/d2cc174d-e609-4b67-be2a-a73108f0f1a3-kube-api-access-tg4x2\") pod \"limitador-operator-controller-manager-859d7b78bd-9cwlz\" (UID: \"d2cc174d-e609-4b67-be2a-a73108f0f1a3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:29.993101 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:29.993065    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:30.116816 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:30.116749    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw" event={"ID":"6275cc5a-747f-4413-9a35-e715b63a0b21","Type":"ContainerStarted","Data":"09214397efced6d19c0780acc69d3be077aa3f23240478d968693cb5828e05ba"}
Jul 07 18:57:30.117013 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:30.116982    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:30.138674 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:30.138575    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw" podStartSLOduration=2.206649371 podStartE2EDuration="7.138554662s" totalImagesPullingTime="4.931905291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:30.136538113 +0000 UTC m=+399.295877966" watchObservedRunningTime="2026-07-07 18:57:30.138554662 +0000 UTC m=+399.297894490"
Jul 07 18:57:30.970317 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:30.970291    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"]
Jul 07 18:57:30.973024 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:57:30.972998    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2cc174d_e609_4b67_be2a_a73108f0f1a3.slice/crio-b3bbb0aea74dc8c04c91ceffd86a91b94b1edd3bb8d7a433bcef852ce56c6b70 WatchSource:0}: Error finding container b3bbb0aea74dc8c04c91ceffd86a91b94b1edd3bb8d7a433bcef852ce56c6b70: Status 404 returned error can't find the container with id b3bbb0aea74dc8c04c91ceffd86a91b94b1edd3bb8d7a433bcef852ce56c6b70
Jul 07 18:57:31.122605 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:31.122518    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz" event={"ID":"d2cc174d-e609-4b67-be2a-a73108f0f1a3","Type":"ContainerStarted","Data":"b3bbb0aea74dc8c04c91ceffd86a91b94b1edd3bb8d7a433bcef852ce56c6b70"}
Jul 07 18:57:31.123941 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:31.123914    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qzg7p" event={"ID":"bad913ef-2d27-4444-bb1b-8f6f8b466b86","Type":"ContainerStarted","Data":"f02a2d91bd04ad7fd033fd7a84069f480819592ba5151f1908f23ecc42d66249"}
Jul 07 18:57:31.149380 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:31.149275    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qzg7p" podStartSLOduration=0.912108724 podStartE2EDuration="4.149254836s" totalImagesPullingTime="3.237146112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:31.147674746 +0000 UTC m=+400.307014595" watchObservedRunningTime="2026-07-07 18:57:31.149254836 +0000 UTC m=+400.308594663"
Jul 07 18:57:32.073913 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.073880    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cgnl5"
Jul 07 18:57:32.116122 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.116083    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f"]
Jul 07 18:57:32.119508 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.119486    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f"
Jul 07 18:57:32.122272 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.122249    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 07 18:57:32.122394 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.122258    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 07 18:57:32.122394 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.122358    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j6cxj\""
Jul 07 18:57:32.129690 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.129663    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qzg7p"
Jul 07 18:57:32.129774 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.129724    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f"]
Jul 07 18:57:32.154697 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.154670    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/17b87a87-3137-49e8-bfc5-3119d5a25974-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6mt8f\" (UID: \"17b87a87-3137-49e8-bfc5-3119d5a25974\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f"
Jul 07 18:57:32.154918 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.154898    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/17b87a87-3137-49e8-bfc5-3119d5a25974-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6mt8f\" (UID: \"17b87a87-3137-49e8-bfc5-3119d5a25974\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f"
Jul 07 18:57:32.155126 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.155098    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qpxr\" (UniqueName: \"kubernetes.io/projected/17b87a87-3137-49e8-bfc5-3119d5a25974-kube-api-access-7qpxr\") pod \"kuadrant-console-plugin-66b5774985-6mt8f\" (UID: \"17b87a87-3137-49e8-bfc5-3119d5a25974\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f"
Jul 07 18:57:32.255749 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.255715    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qpxr\" (UniqueName: \"kubernetes.io/projected/17b87a87-3137-49e8-bfc5-3119d5a25974-kube-api-access-7qpxr\") pod \"kuadrant-console-plugin-66b5774985-6mt8f\" (UID: \"17b87a87-3137-49e8-bfc5-3119d5a25974\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f"
Jul 07 18:57:32.255972 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.255779    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/17b87a87-3137-49e8-bfc5-3119d5a25974-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6mt8f\" (UID: \"17b87a87-3137-49e8-bfc5-3119d5a25974\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f"
Jul 07 18:57:32.255972 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.255901    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/17b87a87-3137-49e8-bfc5-3119d5a25974-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6mt8f\" (UID: \"17b87a87-3137-49e8-bfc5-3119d5a25974\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f"
Jul 07 18:57:32.256588 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.256565    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/17b87a87-3137-49e8-bfc5-3119d5a25974-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6mt8f\" (UID: \"17b87a87-3137-49e8-bfc5-3119d5a25974\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f"
Jul 07 18:57:32.258156 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.258137    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/17b87a87-3137-49e8-bfc5-3119d5a25974-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6mt8f\" (UID: \"17b87a87-3137-49e8-bfc5-3119d5a25974\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f"
Jul 07 18:57:32.266972 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.266934    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qpxr\" (UniqueName: \"kubernetes.io/projected/17b87a87-3137-49e8-bfc5-3119d5a25974-kube-api-access-7qpxr\") pod \"kuadrant-console-plugin-66b5774985-6mt8f\" (UID: \"17b87a87-3137-49e8-bfc5-3119d5a25974\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f"
Jul 07 18:57:32.431598 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.431512    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f"
Jul 07 18:57:32.658135 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:32.658115    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f"]
Jul 07 18:57:32.660162 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:57:32.660136    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17b87a87_3137_49e8_bfc5_3119d5a25974.slice/crio-e51cfbcceee8bfd2fc5d661736196c6e2bf47d1dcb319e815f17a9c21bf236d6 WatchSource:0}: Error finding container e51cfbcceee8bfd2fc5d661736196c6e2bf47d1dcb319e815f17a9c21bf236d6: Status 404 returned error can't find the container with id e51cfbcceee8bfd2fc5d661736196c6e2bf47d1dcb319e815f17a9c21bf236d6
Jul 07 18:57:33.135975 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:33.135939    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz" event={"ID":"d2cc174d-e609-4b67-be2a-a73108f0f1a3","Type":"ContainerStarted","Data":"ca5a31eeb885c8eb19f9e6ff283e1972e61b9f1a5fa4a4af1babad34a4e9a929"}
Jul 07 18:57:33.136449 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:33.136026    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:33.137164 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:33.137142    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f" event={"ID":"17b87a87-3137-49e8-bfc5-3119d5a25974","Type":"ContainerStarted","Data":"e51cfbcceee8bfd2fc5d661736196c6e2bf47d1dcb319e815f17a9c21bf236d6"}
Jul 07 18:57:33.163321 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:33.163281    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz" podStartSLOduration=2.563500855 podStartE2EDuration="4.163269312s" totalImagesPullingTime="1.599768457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:57:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:33.162897246 +0000 UTC m=+402.322237099" watchObservedRunningTime="2026-07-07 18:57:33.163269312 +0000 UTC m=+402.322609137"
Jul 07 18:57:40.878111 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:40.878075    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d6f565794-4h6m4"]
Jul 07 18:57:40.884767 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:40.884744    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:40.914454 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:40.914428    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6f565794-4h6m4"]
Jul 07 18:57:40.939502 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:40.939469    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-console-serving-cert\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:40.939651 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:40.939528    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vm4r\" (UniqueName: \"kubernetes.io/projected/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-kube-api-access-2vm4r\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:40.939716 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:40.939639    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-console-config\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:40.939716 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:40.939707    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-console-oauth-config\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:40.939825 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:40.939739    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-oauth-serving-cert\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:40.939825 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:40.939786    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-trusted-ca-bundle\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:40.939930 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:40.939866    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-service-ca\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.040611 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.040573    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-oauth-serving-cert\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.040823 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.040631    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-trusted-ca-bundle\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.040823 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.040667    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-service-ca\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.040823 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.040701    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-console-serving-cert\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.040823 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.040737    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vm4r\" (UniqueName: \"kubernetes.io/projected/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-kube-api-access-2vm4r\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.040823 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.040778    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-console-config\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.041100 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.040857    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-console-oauth-config\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.041471 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.041405    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-oauth-serving-cert\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.041595 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.041475    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-service-ca\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.041595 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.041573    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-console-config\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.041724 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.041605    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-trusted-ca-bundle\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.043770 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.043746    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-console-oauth-config\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.043963 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.043944    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-console-serving-cert\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.062281 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.062258    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vm4r\" (UniqueName: \"kubernetes.io/projected/9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388-kube-api-access-2vm4r\") pod \"console-d6f565794-4h6m4\" (UID: \"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388\") " pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:41.126819 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.126770    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:41.196285 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:41.196075    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:57:43.064913 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.064862    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"]
Jul 07 18:57:43.065408 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.065130    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw" podUID="6275cc5a-747f-4413-9a35-e715b63a0b21" containerName="manager" containerID="cri-o://09214397efced6d19c0780acc69d3be077aa3f23240478d968693cb5828e05ba" gracePeriod=2
Jul 07 18:57:43.067238 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.067209    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"]
Jul 07 18:57:43.067694 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:43.067656    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7kwhw\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="6275cc5a-747f-4413-9a35-e715b63a0b21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:43.083593 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.083566    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"]
Jul 07 18:57:43.083832 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.083791    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz" podUID="d2cc174d-e609-4b67-be2a-a73108f0f1a3" containerName="manager" containerID="cri-o://ca5a31eeb885c8eb19f9e6ff283e1972e61b9f1a5fa4a4af1babad34a4e9a929" gracePeriod=2
Jul 07 18:57:43.085921 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.085865    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:43.086600 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:43.086389    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7kwhw\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="6275cc5a-747f-4413-9a35-e715b63a0b21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:43.095604 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.095563    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"]
Jul 07 18:57:43.100383 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:43.100317    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7kwhw\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="6275cc5a-747f-4413-9a35-e715b63a0b21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:43.102627 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.102552    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"]
Jul 07 18:57:43.103047 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.103028    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6275cc5a-747f-4413-9a35-e715b63a0b21" containerName="manager"
Jul 07 18:57:43.103142 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.103051    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6275cc5a-747f-4413-9a35-e715b63a0b21" containerName="manager"
Jul 07 18:57:43.103142 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.103074    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2cc174d-e609-4b67-be2a-a73108f0f1a3" containerName="manager"
Jul 07 18:57:43.103142 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.103082    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2cc174d-e609-4b67-be2a-a73108f0f1a3" containerName="manager"
Jul 07 18:57:43.103288 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.103176    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6275cc5a-747f-4413-9a35-e715b63a0b21" containerName="manager"
Jul 07 18:57:43.103288 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.103190    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2cc174d-e609-4b67-be2a-a73108f0f1a3" containerName="manager"
Jul 07 18:57:43.104398 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:43.104362    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9cwlz\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="d2cc174d-e609-4b67-be2a-a73108f0f1a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:43.107921 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.107901    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"
Jul 07 18:57:43.119169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.119130    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qptkl"]
Jul 07 18:57:43.125314 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.125288    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"]
Jul 07 18:57:43.125424 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.125400    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qptkl"
Jul 07 18:57:43.139923 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.139894    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qzg7p"
Jul 07 18:57:43.147028 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.147001    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qptkl"]
Jul 07 18:57:43.160423 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.160000    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb0033c5-f524-4b7a-96d8-bd12f48ad7fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6zswn\" (UID: \"cb0033c5-f524-4b7a-96d8-bd12f48ad7fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"
Jul 07 18:57:43.160423 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.160044    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dtfk\" (UniqueName: \"kubernetes.io/projected/cb0033c5-f524-4b7a-96d8-bd12f48ad7fb-kube-api-access-6dtfk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6zswn\" (UID: \"cb0033c5-f524-4b7a-96d8-bd12f48ad7fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"
Jul 07 18:57:43.164289 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:43.164256    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7kwhw\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="6275cc5a-747f-4413-9a35-e715b63a0b21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:43.167912 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:43.167886    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9cwlz\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="d2cc174d-e609-4b67-be2a-a73108f0f1a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:43.209720 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:43.209677    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7kwhw\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="6275cc5a-747f-4413-9a35-e715b63a0b21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:43.213983 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:43.213951    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9cwlz\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="d2cc174d-e609-4b67-be2a-a73108f0f1a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:43.261088 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.261051    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dtfk\" (UniqueName: \"kubernetes.io/projected/cb0033c5-f524-4b7a-96d8-bd12f48ad7fb-kube-api-access-6dtfk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6zswn\" (UID: \"cb0033c5-f524-4b7a-96d8-bd12f48ad7fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"
Jul 07 18:57:43.261240 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.261120    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j4nv\" (UniqueName: \"kubernetes.io/projected/3c372f48-e347-4aae-84e9-eae58d31cd37-kube-api-access-6j4nv\") pod \"limitador-operator-controller-manager-859d7b78bd-qptkl\" (UID: \"3c372f48-e347-4aae-84e9-eae58d31cd37\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qptkl"
Jul 07 18:57:43.261316 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.261246    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb0033c5-f524-4b7a-96d8-bd12f48ad7fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6zswn\" (UID: \"cb0033c5-f524-4b7a-96d8-bd12f48ad7fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"
Jul 07 18:57:43.261635 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.261606    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb0033c5-f524-4b7a-96d8-bd12f48ad7fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6zswn\" (UID: \"cb0033c5-f524-4b7a-96d8-bd12f48ad7fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"
Jul 07 18:57:43.275230 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.275197    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dtfk\" (UniqueName: \"kubernetes.io/projected/cb0033c5-f524-4b7a-96d8-bd12f48ad7fb-kube-api-access-6dtfk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6zswn\" (UID: \"cb0033c5-f524-4b7a-96d8-bd12f48ad7fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"
Jul 07 18:57:43.361951 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.361875    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j4nv\" (UniqueName: \"kubernetes.io/projected/3c372f48-e347-4aae-84e9-eae58d31cd37-kube-api-access-6j4nv\") pod \"limitador-operator-controller-manager-859d7b78bd-qptkl\" (UID: \"3c372f48-e347-4aae-84e9-eae58d31cd37\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qptkl"
Jul 07 18:57:43.374992 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.374962    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j4nv\" (UniqueName: \"kubernetes.io/projected/3c372f48-e347-4aae-84e9-eae58d31cd37-kube-api-access-6j4nv\") pod \"limitador-operator-controller-manager-859d7b78bd-qptkl\" (UID: \"3c372f48-e347-4aae-84e9-eae58d31cd37\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qptkl"
Jul 07 18:57:43.517957 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.517919    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"
Jul 07 18:57:43.527160 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:43.527105    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qptkl"
Jul 07 18:57:54.953415 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:54.953390    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:54.955968 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:54.955938    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9cwlz\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="d2cc174d-e609-4b67-be2a-a73108f0f1a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:54.969252 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:54.969011    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:54.972907 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:54.972877    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7kwhw\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="6275cc5a-747f-4413-9a35-e715b63a0b21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:54.978073 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:54.978002    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9cwlz\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="d2cc174d-e609-4b67-be2a-a73108f0f1a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:54.982391 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:54.982364    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6f565794-4h6m4"]
Jul 07 18:57:54.985064 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:57:54.985033    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b51b5b1_0339_4a8d_95a1_f6ebe6bcc388.slice/crio-6b506f10678f102dab78ac52feea3658c7b3a803a980685356f9bf220f3a4800 WatchSource:0}: Error finding container 6b506f10678f102dab78ac52feea3658c7b3a803a980685356f9bf220f3a4800: Status 404 returned error can't find the container with id 6b506f10678f102dab78ac52feea3658c7b3a803a980685356f9bf220f3a4800
Jul 07 18:57:55.011209 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.011189    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"]
Jul 07 18:57:55.015899 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:57:55.015874    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb0033c5_f524_4b7a_96d8_bd12f48ad7fb.slice/crio-a0de3f6ffa34a01f26decfb367788ac1f50c242a7c87c2a548cc3dcdca7cda1e WatchSource:0}: Error finding container a0de3f6ffa34a01f26decfb367788ac1f50c242a7c87c2a548cc3dcdca7cda1e: Status 404 returned error can't find the container with id a0de3f6ffa34a01f26decfb367788ac1f50c242a7c87c2a548cc3dcdca7cda1e
Jul 07 18:57:55.042077 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.042049    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qptkl"]
Jul 07 18:57:55.044402 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:57:55.044306    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c372f48_e347_4aae_84e9_eae58d31cd37.slice/crio-b4aeb9efa43ed18cf1f4afcdc36f4235918291edba9cb91f1176e6f44ca920b6 WatchSource:0}: Error finding container b4aeb9efa43ed18cf1f4afcdc36f4235918291edba9cb91f1176e6f44ca920b6: Status 404 returned error can't find the container with id b4aeb9efa43ed18cf1f4afcdc36f4235918291edba9cb91f1176e6f44ca920b6
Jul 07 18:57:55.072468 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.072367    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rr5z\" (UniqueName: \"kubernetes.io/projected/6275cc5a-747f-4413-9a35-e715b63a0b21-kube-api-access-8rr5z\") pod \"6275cc5a-747f-4413-9a35-e715b63a0b21\" (UID: \"6275cc5a-747f-4413-9a35-e715b63a0b21\") "
Jul 07 18:57:55.072468 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.072416    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg4x2\" (UniqueName: \"kubernetes.io/projected/d2cc174d-e609-4b67-be2a-a73108f0f1a3-kube-api-access-tg4x2\") pod \"d2cc174d-e609-4b67-be2a-a73108f0f1a3\" (UID: \"d2cc174d-e609-4b67-be2a-a73108f0f1a3\") "
Jul 07 18:57:55.072616 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.072488    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6275cc5a-747f-4413-9a35-e715b63a0b21-extensions-socket-volume\") pod \"6275cc5a-747f-4413-9a35-e715b63a0b21\" (UID: \"6275cc5a-747f-4413-9a35-e715b63a0b21\") "
Jul 07 18:57:55.073274 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.073246    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6275cc5a-747f-4413-9a35-e715b63a0b21-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6275cc5a-747f-4413-9a35-e715b63a0b21" (UID: "6275cc5a-747f-4413-9a35-e715b63a0b21"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:57:55.074653 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.074631    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6275cc5a-747f-4413-9a35-e715b63a0b21-kube-api-access-8rr5z" (OuterVolumeSpecName: "kube-api-access-8rr5z") pod "6275cc5a-747f-4413-9a35-e715b63a0b21" (UID: "6275cc5a-747f-4413-9a35-e715b63a0b21"). InnerVolumeSpecName "kube-api-access-8rr5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:57:55.075056 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.075035    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2cc174d-e609-4b67-be2a-a73108f0f1a3-kube-api-access-tg4x2" (OuterVolumeSpecName: "kube-api-access-tg4x2") pod "d2cc174d-e609-4b67-be2a-a73108f0f1a3" (UID: "d2cc174d-e609-4b67-be2a-a73108f0f1a3"). InnerVolumeSpecName "kube-api-access-tg4x2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:57:55.174113 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.174077    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rr5z\" (UniqueName: \"kubernetes.io/projected/6275cc5a-747f-4413-9a35-e715b63a0b21-kube-api-access-8rr5z\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:57:55.174113 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.174112    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg4x2\" (UniqueName: \"kubernetes.io/projected/d2cc174d-e609-4b67-be2a-a73108f0f1a3-kube-api-access-tg4x2\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:57:55.174303 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.174127    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6275cc5a-747f-4413-9a35-e715b63a0b21-extensions-socket-volume\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:57:55.261899 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.261861    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qptkl" event={"ID":"3c372f48-e347-4aae-84e9-eae58d31cd37","Type":"ContainerStarted","Data":"1803a4eed8c93cfe67fb2684d2124281b784a901d584185fd42bd9d61bdd3904"}
Jul 07 18:57:55.262072 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.261931    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qptkl"
Jul 07 18:57:55.262072 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.261955    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qptkl" event={"ID":"3c372f48-e347-4aae-84e9-eae58d31cd37","Type":"ContainerStarted","Data":"b4aeb9efa43ed18cf1f4afcdc36f4235918291edba9cb91f1176e6f44ca920b6"}
Jul 07 18:57:55.263339 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.263310    2554 generic.go:356] "Generic (PLEG): container finished" podID="6275cc5a-747f-4413-9a35-e715b63a0b21" containerID="09214397efced6d19c0780acc69d3be077aa3f23240478d968693cb5828e05ba" exitCode=0
Jul 07 18:57:55.263452 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.263350    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:55.263452 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.263375    2554 scope.go:117] "RemoveContainer" containerID="09214397efced6d19c0780acc69d3be077aa3f23240478d968693cb5828e05ba"
Jul 07 18:57:55.265125 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:55.265082    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9cwlz\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="d2cc174d-e609-4b67-be2a-a73108f0f1a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:55.265845 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.265393    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn" event={"ID":"cb0033c5-f524-4b7a-96d8-bd12f48ad7fb","Type":"ContainerStarted","Data":"87407f1b0c40ce0f7cd1daaf7a57206c2212c336c480903615228a91b50a4ab6"}
Jul 07 18:57:55.265845 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.265456    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"
Jul 07 18:57:55.265845 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.265478    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn" event={"ID":"cb0033c5-f524-4b7a-96d8-bd12f48ad7fb","Type":"ContainerStarted","Data":"a0de3f6ffa34a01f26decfb367788ac1f50c242a7c87c2a548cc3dcdca7cda1e"}
Jul 07 18:57:55.267239 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.267168    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6f565794-4h6m4" event={"ID":"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388","Type":"ContainerStarted","Data":"f880b261ec3042d1319841937291376998197fe4b9b0f1dde0d3a623cccc850c"}
Jul 07 18:57:55.267239 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.267209    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6f565794-4h6m4" event={"ID":"9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388","Type":"ContainerStarted","Data":"6b506f10678f102dab78ac52feea3658c7b3a803a980685356f9bf220f3a4800"}
Jul 07 18:57:55.269007 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.268970    2554 generic.go:356] "Generic (PLEG): container finished" podID="d2cc174d-e609-4b67-be2a-a73108f0f1a3" containerID="ca5a31eeb885c8eb19f9e6ff283e1972e61b9f1a5fa4a4af1babad34a4e9a929" exitCode=0
Jul 07 18:57:55.269097 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.269015    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:55.271229 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.271206    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f" event={"ID":"17b87a87-3137-49e8-bfc5-3119d5a25974","Type":"ContainerStarted","Data":"4e9e83097efb5ac60c0723006392e4ec951c1b36a51a92360a8a758a98d07811"}
Jul 07 18:57:55.274777 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.274743    2554 scope.go:117] "RemoveContainer" containerID="09214397efced6d19c0780acc69d3be077aa3f23240478d968693cb5828e05ba"
Jul 07 18:57:55.275084 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:55.275064    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09214397efced6d19c0780acc69d3be077aa3f23240478d968693cb5828e05ba\": container with ID starting with 09214397efced6d19c0780acc69d3be077aa3f23240478d968693cb5828e05ba not found: ID does not exist" containerID="09214397efced6d19c0780acc69d3be077aa3f23240478d968693cb5828e05ba"
Jul 07 18:57:55.275169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.275090    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09214397efced6d19c0780acc69d3be077aa3f23240478d968693cb5828e05ba"} err="failed to get container status \"09214397efced6d19c0780acc69d3be077aa3f23240478d968693cb5828e05ba\": rpc error: code = NotFound desc = could not find container \"09214397efced6d19c0780acc69d3be077aa3f23240478d968693cb5828e05ba\": container with ID starting with 09214397efced6d19c0780acc69d3be077aa3f23240478d968693cb5828e05ba not found: ID does not exist"
Jul 07 18:57:55.275169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.275111    2554 scope.go:117] "RemoveContainer" containerID="ca5a31eeb885c8eb19f9e6ff283e1972e61b9f1a5fa4a4af1babad34a4e9a929"
Jul 07 18:57:55.283122 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.283095    2554 scope.go:117] "RemoveContainer" containerID="ca5a31eeb885c8eb19f9e6ff283e1972e61b9f1a5fa4a4af1babad34a4e9a929"
Jul 07 18:57:55.283374 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:55.283352    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca5a31eeb885c8eb19f9e6ff283e1972e61b9f1a5fa4a4af1babad34a4e9a929\": container with ID starting with ca5a31eeb885c8eb19f9e6ff283e1972e61b9f1a5fa4a4af1babad34a4e9a929 not found: ID does not exist" containerID="ca5a31eeb885c8eb19f9e6ff283e1972e61b9f1a5fa4a4af1babad34a4e9a929"
Jul 07 18:57:55.283449 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.283379    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca5a31eeb885c8eb19f9e6ff283e1972e61b9f1a5fa4a4af1babad34a4e9a929"} err="failed to get container status \"ca5a31eeb885c8eb19f9e6ff283e1972e61b9f1a5fa4a4af1babad34a4e9a929\": rpc error: code = NotFound desc = could not find container \"ca5a31eeb885c8eb19f9e6ff283e1972e61b9f1a5fa4a4af1babad34a4e9a929\": container with ID starting with ca5a31eeb885c8eb19f9e6ff283e1972e61b9f1a5fa4a4af1babad34a4e9a929 not found: ID does not exist"
Jul 07 18:57:55.290394 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:55.290362    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7kwhw\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="6275cc5a-747f-4413-9a35-e715b63a0b21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:55.291001 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.290963    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qptkl" podStartSLOduration=12.290951612 podStartE2EDuration="12.290951612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:57:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:55.288101033 +0000 UTC m=+424.447440900" watchObservedRunningTime="2026-07-07 18:57:55.290951612 +0000 UTC m=+424.450291439"
Jul 07 18:57:55.292815 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:55.292766    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7kwhw\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="6275cc5a-747f-4413-9a35-e715b63a0b21" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7kwhw"
Jul 07 18:57:55.294823 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:57:55.294779    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9cwlz\" is forbidden: User \"system:node:ip-10-0-128-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-118.ec2.internal' and this object" podUID="d2cc174d-e609-4b67-be2a-a73108f0f1a3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9cwlz"
Jul 07 18:57:55.319716 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.319664    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d6f565794-4h6m4" podStartSLOduration=15.319651611 podStartE2EDuration="15.319651611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:55.317688702 +0000 UTC m=+424.477028528" watchObservedRunningTime="2026-07-07 18:57:55.319651611 +0000 UTC m=+424.478991436"
Jul 07 18:57:55.342291 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.342247    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6mt8f" podStartSLOduration=1.147617562 podStartE2EDuration="23.342234574s" totalImagesPullingTime="22.194617012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:55.340821486 +0000 UTC m=+424.500161303" watchObservedRunningTime="2026-07-07 18:57:55.342234574 +0000 UTC m=+424.501574436"
Jul 07 18:57:55.372423 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.372368    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn" podStartSLOduration=12.372348606 podStartE2EDuration="12.372348606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:57:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:57:55.371095594 +0000 UTC m=+424.530435421" watchObservedRunningTime="2026-07-07 18:57:55.372348606 +0000 UTC m=+424.531688433"
Jul 07 18:57:55.475425 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.475392    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6275cc5a-747f-4413-9a35-e715b63a0b21" path="/var/lib/kubelet/pods/6275cc5a-747f-4413-9a35-e715b63a0b21/volumes"
Jul 07 18:57:55.475731 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:57:55.475718    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2cc174d-e609-4b67-be2a-a73108f0f1a3" path="/var/lib/kubelet/pods/d2cc174d-e609-4b67-be2a-a73108f0f1a3/volumes"
Jul 07 18:58:01.196638 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:01.196601    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:58:01.197224 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:01.196663    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:58:01.201503 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:01.201480    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:58:01.305337 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:01.305310    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d6f565794-4h6m4"
Jul 07 18:58:01.366348 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:01.366315    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ff6c6d876-clbg9"]
Jul 07 18:58:01.815176 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:01.815143    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"]
Jul 07 18:58:01.815428 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:01.815394    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn" podUID="cb0033c5-f524-4b7a-96d8-bd12f48ad7fb" containerName="manager" containerID="cri-o://87407f1b0c40ce0f7cd1daaf7a57206c2212c336c480903615228a91b50a4ab6" gracePeriod=10
Jul 07 18:58:01.817308 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:01.817284    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"
Jul 07 18:58:02.071539 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.071485    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"
Jul 07 18:58:02.232368 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.232339    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb0033c5-f524-4b7a-96d8-bd12f48ad7fb-extensions-socket-volume\") pod \"cb0033c5-f524-4b7a-96d8-bd12f48ad7fb\" (UID: \"cb0033c5-f524-4b7a-96d8-bd12f48ad7fb\") "
Jul 07 18:58:02.232765 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.232433    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dtfk\" (UniqueName: \"kubernetes.io/projected/cb0033c5-f524-4b7a-96d8-bd12f48ad7fb-kube-api-access-6dtfk\") pod \"cb0033c5-f524-4b7a-96d8-bd12f48ad7fb\" (UID: \"cb0033c5-f524-4b7a-96d8-bd12f48ad7fb\") "
Jul 07 18:58:02.232765 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.232655    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb0033c5-f524-4b7a-96d8-bd12f48ad7fb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cb0033c5-f524-4b7a-96d8-bd12f48ad7fb" (UID: "cb0033c5-f524-4b7a-96d8-bd12f48ad7fb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:58:02.234613 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.234589    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb0033c5-f524-4b7a-96d8-bd12f48ad7fb-kube-api-access-6dtfk" (OuterVolumeSpecName: "kube-api-access-6dtfk") pod "cb0033c5-f524-4b7a-96d8-bd12f48ad7fb" (UID: "cb0033c5-f524-4b7a-96d8-bd12f48ad7fb"). InnerVolumeSpecName "kube-api-access-6dtfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:58:02.306814 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.306771    2554 generic.go:356] "Generic (PLEG): container finished" podID="cb0033c5-f524-4b7a-96d8-bd12f48ad7fb" containerID="87407f1b0c40ce0f7cd1daaf7a57206c2212c336c480903615228a91b50a4ab6" exitCode=0
Jul 07 18:58:02.306952 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.306847    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"
Jul 07 18:58:02.306952 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.306866    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn" event={"ID":"cb0033c5-f524-4b7a-96d8-bd12f48ad7fb","Type":"ContainerDied","Data":"87407f1b0c40ce0f7cd1daaf7a57206c2212c336c480903615228a91b50a4ab6"}
Jul 07 18:58:02.306952 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.306937    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn" event={"ID":"cb0033c5-f524-4b7a-96d8-bd12f48ad7fb","Type":"ContainerDied","Data":"a0de3f6ffa34a01f26decfb367788ac1f50c242a7c87c2a548cc3dcdca7cda1e"}
Jul 07 18:58:02.307112 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.306968    2554 scope.go:117] "RemoveContainer" containerID="87407f1b0c40ce0f7cd1daaf7a57206c2212c336c480903615228a91b50a4ab6"
Jul 07 18:58:02.315248 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.315230    2554 scope.go:117] "RemoveContainer" containerID="87407f1b0c40ce0f7cd1daaf7a57206c2212c336c480903615228a91b50a4ab6"
Jul 07 18:58:02.315490 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:58:02.315474    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87407f1b0c40ce0f7cd1daaf7a57206c2212c336c480903615228a91b50a4ab6\": container with ID starting with 87407f1b0c40ce0f7cd1daaf7a57206c2212c336c480903615228a91b50a4ab6 not found: ID does not exist" containerID="87407f1b0c40ce0f7cd1daaf7a57206c2212c336c480903615228a91b50a4ab6"
Jul 07 18:58:02.315531 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.315497    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87407f1b0c40ce0f7cd1daaf7a57206c2212c336c480903615228a91b50a4ab6"} err="failed to get container status \"87407f1b0c40ce0f7cd1daaf7a57206c2212c336c480903615228a91b50a4ab6\": rpc error: code = NotFound desc = could not find container \"87407f1b0c40ce0f7cd1daaf7a57206c2212c336c480903615228a91b50a4ab6\": container with ID starting with 87407f1b0c40ce0f7cd1daaf7a57206c2212c336c480903615228a91b50a4ab6 not found: ID does not exist"
Jul 07 18:58:02.331680 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.331626    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"]
Jul 07 18:58:02.334095 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.334049    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb0033c5-f524-4b7a-96d8-bd12f48ad7fb-extensions-socket-volume\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:58:02.334095 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.334074    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dtfk\" (UniqueName: \"kubernetes.io/projected/cb0033c5-f524-4b7a-96d8-bd12f48ad7fb-kube-api-access-6dtfk\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:58:02.351147 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:02.351124    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zswn"]
Jul 07 18:58:03.473765 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:03.473730    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb0033c5-f524-4b7a-96d8-bd12f48ad7fb" path="/var/lib/kubelet/pods/cb0033c5-f524-4b7a-96d8-bd12f48ad7fb/volumes"
Jul 07 18:58:06.281132 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:06.281100    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qptkl"
Jul 07 18:58:18.260712 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.260630    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"]
Jul 07 18:58:18.261185 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.261166    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb0033c5-f524-4b7a-96d8-bd12f48ad7fb" containerName="manager"
Jul 07 18:58:18.261253 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.261188    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb0033c5-f524-4b7a-96d8-bd12f48ad7fb" containerName="manager"
Jul 07 18:58:18.261307 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.261298    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb0033c5-f524-4b7a-96d8-bd12f48ad7fb" containerName="manager"
Jul 07 18:58:18.382066 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.382028    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"]
Jul 07 18:58:18.382250 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.382143    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.386837 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.386810    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-x2ln6\""
Jul 07 18:58:18.565180 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.565086    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7403f0c3-7607-4d6a-9b33-232877bea187-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.565180 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.565162    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.565359 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.565193    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.565359 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.565301    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.565359 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.565339    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7403f0c3-7607-4d6a-9b33-232877bea187-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.565453 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.565361    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.565453 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.565378    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7403f0c3-7607-4d6a-9b33-232877bea187-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.565453 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.565400    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rd8j\" (UniqueName: \"kubernetes.io/projected/7403f0c3-7607-4d6a-9b33-232877bea187-kube-api-access-6rd8j\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.565545 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.565451    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.665913 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.665880    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7403f0c3-7607-4d6a-9b33-232877bea187-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.666056 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.665925    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.666056 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.665946    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.666056 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.665989    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.666056 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.666005    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7403f0c3-7607-4d6a-9b33-232877bea187-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.666056 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.666023    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.666056 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.666044    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7403f0c3-7607-4d6a-9b33-232877bea187-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.666349 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.666071    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rd8j\" (UniqueName: \"kubernetes.io/projected/7403f0c3-7607-4d6a-9b33-232877bea187-kube-api-access-6rd8j\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.666349 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.666099    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.666455 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.666422    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.666551 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.666510    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.666703 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.666677    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.666838 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.666684    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.666838 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.666733    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7403f0c3-7607-4d6a-9b33-232877bea187-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.668169 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.668148    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7403f0c3-7607-4d6a-9b33-232877bea187-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.668455 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.668435    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7403f0c3-7607-4d6a-9b33-232877bea187-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.674963 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.674943    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7403f0c3-7607-4d6a-9b33-232877bea187-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.675168 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.675148    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rd8j\" (UniqueName: \"kubernetes.io/projected/7403f0c3-7607-4d6a-9b33-232877bea187-kube-api-access-6rd8j\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4tmq\" (UID: \"7403f0c3-7607-4d6a-9b33-232877bea187\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.693903 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.693878    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:18.845134 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.845105    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"]
Jul 07 18:58:18.847246 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:58:18.847219    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7403f0c3_7607_4d6a_9b33_232877bea187.slice/crio-07ff7398286131753e8f4e9c8f6720b3f466e1a1aa4b0ed0d44c24e614649bd6 WatchSource:0}: Error finding container 07ff7398286131753e8f4e9c8f6720b3f466e1a1aa4b0ed0d44c24e614649bd6: Status 404 returned error can't find the container with id 07ff7398286131753e8f4e9c8f6720b3f466e1a1aa4b0ed0d44c24e614649bd6
Jul 07 18:58:18.849445 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.849416    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 18:58:18.849536 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.849475    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 18:58:18.849536 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:18.849503    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 18:58:19.402301 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:19.402255    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq" event={"ID":"7403f0c3-7607-4d6a-9b33-232877bea187","Type":"ContainerStarted","Data":"c3d93aa6b27a8b7c0981479846f7c588e24ddc0c0888e56cdddb8ec41bd9d1cc"}
Jul 07 18:58:19.402699 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:19.402355    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq" event={"ID":"7403f0c3-7607-4d6a-9b33-232877bea187","Type":"ContainerStarted","Data":"07ff7398286131753e8f4e9c8f6720b3f466e1a1aa4b0ed0d44c24e614649bd6"}
Jul 07 18:58:19.426989 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:19.426939    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq" podStartSLOduration=1.42692502 podStartE2EDuration="1.42692502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:58:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:58:19.425312527 +0000 UTC m=+448.584652379" watchObservedRunningTime="2026-07-07 18:58:19.42692502 +0000 UTC m=+448.586264848"
Jul 07 18:58:19.695098 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:19.695012    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:19.700431 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:19.700407    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:20.408119 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:20.408082    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:20.409070 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:20.409045    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:58:20.478298 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:20.478269    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"]
Jul 07 18:58:20.719394 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:20.719319    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"]
Jul 07 18:58:20.719394 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:20.719362    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"]
Jul 07 18:58:20.719565 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:20.719432    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"
Jul 07 18:58:20.722606 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:20.722586    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 18:58:20.780874 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:20.780846    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a75f7433-91d4-45b3-8930-731477dc7f09-config-file\") pod \"limitador-limitador-64c94fd64f-g7dtf\" (UID: \"a75f7433-91d4-45b3-8930-731477dc7f09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"
Jul 07 18:58:20.781010 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:20.780922    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvxjl\" (UniqueName: \"kubernetes.io/projected/a75f7433-91d4-45b3-8930-731477dc7f09-kube-api-access-tvxjl\") pod \"limitador-limitador-64c94fd64f-g7dtf\" (UID: \"a75f7433-91d4-45b3-8930-731477dc7f09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"
Jul 07 18:58:20.881859 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:20.881821    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a75f7433-91d4-45b3-8930-731477dc7f09-config-file\") pod \"limitador-limitador-64c94fd64f-g7dtf\" (UID: \"a75f7433-91d4-45b3-8930-731477dc7f09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"
Jul 07 18:58:20.882009 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:20.881908    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvxjl\" (UniqueName: \"kubernetes.io/projected/a75f7433-91d4-45b3-8930-731477dc7f09-kube-api-access-tvxjl\") pod \"limitador-limitador-64c94fd64f-g7dtf\" (UID: \"a75f7433-91d4-45b3-8930-731477dc7f09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"
Jul 07 18:58:20.882467 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:20.882446    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a75f7433-91d4-45b3-8930-731477dc7f09-config-file\") pod \"limitador-limitador-64c94fd64f-g7dtf\" (UID: \"a75f7433-91d4-45b3-8930-731477dc7f09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"
Jul 07 18:58:20.890732 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:20.890703    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvxjl\" (UniqueName: \"kubernetes.io/projected/a75f7433-91d4-45b3-8930-731477dc7f09-kube-api-access-tvxjl\") pod \"limitador-limitador-64c94fd64f-g7dtf\" (UID: \"a75f7433-91d4-45b3-8930-731477dc7f09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"
Jul 07 18:58:21.030421 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:21.030387    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"
Jul 07 18:58:21.184391 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:21.184361    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"]
Jul 07 18:58:21.186841 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:58:21.186793    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75f7433_91d4_45b3_8930_731477dc7f09.slice/crio-26036e921d83053fa8ca42a83586f820eb96f26273e7a2936cc28554e78a3b41 WatchSource:0}: Error finding container 26036e921d83053fa8ca42a83586f820eb96f26273e7a2936cc28554e78a3b41: Status 404 returned error can't find the container with id 26036e921d83053fa8ca42a83586f820eb96f26273e7a2936cc28554e78a3b41
Jul 07 18:58:21.413551 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:21.413474    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf" event={"ID":"a75f7433-91d4-45b3-8930-731477dc7f09","Type":"ContainerStarted","Data":"26036e921d83053fa8ca42a83586f820eb96f26273e7a2936cc28554e78a3b41"}
Jul 07 18:58:21.524340 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:21.524295    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-8869c"]
Jul 07 18:58:21.769618 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:21.769583    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8869c"]
Jul 07 18:58:21.769838 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:21.769677    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8869c"
Jul 07 18:58:21.776617 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:21.776596    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8w792\""
Jul 07 18:58:21.789571 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:21.789547    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-268r7\" (UniqueName: \"kubernetes.io/projected/019393b7-255f-49d1-816d-5e2130b7d54f-kube-api-access-268r7\") pod \"authorino-75d556bd77-8869c\" (UID: \"019393b7-255f-49d1-816d-5e2130b7d54f\") " pod="kuadrant-system/authorino-75d556bd77-8869c"
Jul 07 18:58:21.890457 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:21.890426    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-268r7\" (UniqueName: \"kubernetes.io/projected/019393b7-255f-49d1-816d-5e2130b7d54f-kube-api-access-268r7\") pod \"authorino-75d556bd77-8869c\" (UID: \"019393b7-255f-49d1-816d-5e2130b7d54f\") " pod="kuadrant-system/authorino-75d556bd77-8869c"
Jul 07 18:58:21.900317 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:21.900288    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-268r7\" (UniqueName: \"kubernetes.io/projected/019393b7-255f-49d1-816d-5e2130b7d54f-kube-api-access-268r7\") pod \"authorino-75d556bd77-8869c\" (UID: \"019393b7-255f-49d1-816d-5e2130b7d54f\") " pod="kuadrant-system/authorino-75d556bd77-8869c"
Jul 07 18:58:22.079620 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:22.079550    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8869c"
Jul 07 18:58:22.234264 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:22.234222    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8869c"]
Jul 07 18:58:22.236893 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:58:22.236861    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod019393b7_255f_49d1_816d_5e2130b7d54f.slice/crio-f2a37311954e3e911b4a24a56dec9cd9f046dbc2a459d027b27c70963bea025e WatchSource:0}: Error finding container f2a37311954e3e911b4a24a56dec9cd9f046dbc2a459d027b27c70963bea025e: Status 404 returned error can't find the container with id f2a37311954e3e911b4a24a56dec9cd9f046dbc2a459d027b27c70963bea025e
Jul 07 18:58:22.421385 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:22.421301    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8869c" event={"ID":"019393b7-255f-49d1-816d-5e2130b7d54f","Type":"ContainerStarted","Data":"f2a37311954e3e911b4a24a56dec9cd9f046dbc2a459d027b27c70963bea025e"}
Jul 07 18:58:26.387082 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.387047    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-ff6c6d876-clbg9" podUID="6663035b-3e91-4757-942d-ca13b925356f" containerName="console" containerID="cri-o://b2b7c219b0f79ed74e4f6b3eee112e78cb2222e6a19b3342a2c0caee085d13e1" gracePeriod=15
Jul 07 18:58:26.646900 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.646874    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:58:26.740316 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.740283    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6663035b-3e91-4757-942d-ca13b925356f-console-oauth-config\") pod \"6663035b-3e91-4757-942d-ca13b925356f\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") "
Jul 07 18:58:26.740466 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.740326    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-trusted-ca-bundle\") pod \"6663035b-3e91-4757-942d-ca13b925356f\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") "
Jul 07 18:58:26.740466 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.740352    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-console-config\") pod \"6663035b-3e91-4757-942d-ca13b925356f\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") "
Jul 07 18:58:26.740466 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.740376    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6663035b-3e91-4757-942d-ca13b925356f-console-serving-cert\") pod \"6663035b-3e91-4757-942d-ca13b925356f\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") "
Jul 07 18:58:26.740466 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.740404    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-oauth-serving-cert\") pod \"6663035b-3e91-4757-942d-ca13b925356f\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") "
Jul 07 18:58:26.740466 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.740446    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-service-ca\") pod \"6663035b-3e91-4757-942d-ca13b925356f\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") "
Jul 07 18:58:26.740466 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.740461    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2x69\" (UniqueName: \"kubernetes.io/projected/6663035b-3e91-4757-942d-ca13b925356f-kube-api-access-c2x69\") pod \"6663035b-3e91-4757-942d-ca13b925356f\" (UID: \"6663035b-3e91-4757-942d-ca13b925356f\") "
Jul 07 18:58:26.740895 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.740868    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6663035b-3e91-4757-942d-ca13b925356f" (UID: "6663035b-3e91-4757-942d-ca13b925356f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:58:26.740977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.740915    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6663035b-3e91-4757-942d-ca13b925356f" (UID: "6663035b-3e91-4757-942d-ca13b925356f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:58:26.740977 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.740939    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-service-ca" (OuterVolumeSpecName: "service-ca") pod "6663035b-3e91-4757-942d-ca13b925356f" (UID: "6663035b-3e91-4757-942d-ca13b925356f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:58:26.741044 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.741019    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-console-config" (OuterVolumeSpecName: "console-config") pod "6663035b-3e91-4757-942d-ca13b925356f" (UID: "6663035b-3e91-4757-942d-ca13b925356f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:58:26.742432 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.742409    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6663035b-3e91-4757-942d-ca13b925356f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6663035b-3e91-4757-942d-ca13b925356f" (UID: "6663035b-3e91-4757-942d-ca13b925356f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:58:26.742605 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.742579    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6663035b-3e91-4757-942d-ca13b925356f-kube-api-access-c2x69" (OuterVolumeSpecName: "kube-api-access-c2x69") pod "6663035b-3e91-4757-942d-ca13b925356f" (UID: "6663035b-3e91-4757-942d-ca13b925356f"). InnerVolumeSpecName "kube-api-access-c2x69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:58:26.742671 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.742650    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6663035b-3e91-4757-942d-ca13b925356f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6663035b-3e91-4757-942d-ca13b925356f" (UID: "6663035b-3e91-4757-942d-ca13b925356f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:58:26.841900 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.841856    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-console-config\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:58:26.841900 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.841893    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6663035b-3e91-4757-942d-ca13b925356f-console-serving-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:58:26.841900 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.841903    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-oauth-serving-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:58:26.841900 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.841912    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:58:26.842146 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.841921    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2x69\" (UniqueName: \"kubernetes.io/projected/6663035b-3e91-4757-942d-ca13b925356f-kube-api-access-c2x69\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:58:26.842146 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.841931    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6663035b-3e91-4757-942d-ca13b925356f-console-oauth-config\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:58:26.842146 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:26.841939    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6663035b-3e91-4757-942d-ca13b925356f-trusted-ca-bundle\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:58:27.453202 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:27.453171    2554 generic.go:356] "Generic (PLEG): container finished" podID="6663035b-3e91-4757-942d-ca13b925356f" containerID="b2b7c219b0f79ed74e4f6b3eee112e78cb2222e6a19b3342a2c0caee085d13e1" exitCode=0
Jul 07 18:58:27.453652 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:27.453218    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff6c6d876-clbg9"
Jul 07 18:58:27.453652 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:27.453258    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff6c6d876-clbg9" event={"ID":"6663035b-3e91-4757-942d-ca13b925356f","Type":"ContainerDied","Data":"b2b7c219b0f79ed74e4f6b3eee112e78cb2222e6a19b3342a2c0caee085d13e1"}
Jul 07 18:58:27.453652 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:27.453313    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff6c6d876-clbg9" event={"ID":"6663035b-3e91-4757-942d-ca13b925356f","Type":"ContainerDied","Data":"9644ae97fbe08fbd046d532de1d33d1a4983e26680a2fa8247d36988c1f5bc89"}
Jul 07 18:58:27.453652 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:27.453346    2554 scope.go:117] "RemoveContainer" containerID="b2b7c219b0f79ed74e4f6b3eee112e78cb2222e6a19b3342a2c0caee085d13e1"
Jul 07 18:58:27.454930 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:27.454909    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf" event={"ID":"a75f7433-91d4-45b3-8930-731477dc7f09","Type":"ContainerStarted","Data":"086a3edf27ff49e2886aff3017d9346059588240b0cf5bdcb12a4348a8e51a98"}
Jul 07 18:58:27.455067 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:27.455049    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"
Jul 07 18:58:27.456493 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:27.456465    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8869c" event={"ID":"019393b7-255f-49d1-816d-5e2130b7d54f","Type":"ContainerStarted","Data":"41c730af51a07294ae07ae6ce7009c6512de2a8be1ef36542fdc0e9ec3f977f1"}
Jul 07 18:58:27.462350 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:27.462334    2554 scope.go:117] "RemoveContainer" containerID="b2b7c219b0f79ed74e4f6b3eee112e78cb2222e6a19b3342a2c0caee085d13e1"
Jul 07 18:58:27.462583 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:58:27.462566    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2b7c219b0f79ed74e4f6b3eee112e78cb2222e6a19b3342a2c0caee085d13e1\": container with ID starting with b2b7c219b0f79ed74e4f6b3eee112e78cb2222e6a19b3342a2c0caee085d13e1 not found: ID does not exist" containerID="b2b7c219b0f79ed74e4f6b3eee112e78cb2222e6a19b3342a2c0caee085d13e1"
Jul 07 18:58:27.462644 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:27.462590    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2b7c219b0f79ed74e4f6b3eee112e78cb2222e6a19b3342a2c0caee085d13e1"} err="failed to get container status \"b2b7c219b0f79ed74e4f6b3eee112e78cb2222e6a19b3342a2c0caee085d13e1\": rpc error: code = NotFound desc = could not find container \"b2b7c219b0f79ed74e4f6b3eee112e78cb2222e6a19b3342a2c0caee085d13e1\": container with ID starting with b2b7c219b0f79ed74e4f6b3eee112e78cb2222e6a19b3342a2c0caee085d13e1 not found: ID does not exist"
Jul 07 18:58:27.477035 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:27.476991    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf" podStartSLOduration=2.258728949 podStartE2EDuration="7.476978915s" totalImagesPullingTime="5.218249966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:58:27.476254664 +0000 UTC m=+456.635594492" watchObservedRunningTime="2026-07-07 18:58:27.476978915 +0000 UTC m=+456.636318740"
Jul 07 18:58:27.498174 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:27.498139    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-8869c" podStartSLOduration=2.368879447 podStartE2EDuration="6.498127203s" totalImagesPullingTime="4.129247756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:58:27.496302335 +0000 UTC m=+456.655642164" watchObservedRunningTime="2026-07-07 18:58:27.498127203 +0000 UTC m=+456.657467029"
Jul 07 18:58:27.517193 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:27.517166    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ff6c6d876-clbg9"]
Jul 07 18:58:27.525724 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:27.525698    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-ff6c6d876-clbg9"]
Jul 07 18:58:29.473686 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:29.473647    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6663035b-3e91-4757-942d-ca13b925356f" path="/var/lib/kubelet/pods/6663035b-3e91-4757-942d-ca13b925356f/volumes"
Jul 07 18:58:37.782284 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:37.782247    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"]
Jul 07 18:58:37.782720 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:37.782435    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf" podUID="a75f7433-91d4-45b3-8930-731477dc7f09" containerName="limitador" containerID="cri-o://086a3edf27ff49e2886aff3017d9346059588240b0cf5bdcb12a4348a8e51a98" gracePeriod=30
Jul 07 18:58:37.783165 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:37.783147    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"
Jul 07 18:58:38.332771 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.332744    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"
Jul 07 18:58:38.439262 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.439183    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvxjl\" (UniqueName: \"kubernetes.io/projected/a75f7433-91d4-45b3-8930-731477dc7f09-kube-api-access-tvxjl\") pod \"a75f7433-91d4-45b3-8930-731477dc7f09\" (UID: \"a75f7433-91d4-45b3-8930-731477dc7f09\") "
Jul 07 18:58:38.439262 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.439231    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a75f7433-91d4-45b3-8930-731477dc7f09-config-file\") pod \"a75f7433-91d4-45b3-8930-731477dc7f09\" (UID: \"a75f7433-91d4-45b3-8930-731477dc7f09\") "
Jul 07 18:58:38.439636 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.439603    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a75f7433-91d4-45b3-8930-731477dc7f09-config-file" (OuterVolumeSpecName: "config-file") pod "a75f7433-91d4-45b3-8930-731477dc7f09" (UID: "a75f7433-91d4-45b3-8930-731477dc7f09"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:58:38.441148 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.441125    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a75f7433-91d4-45b3-8930-731477dc7f09-kube-api-access-tvxjl" (OuterVolumeSpecName: "kube-api-access-tvxjl") pod "a75f7433-91d4-45b3-8930-731477dc7f09" (UID: "a75f7433-91d4-45b3-8930-731477dc7f09"). InnerVolumeSpecName "kube-api-access-tvxjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:58:38.509151 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.509120    2554 generic.go:356] "Generic (PLEG): container finished" podID="a75f7433-91d4-45b3-8930-731477dc7f09" containerID="086a3edf27ff49e2886aff3017d9346059588240b0cf5bdcb12a4348a8e51a98" exitCode=0
Jul 07 18:58:38.509261 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.509167    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"
Jul 07 18:58:38.509261 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.509209    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf" event={"ID":"a75f7433-91d4-45b3-8930-731477dc7f09","Type":"ContainerDied","Data":"086a3edf27ff49e2886aff3017d9346059588240b0cf5bdcb12a4348a8e51a98"}
Jul 07 18:58:38.509345 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.509261    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g7dtf" event={"ID":"a75f7433-91d4-45b3-8930-731477dc7f09","Type":"ContainerDied","Data":"26036e921d83053fa8ca42a83586f820eb96f26273e7a2936cc28554e78a3b41"}
Jul 07 18:58:38.509345 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.509284    2554 scope.go:117] "RemoveContainer" containerID="086a3edf27ff49e2886aff3017d9346059588240b0cf5bdcb12a4348a8e51a98"
Jul 07 18:58:38.517670 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.517651    2554 scope.go:117] "RemoveContainer" containerID="086a3edf27ff49e2886aff3017d9346059588240b0cf5bdcb12a4348a8e51a98"
Jul 07 18:58:38.517937 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:58:38.517918    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"086a3edf27ff49e2886aff3017d9346059588240b0cf5bdcb12a4348a8e51a98\": container with ID starting with 086a3edf27ff49e2886aff3017d9346059588240b0cf5bdcb12a4348a8e51a98 not found: ID does not exist" containerID="086a3edf27ff49e2886aff3017d9346059588240b0cf5bdcb12a4348a8e51a98"
Jul 07 18:58:38.518002 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.517945    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086a3edf27ff49e2886aff3017d9346059588240b0cf5bdcb12a4348a8e51a98"} err="failed to get container status \"086a3edf27ff49e2886aff3017d9346059588240b0cf5bdcb12a4348a8e51a98\": rpc error: code = NotFound desc = could not find container \"086a3edf27ff49e2886aff3017d9346059588240b0cf5bdcb12a4348a8e51a98\": container with ID starting with 086a3edf27ff49e2886aff3017d9346059588240b0cf5bdcb12a4348a8e51a98 not found: ID does not exist"
Jul 07 18:58:38.530955 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.530931    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"]
Jul 07 18:58:38.535824 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.535790    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g7dtf"]
Jul 07 18:58:38.539837 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.539813    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvxjl\" (UniqueName: \"kubernetes.io/projected/a75f7433-91d4-45b3-8930-731477dc7f09-kube-api-access-tvxjl\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:58:38.539941 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:38.539839    2554 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a75f7433-91d4-45b3-8930-731477dc7f09-config-file\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:58:39.474812 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:39.474768    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a75f7433-91d4-45b3-8930-731477dc7f09" path="/var/lib/kubelet/pods/a75f7433-91d4-45b3-8930-731477dc7f09/volumes"
Jul 07 18:58:42.111643 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.111600    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-764d8"]
Jul 07 18:58:42.112156 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.111970    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6663035b-3e91-4757-942d-ca13b925356f" containerName="console"
Jul 07 18:58:42.112156 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.111983    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6663035b-3e91-4757-942d-ca13b925356f" containerName="console"
Jul 07 18:58:42.112156 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.111995    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75f7433-91d4-45b3-8930-731477dc7f09" containerName="limitador"
Jul 07 18:58:42.112156 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.112001    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75f7433-91d4-45b3-8930-731477dc7f09" containerName="limitador"
Jul 07 18:58:42.112156 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.112063    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a75f7433-91d4-45b3-8930-731477dc7f09" containerName="limitador"
Jul 07 18:58:42.112156 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.112075    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6663035b-3e91-4757-942d-ca13b925356f" containerName="console"
Jul 07 18:58:42.116324 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.116304    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-764d8"
Jul 07 18:58:42.119227 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.119207    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-gz72q\""
Jul 07 18:58:42.119326 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.119251    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 18:58:42.129186 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.129163    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-764d8"]
Jul 07 18:58:42.166364 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.166337    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4457n\" (UniqueName: \"kubernetes.io/projected/410bced3-113f-42f0-a965-4a9eaafa88f7-kube-api-access-4457n\") pod \"postgres-69fb4594cf-764d8\" (UID: \"410bced3-113f-42f0-a965-4a9eaafa88f7\") " pod="opendatahub/postgres-69fb4594cf-764d8"
Jul 07 18:58:42.166474 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.166396    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/410bced3-113f-42f0-a965-4a9eaafa88f7-data\") pod \"postgres-69fb4594cf-764d8\" (UID: \"410bced3-113f-42f0-a965-4a9eaafa88f7\") " pod="opendatahub/postgres-69fb4594cf-764d8"
Jul 07 18:58:42.267065 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.267033    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/410bced3-113f-42f0-a965-4a9eaafa88f7-data\") pod \"postgres-69fb4594cf-764d8\" (UID: \"410bced3-113f-42f0-a965-4a9eaafa88f7\") " pod="opendatahub/postgres-69fb4594cf-764d8"
Jul 07 18:58:42.267185 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.267085    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4457n\" (UniqueName: \"kubernetes.io/projected/410bced3-113f-42f0-a965-4a9eaafa88f7-kube-api-access-4457n\") pod \"postgres-69fb4594cf-764d8\" (UID: \"410bced3-113f-42f0-a965-4a9eaafa88f7\") " pod="opendatahub/postgres-69fb4594cf-764d8"
Jul 07 18:58:42.267411 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.267392    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/410bced3-113f-42f0-a965-4a9eaafa88f7-data\") pod \"postgres-69fb4594cf-764d8\" (UID: \"410bced3-113f-42f0-a965-4a9eaafa88f7\") " pod="opendatahub/postgres-69fb4594cf-764d8"
Jul 07 18:58:42.279072 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.279050    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4457n\" (UniqueName: \"kubernetes.io/projected/410bced3-113f-42f0-a965-4a9eaafa88f7-kube-api-access-4457n\") pod \"postgres-69fb4594cf-764d8\" (UID: \"410bced3-113f-42f0-a965-4a9eaafa88f7\") " pod="opendatahub/postgres-69fb4594cf-764d8"
Jul 07 18:58:42.426577 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.426507    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-764d8"
Jul 07 18:58:42.566376 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:42.566339    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-764d8"]
Jul 07 18:58:42.569292 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:58:42.569267    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod410bced3_113f_42f0_a965_4a9eaafa88f7.slice/crio-961a48af1af606ed76b3ab792365b79e8af6f573385872fc9a291249fe4e6599 WatchSource:0}: Error finding container 961a48af1af606ed76b3ab792365b79e8af6f573385872fc9a291249fe4e6599: Status 404 returned error can't find the container with id 961a48af1af606ed76b3ab792365b79e8af6f573385872fc9a291249fe4e6599
Jul 07 18:58:43.537324 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:43.537284    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-764d8" event={"ID":"410bced3-113f-42f0-a965-4a9eaafa88f7","Type":"ContainerStarted","Data":"961a48af1af606ed76b3ab792365b79e8af6f573385872fc9a291249fe4e6599"}
Jul 07 18:58:47.558939 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:47.558906    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-764d8" event={"ID":"410bced3-113f-42f0-a965-4a9eaafa88f7","Type":"ContainerStarted","Data":"c1dde8d8133994bbc1f645cc82cb92a7d54731dc3d0f7164426774e1e3e90228"}
Jul 07 18:58:47.559365 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:47.558958    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-764d8"
Jul 07 18:58:47.576315 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:47.576270    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-764d8" podStartSLOduration=1.04939339 podStartE2EDuration="5.57625735s" totalImagesPullingTime="4.52686396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:58:47.574890739 +0000 UTC m=+476.734230592" watchObservedRunningTime="2026-07-07 18:58:47.57625735 +0000 UTC m=+476.735597220"
Jul 07 18:58:53.593548 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:53.593521    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-764d8"
Jul 07 18:58:55.917316 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:55.917281    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8869c"]
Jul 07 18:58:55.917781 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:55.917505    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-8869c" podUID="019393b7-255f-49d1-816d-5e2130b7d54f" containerName="authorino" containerID="cri-o://41c730af51a07294ae07ae6ce7009c6512de2a8be1ef36542fdc0e9ec3f977f1" gracePeriod=30
Jul 07 18:58:56.183066 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:56.182998    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8869c"
Jul 07 18:58:56.288219 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:56.288185    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-268r7\" (UniqueName: \"kubernetes.io/projected/019393b7-255f-49d1-816d-5e2130b7d54f-kube-api-access-268r7\") pod \"019393b7-255f-49d1-816d-5e2130b7d54f\" (UID: \"019393b7-255f-49d1-816d-5e2130b7d54f\") "
Jul 07 18:58:56.290214 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:56.290189    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/019393b7-255f-49d1-816d-5e2130b7d54f-kube-api-access-268r7" (OuterVolumeSpecName: "kube-api-access-268r7") pod "019393b7-255f-49d1-816d-5e2130b7d54f" (UID: "019393b7-255f-49d1-816d-5e2130b7d54f"). InnerVolumeSpecName "kube-api-access-268r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:58:56.389220 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:56.389186    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-268r7\" (UniqueName: \"kubernetes.io/projected/019393b7-255f-49d1-816d-5e2130b7d54f-kube-api-access-268r7\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:58:56.601118 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:56.601087    2554 generic.go:356] "Generic (PLEG): container finished" podID="019393b7-255f-49d1-816d-5e2130b7d54f" containerID="41c730af51a07294ae07ae6ce7009c6512de2a8be1ef36542fdc0e9ec3f977f1" exitCode=0
Jul 07 18:58:56.601277 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:56.601128    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8869c"
Jul 07 18:58:56.601277 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:56.601167    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8869c" event={"ID":"019393b7-255f-49d1-816d-5e2130b7d54f","Type":"ContainerDied","Data":"41c730af51a07294ae07ae6ce7009c6512de2a8be1ef36542fdc0e9ec3f977f1"}
Jul 07 18:58:56.601277 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:56.601210    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8869c" event={"ID":"019393b7-255f-49d1-816d-5e2130b7d54f","Type":"ContainerDied","Data":"f2a37311954e3e911b4a24a56dec9cd9f046dbc2a459d027b27c70963bea025e"}
Jul 07 18:58:56.601277 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:56.601227    2554 scope.go:117] "RemoveContainer" containerID="41c730af51a07294ae07ae6ce7009c6512de2a8be1ef36542fdc0e9ec3f977f1"
Jul 07 18:58:56.609398 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:56.609382    2554 scope.go:117] "RemoveContainer" containerID="41c730af51a07294ae07ae6ce7009c6512de2a8be1ef36542fdc0e9ec3f977f1"
Jul 07 18:58:56.609627 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:58:56.609610    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41c730af51a07294ae07ae6ce7009c6512de2a8be1ef36542fdc0e9ec3f977f1\": container with ID starting with 41c730af51a07294ae07ae6ce7009c6512de2a8be1ef36542fdc0e9ec3f977f1 not found: ID does not exist" containerID="41c730af51a07294ae07ae6ce7009c6512de2a8be1ef36542fdc0e9ec3f977f1"
Jul 07 18:58:56.609705 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:56.609633    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41c730af51a07294ae07ae6ce7009c6512de2a8be1ef36542fdc0e9ec3f977f1"} err="failed to get container status \"41c730af51a07294ae07ae6ce7009c6512de2a8be1ef36542fdc0e9ec3f977f1\": rpc error: code = NotFound desc = could not find container \"41c730af51a07294ae07ae6ce7009c6512de2a8be1ef36542fdc0e9ec3f977f1\": container with ID starting with 41c730af51a07294ae07ae6ce7009c6512de2a8be1ef36542fdc0e9ec3f977f1 not found: ID does not exist"
Jul 07 18:58:56.622702 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:56.622682    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8869c"]
Jul 07 18:58:56.630366 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:56.630344    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8869c"]
Jul 07 18:58:57.479526 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:58:57.479487    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="019393b7-255f-49d1-816d-5e2130b7d54f" path="/var/lib/kubelet/pods/019393b7-255f-49d1-816d-5e2130b7d54f/volumes"
Jul 07 18:59:00.338058 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.338019    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5df8fc765-2vm2w"]
Jul 07 18:59:00.338542 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.338521    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="019393b7-255f-49d1-816d-5e2130b7d54f" containerName="authorino"
Jul 07 18:59:00.338616 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.338546    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="019393b7-255f-49d1-816d-5e2130b7d54f" containerName="authorino"
Jul 07 18:59:00.338666 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.338639    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="019393b7-255f-49d1-816d-5e2130b7d54f" containerName="authorino"
Jul 07 18:59:00.560057 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.560025    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df8fc765-2vm2w"]
Jul 07 18:59:00.560207 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.560085    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74cdf475f-x59hr"]
Jul 07 18:59:00.560207 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.560145    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df8fc765-2vm2w"
Jul 07 18:59:00.564166 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.564143    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 18:59:00.564356 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.564198    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4ch8p\""
Jul 07 18:59:00.564356 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.564275    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 18:59:00.584899 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.584876    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74cdf475f-x59hr"]
Jul 07 18:59:00.584982 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.584964    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74cdf475f-x59hr"
Jul 07 18:59:00.726989 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.726957    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zjn7\" (UniqueName: \"kubernetes.io/projected/7899aa46-296e-4cc6-8d46-28795a4a1cae-kube-api-access-7zjn7\") pod \"maas-controller-74cdf475f-x59hr\" (UID: \"7899aa46-296e-4cc6-8d46-28795a4a1cae\") " pod="opendatahub/maas-controller-74cdf475f-x59hr"
Jul 07 18:59:00.727115 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.727047    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7899aa46-296e-4cc6-8d46-28795a4a1cae-webhook-cert\") pod \"maas-controller-74cdf475f-x59hr\" (UID: \"7899aa46-296e-4cc6-8d46-28795a4a1cae\") " pod="opendatahub/maas-controller-74cdf475f-x59hr"
Jul 07 18:59:00.727115 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.727078    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f40502bb-5a7c-4757-8b2f-317e983c1283-webhook-cert\") pod \"maas-controller-5df8fc765-2vm2w\" (UID: \"f40502bb-5a7c-4757-8b2f-317e983c1283\") " pod="opendatahub/maas-controller-5df8fc765-2vm2w"
Jul 07 18:59:00.727115 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.727100    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kxqz\" (UniqueName: \"kubernetes.io/projected/f40502bb-5a7c-4757-8b2f-317e983c1283-kube-api-access-7kxqz\") pod \"maas-controller-5df8fc765-2vm2w\" (UID: \"f40502bb-5a7c-4757-8b2f-317e983c1283\") " pod="opendatahub/maas-controller-5df8fc765-2vm2w"
Jul 07 18:59:00.827677 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.827639    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7899aa46-296e-4cc6-8d46-28795a4a1cae-webhook-cert\") pod \"maas-controller-74cdf475f-x59hr\" (UID: \"7899aa46-296e-4cc6-8d46-28795a4a1cae\") " pod="opendatahub/maas-controller-74cdf475f-x59hr"
Jul 07 18:59:00.827842 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.827684    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f40502bb-5a7c-4757-8b2f-317e983c1283-webhook-cert\") pod \"maas-controller-5df8fc765-2vm2w\" (UID: \"f40502bb-5a7c-4757-8b2f-317e983c1283\") " pod="opendatahub/maas-controller-5df8fc765-2vm2w"
Jul 07 18:59:00.827842 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.827708    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kxqz\" (UniqueName: \"kubernetes.io/projected/f40502bb-5a7c-4757-8b2f-317e983c1283-kube-api-access-7kxqz\") pod \"maas-controller-5df8fc765-2vm2w\" (UID: \"f40502bb-5a7c-4757-8b2f-317e983c1283\") " pod="opendatahub/maas-controller-5df8fc765-2vm2w"
Jul 07 18:59:00.827842 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.827750    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zjn7\" (UniqueName: \"kubernetes.io/projected/7899aa46-296e-4cc6-8d46-28795a4a1cae-kube-api-access-7zjn7\") pod \"maas-controller-74cdf475f-x59hr\" (UID: \"7899aa46-296e-4cc6-8d46-28795a4a1cae\") " pod="opendatahub/maas-controller-74cdf475f-x59hr"
Jul 07 18:59:00.830268 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.830240    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7899aa46-296e-4cc6-8d46-28795a4a1cae-webhook-cert\") pod \"maas-controller-74cdf475f-x59hr\" (UID: \"7899aa46-296e-4cc6-8d46-28795a4a1cae\") " pod="opendatahub/maas-controller-74cdf475f-x59hr"
Jul 07 18:59:00.830357 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.830240    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f40502bb-5a7c-4757-8b2f-317e983c1283-webhook-cert\") pod \"maas-controller-5df8fc765-2vm2w\" (UID: \"f40502bb-5a7c-4757-8b2f-317e983c1283\") " pod="opendatahub/maas-controller-5df8fc765-2vm2w"
Jul 07 18:59:00.838709 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.838683    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zjn7\" (UniqueName: \"kubernetes.io/projected/7899aa46-296e-4cc6-8d46-28795a4a1cae-kube-api-access-7zjn7\") pod \"maas-controller-74cdf475f-x59hr\" (UID: \"7899aa46-296e-4cc6-8d46-28795a4a1cae\") " pod="opendatahub/maas-controller-74cdf475f-x59hr"
Jul 07 18:59:00.838809 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.838783    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kxqz\" (UniqueName: \"kubernetes.io/projected/f40502bb-5a7c-4757-8b2f-317e983c1283-kube-api-access-7kxqz\") pod \"maas-controller-5df8fc765-2vm2w\" (UID: \"f40502bb-5a7c-4757-8b2f-317e983c1283\") " pod="opendatahub/maas-controller-5df8fc765-2vm2w"
Jul 07 18:59:00.870533 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.870481    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df8fc765-2vm2w"
Jul 07 18:59:00.894123 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:00.894103    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74cdf475f-x59hr"
Jul 07 18:59:01.038265 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:01.038242    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df8fc765-2vm2w"]
Jul 07 18:59:01.040231 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:59:01.040203    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40502bb_5a7c_4757_8b2f_317e983c1283.slice/crio-751617c5a31acb1d46659f993173b8621203a831f001a9b68dfdfdb097cb82b0 WatchSource:0}: Error finding container 751617c5a31acb1d46659f993173b8621203a831f001a9b68dfdfdb097cb82b0: Status 404 returned error can't find the container with id 751617c5a31acb1d46659f993173b8621203a831f001a9b68dfdfdb097cb82b0
Jul 07 18:59:01.056177 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:01.056154    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74cdf475f-x59hr"]
Jul 07 18:59:01.058013 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:59:01.057987    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7899aa46_296e_4cc6_8d46_28795a4a1cae.slice/crio-5b7b99a9c077bb09ddefe2c819d9ca23f3fc6dc180528eb7fe5a24d47229f959 WatchSource:0}: Error finding container 5b7b99a9c077bb09ddefe2c819d9ca23f3fc6dc180528eb7fe5a24d47229f959: Status 404 returned error can't find the container with id 5b7b99a9c077bb09ddefe2c819d9ca23f3fc6dc180528eb7fe5a24d47229f959
Jul 07 18:59:01.627104 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:01.627064    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74cdf475f-x59hr" event={"ID":"7899aa46-296e-4cc6-8d46-28795a4a1cae","Type":"ContainerStarted","Data":"5b7b99a9c077bb09ddefe2c819d9ca23f3fc6dc180528eb7fe5a24d47229f959"}
Jul 07 18:59:01.628409 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:01.628386    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df8fc765-2vm2w" event={"ID":"f40502bb-5a7c-4757-8b2f-317e983c1283","Type":"ContainerStarted","Data":"751617c5a31acb1d46659f993173b8621203a831f001a9b68dfdfdb097cb82b0"}
Jul 07 18:59:03.639348 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:03.639261    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74cdf475f-x59hr" event={"ID":"7899aa46-296e-4cc6-8d46-28795a4a1cae","Type":"ContainerStarted","Data":"2dd675d2b955dcb3f283bb45b523101402489d0fce920d63425313c7baeb56d0"}
Jul 07 18:59:03.639847 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:03.639375    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74cdf475f-x59hr"
Jul 07 18:59:03.640962 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:03.640938    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df8fc765-2vm2w" event={"ID":"f40502bb-5a7c-4757-8b2f-317e983c1283","Type":"ContainerStarted","Data":"fc068e409518d8aaf1c7f39ef4d06ebaf419a9d2499e882079005710b62005e0"}
Jul 07 18:59:03.641054 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:03.640993    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5df8fc765-2vm2w"
Jul 07 18:59:03.667429 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:03.667386    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74cdf475f-x59hr" podStartSLOduration=1.432843944 podStartE2EDuration="3.66737323s" totalImagesPullingTime="2.234529286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:59:03.666224677 +0000 UTC m=+492.825564503" watchObservedRunningTime="2026-07-07 18:59:03.66737323 +0000 UTC m=+492.826713055"
Jul 07 18:59:03.694227 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:03.694183    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5df8fc765-2vm2w" podStartSLOduration=1.433155213 podStartE2EDuration="3.694165691s" totalImagesPullingTime="2.261010478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:59:03.692525305 +0000 UTC m=+492.851865179" watchObservedRunningTime="2026-07-07 18:59:03.694165691 +0000 UTC m=+492.853505546"
Jul 07 18:59:14.650238 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:14.650207    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74cdf475f-x59hr"
Jul 07 18:59:14.651850 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:14.651825    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5df8fc765-2vm2w"
Jul 07 18:59:14.719215 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:14.719186    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df8fc765-2vm2w"]
Jul 07 18:59:14.719426 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:14.719354    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5df8fc765-2vm2w" podUID="f40502bb-5a7c-4757-8b2f-317e983c1283" containerName="manager" containerID="cri-o://fc068e409518d8aaf1c7f39ef4d06ebaf419a9d2499e882079005710b62005e0" gracePeriod=30
Jul 07 18:59:14.960490 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:14.960463    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df8fc765-2vm2w"
Jul 07 18:59:15.143717 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.143686    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f40502bb-5a7c-4757-8b2f-317e983c1283-webhook-cert\") pod \"f40502bb-5a7c-4757-8b2f-317e983c1283\" (UID: \"f40502bb-5a7c-4757-8b2f-317e983c1283\") "
Jul 07 18:59:15.143886 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.143738    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kxqz\" (UniqueName: \"kubernetes.io/projected/f40502bb-5a7c-4757-8b2f-317e983c1283-kube-api-access-7kxqz\") pod \"f40502bb-5a7c-4757-8b2f-317e983c1283\" (UID: \"f40502bb-5a7c-4757-8b2f-317e983c1283\") "
Jul 07 18:59:15.145915 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.145886    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f40502bb-5a7c-4757-8b2f-317e983c1283-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f40502bb-5a7c-4757-8b2f-317e983c1283" (UID: "f40502bb-5a7c-4757-8b2f-317e983c1283"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:59:15.145915 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.145907    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f40502bb-5a7c-4757-8b2f-317e983c1283-kube-api-access-7kxqz" (OuterVolumeSpecName: "kube-api-access-7kxqz") pod "f40502bb-5a7c-4757-8b2f-317e983c1283" (UID: "f40502bb-5a7c-4757-8b2f-317e983c1283"). InnerVolumeSpecName "kube-api-access-7kxqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:59:15.245006 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.244987    2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f40502bb-5a7c-4757-8b2f-317e983c1283-webhook-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:59:15.245118 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.245009    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kxqz\" (UniqueName: \"kubernetes.io/projected/f40502bb-5a7c-4757-8b2f-317e983c1283-kube-api-access-7kxqz\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 18:59:15.697231 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.697144    2554 generic.go:356] "Generic (PLEG): container finished" podID="f40502bb-5a7c-4757-8b2f-317e983c1283" containerID="fc068e409518d8aaf1c7f39ef4d06ebaf419a9d2499e882079005710b62005e0" exitCode=0
Jul 07 18:59:15.697231 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.697190    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df8fc765-2vm2w"
Jul 07 18:59:15.697231 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.697197    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df8fc765-2vm2w" event={"ID":"f40502bb-5a7c-4757-8b2f-317e983c1283","Type":"ContainerDied","Data":"fc068e409518d8aaf1c7f39ef4d06ebaf419a9d2499e882079005710b62005e0"}
Jul 07 18:59:15.697758 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.697241    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df8fc765-2vm2w" event={"ID":"f40502bb-5a7c-4757-8b2f-317e983c1283","Type":"ContainerDied","Data":"751617c5a31acb1d46659f993173b8621203a831f001a9b68dfdfdb097cb82b0"}
Jul 07 18:59:15.697758 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.697263    2554 scope.go:117] "RemoveContainer" containerID="fc068e409518d8aaf1c7f39ef4d06ebaf419a9d2499e882079005710b62005e0"
Jul 07 18:59:15.707425 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.707370    2554 scope.go:117] "RemoveContainer" containerID="fc068e409518d8aaf1c7f39ef4d06ebaf419a9d2499e882079005710b62005e0"
Jul 07 18:59:15.707909 ip-10-0-128-118 kubenswrapper[2554]: E0707 18:59:15.707885    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc068e409518d8aaf1c7f39ef4d06ebaf419a9d2499e882079005710b62005e0\": container with ID starting with fc068e409518d8aaf1c7f39ef4d06ebaf419a9d2499e882079005710b62005e0 not found: ID does not exist" containerID="fc068e409518d8aaf1c7f39ef4d06ebaf419a9d2499e882079005710b62005e0"
Jul 07 18:59:15.708002 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.707919    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc068e409518d8aaf1c7f39ef4d06ebaf419a9d2499e882079005710b62005e0"} err="failed to get container status \"fc068e409518d8aaf1c7f39ef4d06ebaf419a9d2499e882079005710b62005e0\": rpc error: code = NotFound desc = could not find container \"fc068e409518d8aaf1c7f39ef4d06ebaf419a9d2499e882079005710b62005e0\": container with ID starting with fc068e409518d8aaf1c7f39ef4d06ebaf419a9d2499e882079005710b62005e0 not found: ID does not exist"
Jul 07 18:59:15.720912 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.720889    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df8fc765-2vm2w"]
Jul 07 18:59:15.725175 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:15.725154    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5df8fc765-2vm2w"]
Jul 07 18:59:17.474523 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:17.474488    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f40502bb-5a7c-4757-8b2f-317e983c1283" path="/var/lib/kubelet/pods/f40502bb-5a7c-4757-8b2f-317e983c1283/volumes"
Jul 07 18:59:36.513621 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.513587    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5fcf4f568d-7znxx"]
Jul 07 18:59:36.514028 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.513969    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f40502bb-5a7c-4757-8b2f-317e983c1283" containerName="manager"
Jul 07 18:59:36.514028 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.513981    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f40502bb-5a7c-4757-8b2f-317e983c1283" containerName="manager"
Jul 07 18:59:36.514096 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.514050    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f40502bb-5a7c-4757-8b2f-317e983c1283" containerName="manager"
Jul 07 18:59:36.516958 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.516934    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5fcf4f568d-7znxx"
Jul 07 18:59:36.519436 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.519416    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-vhgsf\""
Jul 07 18:59:36.519709 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.519689    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 07 18:59:36.534458 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.534437    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5fcf4f568d-7znxx"]
Jul 07 18:59:36.608230 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.608201    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf8448f0-d085-4f78-91a7-e3ca17534ddd-maas-api-tls\") pod \"maas-api-5fcf4f568d-7znxx\" (UID: \"bf8448f0-d085-4f78-91a7-e3ca17534ddd\") " pod="opendatahub/maas-api-5fcf4f568d-7znxx"
Jul 07 18:59:36.608363 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.608236    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf8448f0-d085-4f78-91a7-e3ca17534ddd-openshift-service-ca\") pod \"maas-api-5fcf4f568d-7znxx\" (UID: \"bf8448f0-d085-4f78-91a7-e3ca17534ddd\") " pod="opendatahub/maas-api-5fcf4f568d-7znxx"
Jul 07 18:59:36.608363 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.608255    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzvbx\" (UniqueName: \"kubernetes.io/projected/bf8448f0-d085-4f78-91a7-e3ca17534ddd-kube-api-access-bzvbx\") pod \"maas-api-5fcf4f568d-7znxx\" (UID: \"bf8448f0-d085-4f78-91a7-e3ca17534ddd\") " pod="opendatahub/maas-api-5fcf4f568d-7znxx"
Jul 07 18:59:36.709032 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.709002    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf8448f0-d085-4f78-91a7-e3ca17534ddd-maas-api-tls\") pod \"maas-api-5fcf4f568d-7znxx\" (UID: \"bf8448f0-d085-4f78-91a7-e3ca17534ddd\") " pod="opendatahub/maas-api-5fcf4f568d-7znxx"
Jul 07 18:59:36.709183 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.709039    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf8448f0-d085-4f78-91a7-e3ca17534ddd-openshift-service-ca\") pod \"maas-api-5fcf4f568d-7znxx\" (UID: \"bf8448f0-d085-4f78-91a7-e3ca17534ddd\") " pod="opendatahub/maas-api-5fcf4f568d-7znxx"
Jul 07 18:59:36.709183 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.709058    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvbx\" (UniqueName: \"kubernetes.io/projected/bf8448f0-d085-4f78-91a7-e3ca17534ddd-kube-api-access-bzvbx\") pod \"maas-api-5fcf4f568d-7znxx\" (UID: \"bf8448f0-d085-4f78-91a7-e3ca17534ddd\") " pod="opendatahub/maas-api-5fcf4f568d-7znxx"
Jul 07 18:59:36.709660 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.709634    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf8448f0-d085-4f78-91a7-e3ca17534ddd-openshift-service-ca\") pod \"maas-api-5fcf4f568d-7znxx\" (UID: \"bf8448f0-d085-4f78-91a7-e3ca17534ddd\") " pod="opendatahub/maas-api-5fcf4f568d-7znxx"
Jul 07 18:59:36.711364 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.711337    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf8448f0-d085-4f78-91a7-e3ca17534ddd-maas-api-tls\") pod \"maas-api-5fcf4f568d-7znxx\" (UID: \"bf8448f0-d085-4f78-91a7-e3ca17534ddd\") " pod="opendatahub/maas-api-5fcf4f568d-7znxx"
Jul 07 18:59:36.726700 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.726678    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzvbx\" (UniqueName: \"kubernetes.io/projected/bf8448f0-d085-4f78-91a7-e3ca17534ddd-kube-api-access-bzvbx\") pod \"maas-api-5fcf4f568d-7znxx\" (UID: \"bf8448f0-d085-4f78-91a7-e3ca17534ddd\") " pod="opendatahub/maas-api-5fcf4f568d-7znxx"
Jul 07 18:59:36.827399 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.827326    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5fcf4f568d-7znxx"
Jul 07 18:59:36.969095 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:36.969056    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5fcf4f568d-7znxx"]
Jul 07 18:59:36.972603 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:59:36.972571    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf8448f0_d085_4f78_91a7_e3ca17534ddd.slice/crio-b120d89ce532d9625586d1e250095ddb0cca32eac9b483db0c7246945f784403 WatchSource:0}: Error finding container b120d89ce532d9625586d1e250095ddb0cca32eac9b483db0c7246945f784403: Status 404 returned error can't find the container with id b120d89ce532d9625586d1e250095ddb0cca32eac9b483db0c7246945f784403
Jul 07 18:59:37.023700 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.023673    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-q68pg"]
Jul 07 18:59:37.027226 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.027211    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-q68pg"
Jul 07 18:59:37.029745 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.029714    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 18:59:37.029887 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.029770    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vjscd\""
Jul 07 18:59:37.038702 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.038682    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-q68pg"]
Jul 07 18:59:37.041925 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.041906    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-x8vgz"]
Jul 07 18:59:37.044358 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.044341    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-x8vgz"
Jul 07 18:59:37.058382 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.058360    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-x8vgz"]
Jul 07 18:59:37.112352 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.112269    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8-plugins-config-volume\") pod \"payload-processing-58f86c7798-x8vgz\" (UID: \"7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8\") " pod="openshift-ingress/payload-processing-58f86c7798-x8vgz"
Jul 07 18:59:37.112352 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.112333    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95tc2\" (UniqueName: \"kubernetes.io/projected/7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8-kube-api-access-95tc2\") pod \"payload-processing-58f86c7798-x8vgz\" (UID: \"7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8\") " pod="openshift-ingress/payload-processing-58f86c7798-x8vgz"
Jul 07 18:59:37.112556 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.112387    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f66922a2-9690-47d6-a1c8-8a43dbeeb1b7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-q68pg\" (UID: \"f66922a2-9690-47d6-a1c8-8a43dbeeb1b7\") " pod="openshift-ingress/payload-pre-processing-7964457696-q68pg"
Jul 07 18:59:37.112556 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.112446    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2gcp\" (UniqueName: \"kubernetes.io/projected/f66922a2-9690-47d6-a1c8-8a43dbeeb1b7-kube-api-access-r2gcp\") pod \"payload-pre-processing-7964457696-q68pg\" (UID: \"f66922a2-9690-47d6-a1c8-8a43dbeeb1b7\") " pod="openshift-ingress/payload-pre-processing-7964457696-q68pg"
Jul 07 18:59:37.213256 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.213214    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8-plugins-config-volume\") pod \"payload-processing-58f86c7798-x8vgz\" (UID: \"7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8\") " pod="openshift-ingress/payload-processing-58f86c7798-x8vgz"
Jul 07 18:59:37.213430 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.213277    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95tc2\" (UniqueName: \"kubernetes.io/projected/7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8-kube-api-access-95tc2\") pod \"payload-processing-58f86c7798-x8vgz\" (UID: \"7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8\") " pod="openshift-ingress/payload-processing-58f86c7798-x8vgz"
Jul 07 18:59:37.213430 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.213321    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f66922a2-9690-47d6-a1c8-8a43dbeeb1b7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-q68pg\" (UID: \"f66922a2-9690-47d6-a1c8-8a43dbeeb1b7\") " pod="openshift-ingress/payload-pre-processing-7964457696-q68pg"
Jul 07 18:59:37.213430 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.213362    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2gcp\" (UniqueName: \"kubernetes.io/projected/f66922a2-9690-47d6-a1c8-8a43dbeeb1b7-kube-api-access-r2gcp\") pod \"payload-pre-processing-7964457696-q68pg\" (UID: \"f66922a2-9690-47d6-a1c8-8a43dbeeb1b7\") " pod="openshift-ingress/payload-pre-processing-7964457696-q68pg"
Jul 07 18:59:37.214136 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.214108    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f66922a2-9690-47d6-a1c8-8a43dbeeb1b7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-q68pg\" (UID: \"f66922a2-9690-47d6-a1c8-8a43dbeeb1b7\") " pod="openshift-ingress/payload-pre-processing-7964457696-q68pg"
Jul 07 18:59:37.214253 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.214165    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8-plugins-config-volume\") pod \"payload-processing-58f86c7798-x8vgz\" (UID: \"7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8\") " pod="openshift-ingress/payload-processing-58f86c7798-x8vgz"
Jul 07 18:59:37.223517 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.223489    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2gcp\" (UniqueName: \"kubernetes.io/projected/f66922a2-9690-47d6-a1c8-8a43dbeeb1b7-kube-api-access-r2gcp\") pod \"payload-pre-processing-7964457696-q68pg\" (UID: \"f66922a2-9690-47d6-a1c8-8a43dbeeb1b7\") " pod="openshift-ingress/payload-pre-processing-7964457696-q68pg"
Jul 07 18:59:37.224057 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.224041    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95tc2\" (UniqueName: \"kubernetes.io/projected/7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8-kube-api-access-95tc2\") pod \"payload-processing-58f86c7798-x8vgz\" (UID: \"7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8\") " pod="openshift-ingress/payload-processing-58f86c7798-x8vgz"
Jul 07 18:59:37.338808 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.338765    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-q68pg"
Jul 07 18:59:37.356943 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.356917    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-x8vgz"
Jul 07 18:59:37.542506 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.542471    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-q68pg"]
Jul 07 18:59:37.545647 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:59:37.545616    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf66922a2_9690_47d6_a1c8_8a43dbeeb1b7.slice/crio-bce7bc9208fcf9eb2ee9f09b379ab75688d1593854f970f8cda6cfffa5e56cde WatchSource:0}: Error finding container bce7bc9208fcf9eb2ee9f09b379ab75688d1593854f970f8cda6cfffa5e56cde: Status 404 returned error can't find the container with id bce7bc9208fcf9eb2ee9f09b379ab75688d1593854f970f8cda6cfffa5e56cde
Jul 07 18:59:37.577974 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.577954    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-x8vgz"]
Jul 07 18:59:37.580206 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:59:37.580168    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f77b55e_a96b_4cea_bb5b_15d63eb3ffd8.slice/crio-c1e881cd03bd63ec8de9dddf131c6cb32bfd83bbe11b1225e68e0c9dda896143 WatchSource:0}: Error finding container c1e881cd03bd63ec8de9dddf131c6cb32bfd83bbe11b1225e68e0c9dda896143: Status 404 returned error can't find the container with id c1e881cd03bd63ec8de9dddf131c6cb32bfd83bbe11b1225e68e0c9dda896143
Jul 07 18:59:37.802596 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.802544    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5fcf4f568d-7znxx" event={"ID":"bf8448f0-d085-4f78-91a7-e3ca17534ddd","Type":"ContainerStarted","Data":"b120d89ce532d9625586d1e250095ddb0cca32eac9b483db0c7246945f784403"}
Jul 07 18:59:37.804563 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.804532    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-x8vgz" event={"ID":"7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8","Type":"ContainerStarted","Data":"c1e881cd03bd63ec8de9dddf131c6cb32bfd83bbe11b1225e68e0c9dda896143"}
Jul 07 18:59:37.805987 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:37.805949    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-q68pg" event={"ID":"f66922a2-9690-47d6-a1c8-8a43dbeeb1b7","Type":"ContainerStarted","Data":"bce7bc9208fcf9eb2ee9f09b379ab75688d1593854f970f8cda6cfffa5e56cde"}
Jul 07 18:59:39.818146 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:39.818110    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-x8vgz" event={"ID":"7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8","Type":"ContainerStarted","Data":"3db7a558ac093a761f08c2551d10bc24b1a726d8e9e93c3bd38a5c514b4d019b"}
Jul 07 18:59:39.818703 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:39.818196    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-x8vgz"
Jul 07 18:59:39.819653 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:39.819628    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-q68pg" event={"ID":"f66922a2-9690-47d6-a1c8-8a43dbeeb1b7","Type":"ContainerStarted","Data":"c8eda49e2e5173dad5aba47a2b7948bf9a1b0ca898b114ccf3b65d5c7e95879c"}
Jul 07 18:59:39.819790 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:39.819687    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-q68pg"
Jul 07 18:59:39.821057 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:39.821037    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5fcf4f568d-7znxx" event={"ID":"bf8448f0-d085-4f78-91a7-e3ca17534ddd","Type":"ContainerStarted","Data":"ca76e060eb79316203de38c3b91032df25f37445302e41596d05be2f0bbe5667"}
Jul 07 18:59:39.821136 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:39.821091    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5fcf4f568d-7znxx"
Jul 07 18:59:39.837241 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:39.837204    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-x8vgz" podStartSLOduration=1.013122109 podStartE2EDuration="2.837190566s" totalImagesPullingTime="1.824068457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:59:39.836076429 +0000 UTC m=+528.995416255" watchObservedRunningTime="2026-07-07 18:59:39.837190566 +0000 UTC m=+528.996530370"
Jul 07 18:59:39.854749 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:39.854704    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-q68pg" podStartSLOduration=0.994083185 podStartE2EDuration="2.854691249s" totalImagesPullingTime="1.860608064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:59:39.854145133 +0000 UTC m=+529.013484988" watchObservedRunningTime="2026-07-07 18:59:39.854691249 +0000 UTC m=+529.014031075"
Jul 07 18:59:44.848498 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:44.848468    2554 generic.go:356] "Generic (PLEG): container finished" podID="7403f0c3-7607-4d6a-9b33-232877bea187" containerID="c3d93aa6b27a8b7c0981479846f7c588e24ddc0c0888e56cdddb8ec41bd9d1cc" exitCode=0
Jul 07 18:59:44.848923 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:44.848502    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq" event={"ID":"7403f0c3-7607-4d6a-9b33-232877bea187","Type":"ContainerDied","Data":"c3d93aa6b27a8b7c0981479846f7c588e24ddc0c0888e56cdddb8ec41bd9d1cc"}
Jul 07 18:59:44.849022 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:44.849005    2554 scope.go:117] "RemoveContainer" containerID="c3d93aa6b27a8b7c0981479846f7c588e24ddc0c0888e56cdddb8ec41bd9d1cc"
Jul 07 18:59:44.850089 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:44.850062    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 18:59:44.850170 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:44.850147    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 18:59:44.850215 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:44.850202    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 18:59:44.873196 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:44.873152    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5fcf4f568d-7znxx" podStartSLOduration=6.440763024 podStartE2EDuration="8.873134773s" totalImagesPullingTime="2.432371749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:59:39.875568181 +0000 UTC m=+529.034908008" watchObservedRunningTime="2026-07-07 18:59:44.873134773 +0000 UTC m=+534.032474604"
Jul 07 18:59:45.832406 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:45.832377    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5fcf4f568d-7znxx"
Jul 07 18:59:45.855787 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:45.855757    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq" event={"ID":"7403f0c3-7607-4d6a-9b33-232877bea187","Type":"ContainerStarted","Data":"9fd9021ac62bfffecc91ee4dbcabbd842d7549c1a6b4416a57a02a821e4615c0"}
Jul 07 18:59:46.694896 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:46.694866    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:59:46.696066 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:46.696034    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b4tmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 07 18:59:46.696187 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:46.696096    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq" podUID="7403f0c3-7607-4d6a-9b33-232877bea187" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 07 18:59:47.695199 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:47.695147    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b4tmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 07 18:59:47.695597 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:47.695217    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq" podUID="7403f0c3-7607-4d6a-9b33-232877bea187" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 07 18:59:48.694514 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:48.694475    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b4tmq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 07 18:59:48.694722 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:48.694553    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq" podUID="7403f0c3-7607-4d6a-9b33-232877bea187" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 07 18:59:49.698669 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:49.698638    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:59:49.699109 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:49.699010    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:59:49.699844 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:49.699825    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4tmq"
Jul 07 18:59:50.828275 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:50.828242    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-x8vgz"
Jul 07 18:59:50.828666 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:50.828328    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-q68pg"
Jul 07 18:59:55.321924 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.321894    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"]
Jul 07 18:59:55.324915 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.324899    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.329428 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.329406    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 18:59:55.329543 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.329436    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mnl4n\""
Jul 07 18:59:55.329543 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.329443    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 18:59:55.329543 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.329406    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 18:59:55.336210 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.336190    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"]
Jul 07 18:59:55.476349 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.476323    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.476349 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.476352    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkfnp\" (UniqueName: \"kubernetes.io/projected/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-kube-api-access-tkfnp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.476545 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.476445    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.476545 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.476493    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.476545 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.476513    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.476637 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.476562    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.578167 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.578079    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.578327 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.578240    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.578327 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.578283    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.578327 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.578317    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.578482 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.578348    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.578482 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.578376    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkfnp\" (UniqueName: \"kubernetes.io/projected/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-kube-api-access-tkfnp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.578765 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.578739    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.578946 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.578782    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.578946 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.578843    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.581031 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.580999    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.581398 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.581315    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.587127 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.587108    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkfnp\" (UniqueName: \"kubernetes.io/projected/b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd-kube-api-access-tkfnp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc\" (UID: \"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.635995 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.635970    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 18:59:55.779694 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.779667    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"]
Jul 07 18:59:55.781787 ip-10-0-128-118 kubenswrapper[2554]: W0707 18:59:55.781759    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1bee22e_30d1_4a52_9e82_78d2bfcfd0cd.slice/crio-ad5fef62e0691551a1a133c6f421b5f24a553b21f0c429ab55afe26f9c15a4d5 WatchSource:0}: Error finding container ad5fef62e0691551a1a133c6f421b5f24a553b21f0c429ab55afe26f9c15a4d5: Status 404 returned error can't find the container with id ad5fef62e0691551a1a133c6f421b5f24a553b21f0c429ab55afe26f9c15a4d5
Jul 07 18:59:55.909594 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:55.909516    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc" event={"ID":"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd","Type":"ContainerStarted","Data":"ad5fef62e0691551a1a133c6f421b5f24a553b21f0c429ab55afe26f9c15a4d5"}
Jul 07 18:59:56.916168 ip-10-0-128-118 kubenswrapper[2554]: I0707 18:59:56.916134    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc" event={"ID":"b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd","Type":"ContainerStarted","Data":"c9c8ddaafa68cbdc87316de8ee33852eee94ef113f6a2b13a786fd96b702f05a"}
Jul 07 19:00:05.636912 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:05.636875    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 19:00:05.637323 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:05.636947    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 19:00:05.649436 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:05.649416    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 19:00:05.669459 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:05.669415    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc" podStartSLOduration=9.674059834 podStartE2EDuration="10.669402738s" totalImagesPullingTime="995.342904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:59:56.937117494 +0000 UTC m=+546.096457322" watchObservedRunningTime="2026-07-07 19:00:05.669402738 +0000 UTC m=+554.828742605"
Jul 07 19:00:05.977680 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:05.977656    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc"
Jul 07 19:00:19.520574 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.520543    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"]
Jul 07 19:00:19.523107 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.523083    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.526107 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.526085    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 19:00:19.536303 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.536281    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"]
Jul 07 19:00:19.578249 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.578221    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2591f05f-566f-44b2-b054-98b2a42ba7e0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.578249 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.578252    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2591f05f-566f-44b2-b054-98b2a42ba7e0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.578438 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.578271    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dplr\" (UniqueName: \"kubernetes.io/projected/2591f05f-566f-44b2-b054-98b2a42ba7e0-kube-api-access-5dplr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.578438 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.578295    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2591f05f-566f-44b2-b054-98b2a42ba7e0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.578535 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.578434    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2591f05f-566f-44b2-b054-98b2a42ba7e0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.578535 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.578486    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2591f05f-566f-44b2-b054-98b2a42ba7e0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.679887 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.679858    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2591f05f-566f-44b2-b054-98b2a42ba7e0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.680024 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.679894    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2591f05f-566f-44b2-b054-98b2a42ba7e0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.680024 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.679929    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2591f05f-566f-44b2-b054-98b2a42ba7e0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.680024 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.679947    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2591f05f-566f-44b2-b054-98b2a42ba7e0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.680024 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.679996    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dplr\" (UniqueName: \"kubernetes.io/projected/2591f05f-566f-44b2-b054-98b2a42ba7e0-kube-api-access-5dplr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.680216 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.680033    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2591f05f-566f-44b2-b054-98b2a42ba7e0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.680329 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.680258    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2591f05f-566f-44b2-b054-98b2a42ba7e0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.680388 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.680358    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2591f05f-566f-44b2-b054-98b2a42ba7e0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.680432 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.680385    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2591f05f-566f-44b2-b054-98b2a42ba7e0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.682132 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.682111    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2591f05f-566f-44b2-b054-98b2a42ba7e0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.682313 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.682296    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2591f05f-566f-44b2-b054-98b2a42ba7e0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.690263 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.690238    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dplr\" (UniqueName: \"kubernetes.io/projected/2591f05f-566f-44b2-b054-98b2a42ba7e0-kube-api-access-5dplr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dzkxr\" (UID: \"2591f05f-566f-44b2-b054-98b2a42ba7e0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.834035 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.833953    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:19.976853 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:19.976827    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"]
Jul 07 19:00:19.978951 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:00:19.978920    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2591f05f_566f_44b2_b054_98b2a42ba7e0.slice/crio-f7317e63fccb87e9b31da2cc7d4f2a820613798d8b34f1006d58bb5c2e999e58 WatchSource:0}: Error finding container f7317e63fccb87e9b31da2cc7d4f2a820613798d8b34f1006d58bb5c2e999e58: Status 404 returned error can't find the container with id f7317e63fccb87e9b31da2cc7d4f2a820613798d8b34f1006d58bb5c2e999e58
Jul 07 19:00:20.033790 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:20.033762    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr" event={"ID":"2591f05f-566f-44b2-b054-98b2a42ba7e0","Type":"ContainerStarted","Data":"f7317e63fccb87e9b31da2cc7d4f2a820613798d8b34f1006d58bb5c2e999e58"}
Jul 07 19:00:21.040333 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:21.040295    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr" event={"ID":"2591f05f-566f-44b2-b054-98b2a42ba7e0","Type":"ContainerStarted","Data":"a761cc26a487168175c17fac038bd011fa46a682c24524fc5681c87f7ea797bd"}
Jul 07 19:00:21.060184 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:21.060141    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr" podStartSLOduration=1.6349601009999999 podStartE2EDuration="2.060126485s" totalImagesPullingTime="425.166384ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:00:21.059865159 +0000 UTC m=+570.219205006" watchObservedRunningTime="2026-07-07 19:00:21.060126485 +0000 UTC m=+570.219466310"
Jul 07 19:00:29.834971 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:29.834928    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:29.835372 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:29.835002    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:29.847291 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:29.847263    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:30.094889 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:30.094809    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dzkxr"
Jul 07 19:00:51.273337 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:51.273307    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 19:00:51.275054 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:00:51.275033    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 19:02:47.459470 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.459390    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74cdf475f-x59hr"]
Jul 07 19:02:47.459985 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.459602    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-74cdf475f-x59hr" podUID="7899aa46-296e-4cc6-8d46-28795a4a1cae" containerName="manager" containerID="cri-o://2dd675d2b955dcb3f283bb45b523101402489d0fce920d63425313c7baeb56d0" gracePeriod=30
Jul 07 19:02:47.707379 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.707354    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74cdf475f-x59hr"
Jul 07 19:02:47.755489 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.755458    2554 generic.go:356] "Generic (PLEG): container finished" podID="7899aa46-296e-4cc6-8d46-28795a4a1cae" containerID="2dd675d2b955dcb3f283bb45b523101402489d0fce920d63425313c7baeb56d0" exitCode=0
Jul 07 19:02:47.755630 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.755523    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74cdf475f-x59hr"
Jul 07 19:02:47.755630 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.755521    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74cdf475f-x59hr" event={"ID":"7899aa46-296e-4cc6-8d46-28795a4a1cae","Type":"ContainerDied","Data":"2dd675d2b955dcb3f283bb45b523101402489d0fce920d63425313c7baeb56d0"}
Jul 07 19:02:47.755726 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.755668    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74cdf475f-x59hr" event={"ID":"7899aa46-296e-4cc6-8d46-28795a4a1cae","Type":"ContainerDied","Data":"5b7b99a9c077bb09ddefe2c819d9ca23f3fc6dc180528eb7fe5a24d47229f959"}
Jul 07 19:02:47.755726 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.755716    2554 scope.go:117] "RemoveContainer" containerID="2dd675d2b955dcb3f283bb45b523101402489d0fce920d63425313c7baeb56d0"
Jul 07 19:02:47.766137 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.766113    2554 scope.go:117] "RemoveContainer" containerID="2dd675d2b955dcb3f283bb45b523101402489d0fce920d63425313c7baeb56d0"
Jul 07 19:02:47.766412 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:02:47.766393    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dd675d2b955dcb3f283bb45b523101402489d0fce920d63425313c7baeb56d0\": container with ID starting with 2dd675d2b955dcb3f283bb45b523101402489d0fce920d63425313c7baeb56d0 not found: ID does not exist" containerID="2dd675d2b955dcb3f283bb45b523101402489d0fce920d63425313c7baeb56d0"
Jul 07 19:02:47.766484 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.766422    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd675d2b955dcb3f283bb45b523101402489d0fce920d63425313c7baeb56d0"} err="failed to get container status \"2dd675d2b955dcb3f283bb45b523101402489d0fce920d63425313c7baeb56d0\": rpc error: code = NotFound desc = could not find container \"2dd675d2b955dcb3f283bb45b523101402489d0fce920d63425313c7baeb56d0\": container with ID starting with 2dd675d2b955dcb3f283bb45b523101402489d0fce920d63425313c7baeb56d0 not found: ID does not exist"
Jul 07 19:02:47.779732 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.779713    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zjn7\" (UniqueName: \"kubernetes.io/projected/7899aa46-296e-4cc6-8d46-28795a4a1cae-kube-api-access-7zjn7\") pod \"7899aa46-296e-4cc6-8d46-28795a4a1cae\" (UID: \"7899aa46-296e-4cc6-8d46-28795a4a1cae\") "
Jul 07 19:02:47.779910 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.779897    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7899aa46-296e-4cc6-8d46-28795a4a1cae-webhook-cert\") pod \"7899aa46-296e-4cc6-8d46-28795a4a1cae\" (UID: \"7899aa46-296e-4cc6-8d46-28795a4a1cae\") "
Jul 07 19:02:47.781571 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.781550    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7899aa46-296e-4cc6-8d46-28795a4a1cae-kube-api-access-7zjn7" (OuterVolumeSpecName: "kube-api-access-7zjn7") pod "7899aa46-296e-4cc6-8d46-28795a4a1cae" (UID: "7899aa46-296e-4cc6-8d46-28795a4a1cae"). InnerVolumeSpecName "kube-api-access-7zjn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:02:47.781720 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.781705    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7899aa46-296e-4cc6-8d46-28795a4a1cae-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7899aa46-296e-4cc6-8d46-28795a4a1cae" (UID: "7899aa46-296e-4cc6-8d46-28795a4a1cae"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:02:47.880562 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.880533    2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7899aa46-296e-4cc6-8d46-28795a4a1cae-webhook-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:02:47.880562 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:47.880557    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zjn7\" (UniqueName: \"kubernetes.io/projected/7899aa46-296e-4cc6-8d46-28795a4a1cae-kube-api-access-7zjn7\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:02:48.079254 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:48.079217    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74cdf475f-x59hr"]
Jul 07 19:02:48.083071 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:48.083049    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74cdf475f-x59hr"]
Jul 07 19:02:48.918914 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:48.918879    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74cdf475f-wg7f4"]
Jul 07 19:02:48.919283 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:48.919237    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7899aa46-296e-4cc6-8d46-28795a4a1cae" containerName="manager"
Jul 07 19:02:48.919283 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:48.919247    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7899aa46-296e-4cc6-8d46-28795a4a1cae" containerName="manager"
Jul 07 19:02:48.919352 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:48.919311    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7899aa46-296e-4cc6-8d46-28795a4a1cae" containerName="manager"
Jul 07 19:02:48.922202 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:48.922186    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74cdf475f-wg7f4"
Jul 07 19:02:48.925891 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:48.925870    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4ch8p\""
Jul 07 19:02:48.927036 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:48.927019    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 19:02:48.927146 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:48.927127    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 19:02:48.940367 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:48.940345    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74cdf475f-wg7f4"]
Jul 07 19:02:48.991645 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:48.991620    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab8931c9-cab8-42ea-bf20-d0b81e16e1ef-webhook-cert\") pod \"maas-controller-74cdf475f-wg7f4\" (UID: \"ab8931c9-cab8-42ea-bf20-d0b81e16e1ef\") " pod="opendatahub/maas-controller-74cdf475f-wg7f4"
Jul 07 19:02:48.991752 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:48.991668    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf25c\" (UniqueName: \"kubernetes.io/projected/ab8931c9-cab8-42ea-bf20-d0b81e16e1ef-kube-api-access-tf25c\") pod \"maas-controller-74cdf475f-wg7f4\" (UID: \"ab8931c9-cab8-42ea-bf20-d0b81e16e1ef\") " pod="opendatahub/maas-controller-74cdf475f-wg7f4"
Jul 07 19:02:49.092813 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:49.092770    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab8931c9-cab8-42ea-bf20-d0b81e16e1ef-webhook-cert\") pod \"maas-controller-74cdf475f-wg7f4\" (UID: \"ab8931c9-cab8-42ea-bf20-d0b81e16e1ef\") " pod="opendatahub/maas-controller-74cdf475f-wg7f4"
Jul 07 19:02:49.092931 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:49.092849    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf25c\" (UniqueName: \"kubernetes.io/projected/ab8931c9-cab8-42ea-bf20-d0b81e16e1ef-kube-api-access-tf25c\") pod \"maas-controller-74cdf475f-wg7f4\" (UID: \"ab8931c9-cab8-42ea-bf20-d0b81e16e1ef\") " pod="opendatahub/maas-controller-74cdf475f-wg7f4"
Jul 07 19:02:49.095242 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:49.095223    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab8931c9-cab8-42ea-bf20-d0b81e16e1ef-webhook-cert\") pod \"maas-controller-74cdf475f-wg7f4\" (UID: \"ab8931c9-cab8-42ea-bf20-d0b81e16e1ef\") " pod="opendatahub/maas-controller-74cdf475f-wg7f4"
Jul 07 19:02:49.105671 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:49.105644    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf25c\" (UniqueName: \"kubernetes.io/projected/ab8931c9-cab8-42ea-bf20-d0b81e16e1ef-kube-api-access-tf25c\") pod \"maas-controller-74cdf475f-wg7f4\" (UID: \"ab8931c9-cab8-42ea-bf20-d0b81e16e1ef\") " pod="opendatahub/maas-controller-74cdf475f-wg7f4"
Jul 07 19:02:49.232637 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:49.232607    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74cdf475f-wg7f4"
Jul 07 19:02:49.371645 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:49.371622    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74cdf475f-wg7f4"]
Jul 07 19:02:49.373478 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:02:49.373449    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8931c9_cab8_42ea_bf20_d0b81e16e1ef.slice/crio-ca2e19e1443046ea2750c3b75ff061bd767018473828d7573f4ca0f4da44a6a2 WatchSource:0}: Error finding container ca2e19e1443046ea2750c3b75ff061bd767018473828d7573f4ca0f4da44a6a2: Status 404 returned error can't find the container with id ca2e19e1443046ea2750c3b75ff061bd767018473828d7573f4ca0f4da44a6a2
Jul 07 19:02:49.374787 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:49.374771    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:02:49.473973 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:49.473935    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7899aa46-296e-4cc6-8d46-28795a4a1cae" path="/var/lib/kubelet/pods/7899aa46-296e-4cc6-8d46-28795a4a1cae/volumes"
Jul 07 19:02:49.770885 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:49.770848    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74cdf475f-wg7f4" event={"ID":"ab8931c9-cab8-42ea-bf20-d0b81e16e1ef","Type":"ContainerStarted","Data":"ca2e19e1443046ea2750c3b75ff061bd767018473828d7573f4ca0f4da44a6a2"}
Jul 07 19:02:50.777234 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:50.777195    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74cdf475f-wg7f4" event={"ID":"ab8931c9-cab8-42ea-bf20-d0b81e16e1ef","Type":"ContainerStarted","Data":"ead0585affe8ef24d7c6ea4f8002392139eed4d969a966a3d1925030138902fe"}
Jul 07 19:02:50.777609 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:50.777348    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74cdf475f-wg7f4"
Jul 07 19:02:50.800213 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:02:50.800168    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74cdf475f-wg7f4" podStartSLOduration=2.320355589 podStartE2EDuration="2.800155793s" totalImagesPullingTime="479.800204ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:02:50.79870968 +0000 UTC m=+719.958049506" watchObservedRunningTime="2026-07-07 19:02:50.800155793 +0000 UTC m=+719.959495618"
Jul 07 19:03:01.787461 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:03:01.787429    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74cdf475f-wg7f4"
Jul 07 19:05:51.305854 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:05:51.305762    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 19:05:51.306301 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:05:51.305883    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 19:10:51.334880 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:10:51.334850    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 19:10:51.336696 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:10:51.336679    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 19:15:08.125063 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.124972    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"]
Jul 07 19:15:08.128492 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.128468    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.135175 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.135153    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d8f67fb0-openshift-default-dockercfg-59l4v\""
Jul 07 19:15:08.148209 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.147775    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"]
Jul 07 19:15:08.168666 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.168637    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c96a904-094c-4ff7-b7f8-351415a7a782-istiod-ca-cert\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.168784 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.168675    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-workload-socket\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.168784 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.168733    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-credential-socket\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.168784 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.168765    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s426z\" (UniqueName: \"kubernetes.io/projected/7c96a904-094c-4ff7-b7f8-351415a7a782-kube-api-access-s426z\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.168946 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.168841    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-workload-certs\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.168946 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.168859    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-envoy\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.168946 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.168874    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-data\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.168946 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.168888    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-podinfo\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.168946 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.168904    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-token\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.269426 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.269389    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-credential-socket\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.269601 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.269445    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s426z\" (UniqueName: \"kubernetes.io/projected/7c96a904-094c-4ff7-b7f8-351415a7a782-kube-api-access-s426z\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.269601 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.269490    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-workload-certs\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.269601 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.269509    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-envoy\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.269601 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.269525    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-data\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.269601 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.269583    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-podinfo\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.269929 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.269615    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-token\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.269929 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.269676    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c96a904-094c-4ff7-b7f8-351415a7a782-istiod-ca-cert\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.269929 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.269713    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-workload-socket\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.269929 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.269842    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-credential-socket\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.270172 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.270143    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-workload-certs\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.270305 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.270269    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-workload-socket\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.270418 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.270311    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-data\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.270553 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.270528    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c96a904-094c-4ff7-b7f8-351415a7a782-istiod-ca-cert\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.271997 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.271976    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-envoy\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.272136 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.272118    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-podinfo\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.277585 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.277560    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-token\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.277706 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.277688    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s426z\" (UniqueName: \"kubernetes.io/projected/7c96a904-094c-4ff7-b7f8-351415a7a782-kube-api-access-s426z\") pod \"e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") " pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.441504 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.441416    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:08.581473 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.581438    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"]
Jul 07 19:15:08.587316 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:15:08.587271    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c96a904_094c_4ff7_b7f8_351415a7a782.slice/crio-7bc30606bdc2c37bdc8373ed63ec2bb9a80001b86369cc2e4dcb6ae8f06f0cd4 WatchSource:0}: Error finding container 7bc30606bdc2c37bdc8373ed63ec2bb9a80001b86369cc2e4dcb6ae8f06f0cd4: Status 404 returned error can't find the container with id 7bc30606bdc2c37bdc8373ed63ec2bb9a80001b86369cc2e4dcb6ae8f06f0cd4
Jul 07 19:15:08.589835 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.589761    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:15:08.589935 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.589902    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:15:08.589975 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:08.589960    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:15:09.340301 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.340264    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8" event={"ID":"7c96a904-094c-4ff7-b7f8-351415a7a782","Type":"ContainerStarted","Data":"90ec4fc61aaf3e7cea05389a5cad5fe6e23cbba5766681fa10352e1adbf013cd"}
Jul 07 19:15:09.340710 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.340321    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8" event={"ID":"7c96a904-094c-4ff7-b7f8-351415a7a782","Type":"ContainerStarted","Data":"7bc30606bdc2c37bdc8373ed63ec2bb9a80001b86369cc2e4dcb6ae8f06f0cd4"}
Jul 07 19:15:09.442133 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.442101    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:09.446749 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.446726    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:09.457531 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.457482    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8" podStartSLOduration=1.45746202 podStartE2EDuration="1.45746202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:09.45695293 +0000 UTC m=+1458.616292782" watchObservedRunningTime="2026-07-07 19:15:09.45746202 +0000 UTC m=+1458.616801848"
Jul 07 19:15:09.496612 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.496577    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"]
Jul 07 19:15:09.500229 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.500212    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"
Jul 07 19:15:09.503184 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.503161    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-d8f67fb0-serving-cert\""
Jul 07 19:15:09.533084 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.533058    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"]
Jul 07 19:15:09.581339 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.581312    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01dfa600-24c9-4885-b4ed-159fa4c82e13-maas-api-tls\") pod \"maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk\" (UID: \"01dfa600-24c9-4885-b4ed-159fa4c82e13\") " pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"
Jul 07 19:15:09.581492 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.581360    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr7pt\" (UniqueName: \"kubernetes.io/projected/01dfa600-24c9-4885-b4ed-159fa4c82e13-kube-api-access-jr7pt\") pod \"maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk\" (UID: \"01dfa600-24c9-4885-b4ed-159fa4c82e13\") " pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"
Jul 07 19:15:09.581492 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.581422    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01dfa600-24c9-4885-b4ed-159fa4c82e13-openshift-service-ca\") pod \"maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk\" (UID: \"01dfa600-24c9-4885-b4ed-159fa4c82e13\") " pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"
Jul 07 19:15:09.682227 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.682130    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01dfa600-24c9-4885-b4ed-159fa4c82e13-maas-api-tls\") pod \"maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk\" (UID: \"01dfa600-24c9-4885-b4ed-159fa4c82e13\") " pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"
Jul 07 19:15:09.682227 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.682209    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr7pt\" (UniqueName: \"kubernetes.io/projected/01dfa600-24c9-4885-b4ed-159fa4c82e13-kube-api-access-jr7pt\") pod \"maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk\" (UID: \"01dfa600-24c9-4885-b4ed-159fa4c82e13\") " pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"
Jul 07 19:15:09.682461 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.682235    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01dfa600-24c9-4885-b4ed-159fa4c82e13-openshift-service-ca\") pod \"maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk\" (UID: \"01dfa600-24c9-4885-b4ed-159fa4c82e13\") " pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"
Jul 07 19:15:09.682980 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.682957    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01dfa600-24c9-4885-b4ed-159fa4c82e13-openshift-service-ca\") pod \"maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk\" (UID: \"01dfa600-24c9-4885-b4ed-159fa4c82e13\") " pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"
Jul 07 19:15:09.684719 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.684695    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01dfa600-24c9-4885-b4ed-159fa4c82e13-maas-api-tls\") pod \"maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk\" (UID: \"01dfa600-24c9-4885-b4ed-159fa4c82e13\") " pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"
Jul 07 19:15:09.705919 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.705897    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr7pt\" (UniqueName: \"kubernetes.io/projected/01dfa600-24c9-4885-b4ed-159fa4c82e13-kube-api-access-jr7pt\") pod \"maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk\" (UID: \"01dfa600-24c9-4885-b4ed-159fa4c82e13\") " pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"
Jul 07 19:15:09.810966 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.810931    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"
Jul 07 19:15:09.953642 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.953433    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"]
Jul 07 19:15:09.955826 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:15:09.955781    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01dfa600_24c9_4885_b4ed_159fa4c82e13.slice/crio-0404c75bbb2822005de8ea443e7400085b433e7e0d2032d7b7b042568c29fbb1 WatchSource:0}: Error finding container 0404c75bbb2822005de8ea443e7400085b433e7e0d2032d7b7b042568c29fbb1: Status 404 returned error can't find the container with id 0404c75bbb2822005de8ea443e7400085b433e7e0d2032d7b7b042568c29fbb1
Jul 07 19:15:09.957209 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:09.957188    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:15:10.347320 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:10.347285    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk" event={"ID":"01dfa600-24c9-4885-b4ed-159fa4c82e13","Type":"ContainerStarted","Data":"0404c75bbb2822005de8ea443e7400085b433e7e0d2032d7b7b042568c29fbb1"}
Jul 07 19:15:10.347700 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:10.347590    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:10.348647 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:10.348626    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:11.353815 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:11.353760    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk" event={"ID":"01dfa600-24c9-4885-b4ed-159fa4c82e13","Type":"ContainerStarted","Data":"31e8373b7571a7cf74e5c5fdcb8ebb7e032226f8f6830c1c6f360c3be670e19f"}
Jul 07 19:15:11.354265 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:11.354063    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"
Jul 07 19:15:11.376421 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:11.376376    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk" podStartSLOduration=1.836568159 podStartE2EDuration="2.376363091s" totalImagesPullingTime="539.794932ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:11.375131253 +0000 UTC m=+1460.534471107" watchObservedRunningTime="2026-07-07 19:15:11.376363091 +0000 UTC m=+1460.535702934"
Jul 07 19:15:14.577638 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:14.577590    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"]
Jul 07 19:15:14.578276 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:14.577860    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8" podUID="7c96a904-094c-4ff7-b7f8-351415a7a782" containerName="istio-proxy" containerID="cri-o://90ec4fc61aaf3e7cea05389a5cad5fe6e23cbba5766681fa10352e1adbf013cd" gracePeriod=30
Jul 07 19:15:14.729917 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:14.729882    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"]
Jul 07 19:15:14.730165 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:14.730133    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk" podUID="01dfa600-24c9-4885-b4ed-159fa4c82e13" containerName="maas-api" containerID="cri-o://31e8373b7571a7cf74e5c5fdcb8ebb7e032226f8f6830c1c6f360c3be670e19f" gracePeriod=30
Jul 07 19:15:15.018605 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.018583    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"
Jul 07 19:15:15.031929 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.031907    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr7pt\" (UniqueName: \"kubernetes.io/projected/01dfa600-24c9-4885-b4ed-159fa4c82e13-kube-api-access-jr7pt\") pod \"01dfa600-24c9-4885-b4ed-159fa4c82e13\" (UID: \"01dfa600-24c9-4885-b4ed-159fa4c82e13\") "
Jul 07 19:15:15.032012 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.031972    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01dfa600-24c9-4885-b4ed-159fa4c82e13-maas-api-tls\") pod \"01dfa600-24c9-4885-b4ed-159fa4c82e13\" (UID: \"01dfa600-24c9-4885-b4ed-159fa4c82e13\") "
Jul 07 19:15:15.032012 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.032005    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01dfa600-24c9-4885-b4ed-159fa4c82e13-openshift-service-ca\") pod \"01dfa600-24c9-4885-b4ed-159fa4c82e13\" (UID: \"01dfa600-24c9-4885-b4ed-159fa4c82e13\") "
Jul 07 19:15:15.032391 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.032364    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01dfa600-24c9-4885-b4ed-159fa4c82e13-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "01dfa600-24c9-4885-b4ed-159fa4c82e13" (UID: "01dfa600-24c9-4885-b4ed-159fa4c82e13"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:15:15.033866 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.033839    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01dfa600-24c9-4885-b4ed-159fa4c82e13-kube-api-access-jr7pt" (OuterVolumeSpecName: "kube-api-access-jr7pt") pod "01dfa600-24c9-4885-b4ed-159fa4c82e13" (UID: "01dfa600-24c9-4885-b4ed-159fa4c82e13"). InnerVolumeSpecName "kube-api-access-jr7pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:15:15.033959 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.033887    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01dfa600-24c9-4885-b4ed-159fa4c82e13-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "01dfa600-24c9-4885-b4ed-159fa4c82e13" (UID: "01dfa600-24c9-4885-b4ed-159fa4c82e13"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:15:15.133388 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.133300    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01dfa600-24c9-4885-b4ed-159fa4c82e13-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:15.133388 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.133334    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr7pt\" (UniqueName: \"kubernetes.io/projected/01dfa600-24c9-4885-b4ed-159fa4c82e13-kube-api-access-jr7pt\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:15.133388 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.133344    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01dfa600-24c9-4885-b4ed-159fa4c82e13-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:15.389247 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.389149    2554 generic.go:356] "Generic (PLEG): container finished" podID="01dfa600-24c9-4885-b4ed-159fa4c82e13" containerID="31e8373b7571a7cf74e5c5fdcb8ebb7e032226f8f6830c1c6f360c3be670e19f" exitCode=0
Jul 07 19:15:15.389247 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.389201    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"
Jul 07 19:15:15.389481 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.389238    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk" event={"ID":"01dfa600-24c9-4885-b4ed-159fa4c82e13","Type":"ContainerDied","Data":"31e8373b7571a7cf74e5c5fdcb8ebb7e032226f8f6830c1c6f360c3be670e19f"}
Jul 07 19:15:15.389481 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.389307    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk" event={"ID":"01dfa600-24c9-4885-b4ed-159fa4c82e13","Type":"ContainerDied","Data":"0404c75bbb2822005de8ea443e7400085b433e7e0d2032d7b7b042568c29fbb1"}
Jul 07 19:15:15.389481 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.389338    2554 scope.go:117] "RemoveContainer" containerID="31e8373b7571a7cf74e5c5fdcb8ebb7e032226f8f6830c1c6f360c3be670e19f"
Jul 07 19:15:15.399199 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.399184    2554 scope.go:117] "RemoveContainer" containerID="31e8373b7571a7cf74e5c5fdcb8ebb7e032226f8f6830c1c6f360c3be670e19f"
Jul 07 19:15:15.399458 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:15:15.399442    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31e8373b7571a7cf74e5c5fdcb8ebb7e032226f8f6830c1c6f360c3be670e19f\": container with ID starting with 31e8373b7571a7cf74e5c5fdcb8ebb7e032226f8f6830c1c6f360c3be670e19f not found: ID does not exist" containerID="31e8373b7571a7cf74e5c5fdcb8ebb7e032226f8f6830c1c6f360c3be670e19f"
Jul 07 19:15:15.399500 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.399467    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e8373b7571a7cf74e5c5fdcb8ebb7e032226f8f6830c1c6f360c3be670e19f"} err="failed to get container status \"31e8373b7571a7cf74e5c5fdcb8ebb7e032226f8f6830c1c6f360c3be670e19f\": rpc error: code = NotFound desc = could not find container \"31e8373b7571a7cf74e5c5fdcb8ebb7e032226f8f6830c1c6f360c3be670e19f\": container with ID starting with 31e8373b7571a7cf74e5c5fdcb8ebb7e032226f8f6830c1c6f360c3be670e19f not found: ID does not exist"
Jul 07 19:15:15.412057 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.412032    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"]
Jul 07 19:15:15.414066 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.414042    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-d8f67fb0-6484b5ddcb-dc6jk"]
Jul 07 19:15:15.479140 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:15.479102    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01dfa600-24c9-4885-b4ed-159fa4c82e13" path="/var/lib/kubelet/pods/01dfa600-24c9-4885-b4ed-159fa4c82e13/volumes"
Jul 07 19:15:19.415220 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.415194    2554 generic.go:356] "Generic (PLEG): container finished" podID="7c96a904-094c-4ff7-b7f8-351415a7a782" containerID="90ec4fc61aaf3e7cea05389a5cad5fe6e23cbba5766681fa10352e1adbf013cd" exitCode=0
Jul 07 19:15:19.415547 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.415276    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8" event={"ID":"7c96a904-094c-4ff7-b7f8-351415a7a782","Type":"ContainerDied","Data":"90ec4fc61aaf3e7cea05389a5cad5fe6e23cbba5766681fa10352e1adbf013cd"}
Jul 07 19:15:19.529278 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.529251    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:19.573578 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.573554    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-workload-certs\") pod \"7c96a904-094c-4ff7-b7f8-351415a7a782\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") "
Jul 07 19:15:19.573701 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.573594    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c96a904-094c-4ff7-b7f8-351415a7a782-istiod-ca-cert\") pod \"7c96a904-094c-4ff7-b7f8-351415a7a782\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") "
Jul 07 19:15:19.573701 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.573611    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s426z\" (UniqueName: \"kubernetes.io/projected/7c96a904-094c-4ff7-b7f8-351415a7a782-kube-api-access-s426z\") pod \"7c96a904-094c-4ff7-b7f8-351415a7a782\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") "
Jul 07 19:15:19.573701 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.573645    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-envoy\") pod \"7c96a904-094c-4ff7-b7f8-351415a7a782\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") "
Jul 07 19:15:19.573701 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.573665    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-podinfo\") pod \"7c96a904-094c-4ff7-b7f8-351415a7a782\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") "
Jul 07 19:15:19.573902 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.573725    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-workload-socket\") pod \"7c96a904-094c-4ff7-b7f8-351415a7a782\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") "
Jul 07 19:15:19.573902 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.573763    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-credential-socket\") pod \"7c96a904-094c-4ff7-b7f8-351415a7a782\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") "
Jul 07 19:15:19.573902 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.573793    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-data\") pod \"7c96a904-094c-4ff7-b7f8-351415a7a782\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") "
Jul 07 19:15:19.573902 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.573843    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-token\") pod \"7c96a904-094c-4ff7-b7f8-351415a7a782\" (UID: \"7c96a904-094c-4ff7-b7f8-351415a7a782\") "
Jul 07 19:15:19.574101 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.573926    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7c96a904-094c-4ff7-b7f8-351415a7a782" (UID: "7c96a904-094c-4ff7-b7f8-351415a7a782"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:19.574101 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.573952    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c96a904-094c-4ff7-b7f8-351415a7a782-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7c96a904-094c-4ff7-b7f8-351415a7a782" (UID: "7c96a904-094c-4ff7-b7f8-351415a7a782"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:15:19.574101 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.574063    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7c96a904-094c-4ff7-b7f8-351415a7a782" (UID: "7c96a904-094c-4ff7-b7f8-351415a7a782"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:19.574101 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.574027    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7c96a904-094c-4ff7-b7f8-351415a7a782" (UID: "7c96a904-094c-4ff7-b7f8-351415a7a782"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:19.574312 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.574225    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:19.574312 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.574246    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:19.574312 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.574260    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:19.574312 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.574273    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c96a904-094c-4ff7-b7f8-351415a7a782-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:19.574793 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.574772    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-data" (OuterVolumeSpecName: "istio-data") pod "7c96a904-094c-4ff7-b7f8-351415a7a782" (UID: "7c96a904-094c-4ff7-b7f8-351415a7a782"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:19.576310 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.576292    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-token" (OuterVolumeSpecName: "istio-token") pod "7c96a904-094c-4ff7-b7f8-351415a7a782" (UID: "7c96a904-094c-4ff7-b7f8-351415a7a782"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:15:19.576578 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.576558    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7c96a904-094c-4ff7-b7f8-351415a7a782" (UID: "7c96a904-094c-4ff7-b7f8-351415a7a782"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:19.576632 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.576569    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7c96a904-094c-4ff7-b7f8-351415a7a782" (UID: "7c96a904-094c-4ff7-b7f8-351415a7a782"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:15:19.576752 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.576733    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c96a904-094c-4ff7-b7f8-351415a7a782-kube-api-access-s426z" (OuterVolumeSpecName: "kube-api-access-s426z") pod "7c96a904-094c-4ff7-b7f8-351415a7a782" (UID: "7c96a904-094c-4ff7-b7f8-351415a7a782"). InnerVolumeSpecName "kube-api-access-s426z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:15:19.675058 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.674977    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:19.675058 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.675013    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:19.675058 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.675025    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:19.675058 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.675038    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c96a904-094c-4ff7-b7f8-351415a7a782-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:19.675058 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:19.675050    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s426z\" (UniqueName: \"kubernetes.io/projected/7c96a904-094c-4ff7-b7f8-351415a7a782-kube-api-access-s426z\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:20.420945 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:20.420916    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"
Jul 07 19:15:20.420945 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:20.420927    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8" event={"ID":"7c96a904-094c-4ff7-b7f8-351415a7a782","Type":"ContainerDied","Data":"7bc30606bdc2c37bdc8373ed63ec2bb9a80001b86369cc2e4dcb6ae8f06f0cd4"}
Jul 07 19:15:20.421430 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:20.420982    2554 scope.go:117] "RemoveContainer" containerID="90ec4fc61aaf3e7cea05389a5cad5fe6e23cbba5766681fa10352e1adbf013cd"
Jul 07 19:15:20.450559 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:20.450530    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"]
Jul 07 19:15:20.455047 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:20.455027    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d8f67fb0-openshift-default-78ffcf8b5c-gtzn8"]
Jul 07 19:15:20.981371 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:20.981342    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"]
Jul 07 19:15:20.981879 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:20.981815    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01dfa600-24c9-4885-b4ed-159fa4c82e13" containerName="maas-api"
Jul 07 19:15:20.981879 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:20.981836    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="01dfa600-24c9-4885-b4ed-159fa4c82e13" containerName="maas-api"
Jul 07 19:15:20.981879 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:20.981869    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c96a904-094c-4ff7-b7f8-351415a7a782" containerName="istio-proxy"
Jul 07 19:15:20.981879 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:20.981878    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c96a904-094c-4ff7-b7f8-351415a7a782" containerName="istio-proxy"
Jul 07 19:15:20.982217 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:20.981954    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c96a904-094c-4ff7-b7f8-351415a7a782" containerName="istio-proxy"
Jul 07 19:15:20.982217 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:20.981972    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="01dfa600-24c9-4885-b4ed-159fa4c82e13" containerName="maas-api"
Jul 07 19:15:20.984864 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:20.984841    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:20.988670 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:20.988644    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-db812da0-openshift-default-dockercfg-h4d57\""
Jul 07 19:15:21.000266 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.000244    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"]
Jul 07 19:15:21.088137 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.088107    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frpf7\" (UniqueName: \"kubernetes.io/projected/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-kube-api-access-frpf7\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.088282 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.088150    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istiod-ca-cert\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.088282 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.088176    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-workload-socket\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.088352 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.088296    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-token\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.088352 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.088328    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-credential-socket\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.088423 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.088351    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-workload-certs\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.088423 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.088416    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-envoy\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.088487 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.088443    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-podinfo\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.088487 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.088470    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-data\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.189898 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.189868    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-envoy\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.190055 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.189907    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-podinfo\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.190055 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.189942    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-data\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.190055 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.189973    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frpf7\" (UniqueName: \"kubernetes.io/projected/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-kube-api-access-frpf7\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.190055 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.190015    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istiod-ca-cert\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.190055 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.190043    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-workload-socket\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.190332 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.190132    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-token\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.190392 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.190342    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-credential-socket\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.190392 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.190377    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-workload-certs\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.190514 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.190374    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-data\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.190514 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.190437    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-workload-socket\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.190646 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.190619    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-credential-socket\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.190710 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.190655    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-workload-certs\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.190764 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.190740    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istiod-ca-cert\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.192160 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.192137    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-envoy\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.192358 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.192342    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-podinfo\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.201424 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.201403    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frpf7\" (UniqueName: \"kubernetes.io/projected/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-kube-api-access-frpf7\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.201758 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.201741    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-token\") pod \"e2e-ait-db812da0-openshift-default-54c4569555-8jnck\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") " pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.296200 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.296132    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:21.437752 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.437722    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"]
Jul 07 19:15:21.441089 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:15:21.441064    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2162ef8d_ed9f_48f2_b32e_e77b16e94a9f.slice/crio-d1c0d242dc982730a5f92df8179a3c842fab2a57806bb5eeb47fe6628c843e50 WatchSource:0}: Error finding container d1c0d242dc982730a5f92df8179a3c842fab2a57806bb5eeb47fe6628c843e50: Status 404 returned error can't find the container with id d1c0d242dc982730a5f92df8179a3c842fab2a57806bb5eeb47fe6628c843e50
Jul 07 19:15:21.443104 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.443075    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:15:21.443158 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.443138    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:15:21.443204 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.443164    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:15:21.475183 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:21.475160    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c96a904-094c-4ff7-b7f8-351415a7a782" path="/var/lib/kubelet/pods/7c96a904-094c-4ff7-b7f8-351415a7a782/volumes"
Jul 07 19:15:22.243589 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.243553    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"]
Jul 07 19:15:22.247873 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.247847    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:22.250644 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.250620    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-db812da0-serving-cert\""
Jul 07 19:15:22.259332 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.259312    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"]
Jul 07 19:15:22.301777 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.301751    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a3276a-437a-4e00-92ae-864e4f116942-openshift-service-ca\") pod \"maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n\" (UID: \"04a3276a-437a-4e00-92ae-864e4f116942\") " pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:22.301909 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.301791    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4lxj\" (UniqueName: \"kubernetes.io/projected/04a3276a-437a-4e00-92ae-864e4f116942-kube-api-access-c4lxj\") pod \"maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n\" (UID: \"04a3276a-437a-4e00-92ae-864e4f116942\") " pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:22.301909 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.301898    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04a3276a-437a-4e00-92ae-864e4f116942-maas-api-tls\") pod \"maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n\" (UID: \"04a3276a-437a-4e00-92ae-864e4f116942\") " pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:22.402463 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.402430    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04a3276a-437a-4e00-92ae-864e4f116942-maas-api-tls\") pod \"maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n\" (UID: \"04a3276a-437a-4e00-92ae-864e4f116942\") " pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:22.402649 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.402490    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a3276a-437a-4e00-92ae-864e4f116942-openshift-service-ca\") pod \"maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n\" (UID: \"04a3276a-437a-4e00-92ae-864e4f116942\") " pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:22.402649 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.402518    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4lxj\" (UniqueName: \"kubernetes.io/projected/04a3276a-437a-4e00-92ae-864e4f116942-kube-api-access-c4lxj\") pod \"maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n\" (UID: \"04a3276a-437a-4e00-92ae-864e4f116942\") " pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:22.402649 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:15:22.402593    2554 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-db812da0-serving-cert: secret "maas-api-e2e-ait-db812da0-serving-cert" not found
Jul 07 19:15:22.402857 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:15:22.402684    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04a3276a-437a-4e00-92ae-864e4f116942-maas-api-tls podName:04a3276a-437a-4e00-92ae-864e4f116942 nodeName:}" failed. No retries permitted until 2026-07-07 19:15:22.902661782 +0000 UTC m=+1472.062001606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/04a3276a-437a-4e00-92ae-864e4f116942-maas-api-tls") pod "maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n" (UID: "04a3276a-437a-4e00-92ae-864e4f116942") : secret "maas-api-e2e-ait-db812da0-serving-cert" not found
Jul 07 19:15:22.403167 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.403149    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a3276a-437a-4e00-92ae-864e4f116942-openshift-service-ca\") pod \"maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n\" (UID: \"04a3276a-437a-4e00-92ae-864e4f116942\") " pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:22.414377 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.414348    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4lxj\" (UniqueName: \"kubernetes.io/projected/04a3276a-437a-4e00-92ae-864e4f116942-kube-api-access-c4lxj\") pod \"maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n\" (UID: \"04a3276a-437a-4e00-92ae-864e4f116942\") " pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:22.433828 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.433789    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck" event={"ID":"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f","Type":"ContainerStarted","Data":"0605dd95c18a186d5e550fecf4d5eb950edfa3cd1a47be45ecbad97b39cdb19a"}
Jul 07 19:15:22.433938 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.433854    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck" event={"ID":"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f","Type":"ContainerStarted","Data":"d1c0d242dc982730a5f92df8179a3c842fab2a57806bb5eeb47fe6628c843e50"}
Jul 07 19:15:22.470310 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.470272    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck" podStartSLOduration=2.470260141 podStartE2EDuration="2.470260141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:22.467779177 +0000 UTC m=+1471.627119002" watchObservedRunningTime="2026-07-07 19:15:22.470260141 +0000 UTC m=+1471.629599966"
Jul 07 19:15:22.906857 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.906820    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04a3276a-437a-4e00-92ae-864e4f116942-maas-api-tls\") pod \"maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n\" (UID: \"04a3276a-437a-4e00-92ae-864e4f116942\") " pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:22.909285 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:22.909262    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04a3276a-437a-4e00-92ae-864e4f116942-maas-api-tls\") pod \"maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n\" (UID: \"04a3276a-437a-4e00-92ae-864e4f116942\") " pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:23.162198 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:23.162106    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:23.297129 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:23.297087    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:23.302625 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:23.302597    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:23.334303 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:23.334279    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"]
Jul 07 19:15:23.336960 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:15:23.336931    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a3276a_437a_4e00_92ae_864e4f116942.slice/crio-e1fabca0d661f520c79fe22de94e354cc3a766816865ad7d3ea3456b2dce5102 WatchSource:0}: Error finding container e1fabca0d661f520c79fe22de94e354cc3a766816865ad7d3ea3456b2dce5102: Status 404 returned error can't find the container with id e1fabca0d661f520c79fe22de94e354cc3a766816865ad7d3ea3456b2dce5102
Jul 07 19:15:23.440431 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:23.440339    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n" event={"ID":"04a3276a-437a-4e00-92ae-864e4f116942","Type":"ContainerStarted","Data":"e1fabca0d661f520c79fe22de94e354cc3a766816865ad7d3ea3456b2dce5102"}
Jul 07 19:15:23.440576 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:23.440545    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:23.441427 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:23.441407    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:24.446384 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:24.446296    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n" event={"ID":"04a3276a-437a-4e00-92ae-864e4f116942","Type":"ContainerStarted","Data":"b8ca45abb1996e223c4ffb4db760eaaebcb6dd3a586d3279fb0d5f9e47cf872f"}
Jul 07 19:15:24.471355 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:24.471302    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n" podStartSLOduration=2.012749781 podStartE2EDuration="2.471285533s" totalImagesPullingTime="458.535752ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:24.46818277 +0000 UTC m=+1473.627522596" watchObservedRunningTime="2026-07-07 19:15:24.471285533 +0000 UTC m=+1473.630625359"
Jul 07 19:15:25.451579 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:25.451547    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:27.521607 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:27.521574    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"]
Jul 07 19:15:27.522034 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:27.521768    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n" podUID="04a3276a-437a-4e00-92ae-864e4f116942" containerName="maas-api" containerID="cri-o://b8ca45abb1996e223c4ffb4db760eaaebcb6dd3a586d3279fb0d5f9e47cf872f" gracePeriod=30
Jul 07 19:15:27.782090 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:27.782027    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:27.855459 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:27.855433    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04a3276a-437a-4e00-92ae-864e4f116942-maas-api-tls\") pod \"04a3276a-437a-4e00-92ae-864e4f116942\" (UID: \"04a3276a-437a-4e00-92ae-864e4f116942\") "
Jul 07 19:15:27.855611 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:27.855543    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4lxj\" (UniqueName: \"kubernetes.io/projected/04a3276a-437a-4e00-92ae-864e4f116942-kube-api-access-c4lxj\") pod \"04a3276a-437a-4e00-92ae-864e4f116942\" (UID: \"04a3276a-437a-4e00-92ae-864e4f116942\") "
Jul 07 19:15:27.855611 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:27.855563    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a3276a-437a-4e00-92ae-864e4f116942-openshift-service-ca\") pod \"04a3276a-437a-4e00-92ae-864e4f116942\" (UID: \"04a3276a-437a-4e00-92ae-864e4f116942\") "
Jul 07 19:15:27.855998 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:27.855974    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04a3276a-437a-4e00-92ae-864e4f116942-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "04a3276a-437a-4e00-92ae-864e4f116942" (UID: "04a3276a-437a-4e00-92ae-864e4f116942"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:15:27.857507 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:27.857474    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04a3276a-437a-4e00-92ae-864e4f116942-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "04a3276a-437a-4e00-92ae-864e4f116942" (UID: "04a3276a-437a-4e00-92ae-864e4f116942"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:15:27.857591 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:27.857567    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a3276a-437a-4e00-92ae-864e4f116942-kube-api-access-c4lxj" (OuterVolumeSpecName: "kube-api-access-c4lxj") pod "04a3276a-437a-4e00-92ae-864e4f116942" (UID: "04a3276a-437a-4e00-92ae-864e4f116942"). InnerVolumeSpecName "kube-api-access-c4lxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:15:27.956400 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:27.956373    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04a3276a-437a-4e00-92ae-864e4f116942-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:27.956400 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:27.956398    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4lxj\" (UniqueName: \"kubernetes.io/projected/04a3276a-437a-4e00-92ae-864e4f116942-kube-api-access-c4lxj\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:27.956584 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:27.956409    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a3276a-437a-4e00-92ae-864e4f116942-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:28.471571 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:28.471526    2554 generic.go:356] "Generic (PLEG): container finished" podID="04a3276a-437a-4e00-92ae-864e4f116942" containerID="b8ca45abb1996e223c4ffb4db760eaaebcb6dd3a586d3279fb0d5f9e47cf872f" exitCode=0
Jul 07 19:15:28.471792 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:28.471677    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n" event={"ID":"04a3276a-437a-4e00-92ae-864e4f116942","Type":"ContainerDied","Data":"b8ca45abb1996e223c4ffb4db760eaaebcb6dd3a586d3279fb0d5f9e47cf872f"}
Jul 07 19:15:28.471792 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:28.471733    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n" event={"ID":"04a3276a-437a-4e00-92ae-864e4f116942","Type":"ContainerDied","Data":"e1fabca0d661f520c79fe22de94e354cc3a766816865ad7d3ea3456b2dce5102"}
Jul 07 19:15:28.471792 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:28.471763    2554 scope.go:117] "RemoveContainer" containerID="b8ca45abb1996e223c4ffb4db760eaaebcb6dd3a586d3279fb0d5f9e47cf872f"
Jul 07 19:15:28.471989 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:28.471935    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"
Jul 07 19:15:28.493844 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:28.493815    2554 scope.go:117] "RemoveContainer" containerID="b8ca45abb1996e223c4ffb4db760eaaebcb6dd3a586d3279fb0d5f9e47cf872f"
Jul 07 19:15:28.494197 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:15:28.494173    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8ca45abb1996e223c4ffb4db760eaaebcb6dd3a586d3279fb0d5f9e47cf872f\": container with ID starting with b8ca45abb1996e223c4ffb4db760eaaebcb6dd3a586d3279fb0d5f9e47cf872f not found: ID does not exist" containerID="b8ca45abb1996e223c4ffb4db760eaaebcb6dd3a586d3279fb0d5f9e47cf872f"
Jul 07 19:15:28.494314 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:28.494205    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8ca45abb1996e223c4ffb4db760eaaebcb6dd3a586d3279fb0d5f9e47cf872f"} err="failed to get container status \"b8ca45abb1996e223c4ffb4db760eaaebcb6dd3a586d3279fb0d5f9e47cf872f\": rpc error: code = NotFound desc = could not find container \"b8ca45abb1996e223c4ffb4db760eaaebcb6dd3a586d3279fb0d5f9e47cf872f\": container with ID starting with b8ca45abb1996e223c4ffb4db760eaaebcb6dd3a586d3279fb0d5f9e47cf872f not found: ID does not exist"
Jul 07 19:15:28.508565 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:28.508539    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"]
Jul 07 19:15:28.512649 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:28.512629    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-db812da0-75bbfb5dd7-4rj4n"]
Jul 07 19:15:29.483438 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:29.483397    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04a3276a-437a-4e00-92ae-864e4f116942" path="/var/lib/kubelet/pods/04a3276a-437a-4e00-92ae-864e4f116942/volumes"
Jul 07 19:15:33.339148 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:33.339106    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"]
Jul 07 19:15:33.339654 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:33.339326    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck" podUID="2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" containerName="istio-proxy" containerID="cri-o://0605dd95c18a186d5e550fecf4d5eb950edfa3cd1a47be45ecbad97b39cdb19a" gracePeriod=30
Jul 07 19:15:35.221096 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:15:35.221068    2554 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2162ef8d_ed9f_48f2_b32e_e77b16e94a9f.slice/crio-conmon-0605dd95c18a186d5e550fecf4d5eb950edfa3cd1a47be45ecbad97b39cdb19a.scope\": RecentStats: unable to find data in memory cache]"
Jul 07 19:15:35.399189 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.399165    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:35.515180 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.515131    2554 generic.go:356] "Generic (PLEG): container finished" podID="2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" containerID="0605dd95c18a186d5e550fecf4d5eb950edfa3cd1a47be45ecbad97b39cdb19a" exitCode=0
Jul 07 19:15:35.515333 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.515183    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"
Jul 07 19:15:35.515333 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.515219    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck" event={"ID":"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f","Type":"ContainerDied","Data":"0605dd95c18a186d5e550fecf4d5eb950edfa3cd1a47be45ecbad97b39cdb19a"}
Jul 07 19:15:35.515333 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.515281    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck" event={"ID":"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f","Type":"ContainerDied","Data":"d1c0d242dc982730a5f92df8179a3c842fab2a57806bb5eeb47fe6628c843e50"}
Jul 07 19:15:35.515333 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.515314    2554 scope.go:117] "RemoveContainer" containerID="0605dd95c18a186d5e550fecf4d5eb950edfa3cd1a47be45ecbad97b39cdb19a"
Jul 07 19:15:35.523917 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.523902    2554 scope.go:117] "RemoveContainer" containerID="0605dd95c18a186d5e550fecf4d5eb950edfa3cd1a47be45ecbad97b39cdb19a"
Jul 07 19:15:35.524163 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:15:35.524145    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0605dd95c18a186d5e550fecf4d5eb950edfa3cd1a47be45ecbad97b39cdb19a\": container with ID starting with 0605dd95c18a186d5e550fecf4d5eb950edfa3cd1a47be45ecbad97b39cdb19a not found: ID does not exist" containerID="0605dd95c18a186d5e550fecf4d5eb950edfa3cd1a47be45ecbad97b39cdb19a"
Jul 07 19:15:35.524220 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.524172    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0605dd95c18a186d5e550fecf4d5eb950edfa3cd1a47be45ecbad97b39cdb19a"} err="failed to get container status \"0605dd95c18a186d5e550fecf4d5eb950edfa3cd1a47be45ecbad97b39cdb19a\": rpc error: code = NotFound desc = could not find container \"0605dd95c18a186d5e550fecf4d5eb950edfa3cd1a47be45ecbad97b39cdb19a\": container with ID starting with 0605dd95c18a186d5e550fecf4d5eb950edfa3cd1a47be45ecbad97b39cdb19a not found: ID does not exist"
Jul 07 19:15:35.534988 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.534970    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frpf7\" (UniqueName: \"kubernetes.io/projected/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-kube-api-access-frpf7\") pod \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") "
Jul 07 19:15:35.535081 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535018    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-workload-certs\") pod \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") "
Jul 07 19:15:35.535081 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535073    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-token\") pod \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") "
Jul 07 19:15:35.535165 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535090    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-podinfo\") pod \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") "
Jul 07 19:15:35.535165 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535136    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-credential-socket\") pod \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") "
Jul 07 19:15:35.535286 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535265    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-envoy\") pod \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") "
Jul 07 19:15:35.535342 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535328    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-data\") pod \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") "
Jul 07 19:15:35.535397 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535364    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-workload-socket\") pod \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") "
Jul 07 19:15:35.535397 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535378    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" (UID: "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:35.535397 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535392    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istiod-ca-cert\") pod \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\" (UID: \"2162ef8d-ed9f-48f2-b32e-e77b16e94a9f\") "
Jul 07 19:15:35.535677 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535392    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" (UID: "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:35.535764 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535561    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" (UID: "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:35.535842 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535773    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:35.535842 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535792    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:35.535842 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535824    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:35.536010 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.535844    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" (UID: "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:15:35.536072 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.536049    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-data" (OuterVolumeSpecName: "istio-data") pod "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" (UID: "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:35.537202 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.537174    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-kube-api-access-frpf7" (OuterVolumeSpecName: "kube-api-access-frpf7") pod "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" (UID: "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f"). InnerVolumeSpecName "kube-api-access-frpf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:15:35.537281 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.537222    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-token" (OuterVolumeSpecName: "istio-token") pod "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" (UID: "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:15:35.537517 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.537499    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" (UID: "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:15:35.537764 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.537740    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" (UID: "2162ef8d-ed9f-48f2-b32e-e77b16e94a9f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:35.636365 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.636335    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:35.636365 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.636358    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:35.636365 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.636366    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:35.636536 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.636375    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frpf7\" (UniqueName: \"kubernetes.io/projected/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-kube-api-access-frpf7\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:35.636536 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.636385    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:35.636536 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.636393    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:35.838179 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.838152    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"]
Jul 07 19:15:35.842478 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:35.842456    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-db812da0-openshift-default-54c4569555-8jnck"]
Jul 07 19:15:37.475067 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:37.475034    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" path="/var/lib/kubelet/pods/2162ef8d-ed9f-48f2-b32e-e77b16e94a9f/volumes"
Jul 07 19:15:39.780187 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.780128    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"]
Jul 07 19:15:39.780778 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.780756    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a3276a-437a-4e00-92ae-864e4f116942" containerName="maas-api"
Jul 07 19:15:39.780866 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.780782    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a3276a-437a-4e00-92ae-864e4f116942" containerName="maas-api"
Jul 07 19:15:39.780866 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.780819    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" containerName="istio-proxy"
Jul 07 19:15:39.780866 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.780829    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" containerName="istio-proxy"
Jul 07 19:15:39.781020 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.780950    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a3276a-437a-4e00-92ae-864e4f116942" containerName="maas-api"
Jul 07 19:15:39.781020 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.780966    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2162ef8d-ed9f-48f2-b32e-e77b16e94a9f" containerName="istio-proxy"
Jul 07 19:15:39.785731 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.785711    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.788410 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.788387    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a0e7be54-openshift-default-dockercfg-v8jth\""
Jul 07 19:15:39.795293 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.795270    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"]
Jul 07 19:15:39.870651 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.870618    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-envoy\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.870651 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.870655    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-podinfo\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.870869 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.870678    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwbw4\" (UniqueName: \"kubernetes.io/projected/4e59871c-10d9-4862-bf5a-416ee05580ef-kube-api-access-mwbw4\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.870869 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.870750    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-credential-socket\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.870869 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.870818    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-token\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.870971 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.870870    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-workload-socket\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.870971 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.870903    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-data\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.870971 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.870927    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-workload-certs\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.870971 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.870946    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e59871c-10d9-4862-bf5a-416ee05580ef-istiod-ca-cert\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.971691 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.971648    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-credential-socket\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.971908 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.971710    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-token\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.971908 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.971749    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-workload-socket\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.971908 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.971772    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-data\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.971908 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.971793    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-workload-certs\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.971908 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.971844    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e59871c-10d9-4862-bf5a-416ee05580ef-istiod-ca-cert\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.971908 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.971889    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-envoy\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.971908 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.971907    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-podinfo\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.972317 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.971950    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwbw4\" (UniqueName: \"kubernetes.io/projected/4e59871c-10d9-4862-bf5a-416ee05580ef-kube-api-access-mwbw4\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.972317 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.972208    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-credential-socket\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.972317 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.972240    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-workload-socket\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.972317 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.972254    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-workload-certs\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.972488 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.972364    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-data\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.972819 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.972777    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e59871c-10d9-4862-bf5a-416ee05580ef-istiod-ca-cert\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.974133 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.974114    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-envoy\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.974536 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.974513    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-podinfo\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.981002 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.980982    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-token\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:39.981219 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:39.981201    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwbw4\" (UniqueName: \"kubernetes.io/projected/4e59871c-10d9-4862-bf5a-416ee05580ef-kube-api-access-mwbw4\") pod \"e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") " pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:40.098767 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:40.098688    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:40.237131 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:40.237099    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"]
Jul 07 19:15:40.240126 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:15:40.240098    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e59871c_10d9_4862_bf5a_416ee05580ef.slice/crio-e16deb78ad8499d7543a02116e99d965d5e93a46b593deb72a3bf48748a48d2f WatchSource:0}: Error finding container e16deb78ad8499d7543a02116e99d965d5e93a46b593deb72a3bf48748a48d2f: Status 404 returned error can't find the container with id e16deb78ad8499d7543a02116e99d965d5e93a46b593deb72a3bf48748a48d2f
Jul 07 19:15:40.242284 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:40.242246    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:15:40.242391 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:40.242313    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:15:40.242391 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:40.242343    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:15:40.540903 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:40.540863    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr" event={"ID":"4e59871c-10d9-4862-bf5a-416ee05580ef","Type":"ContainerStarted","Data":"7de7911b61077e641d3f8c7c401d21ad8f1470e93df3b1d597bba578415efdb3"}
Jul 07 19:15:40.541078 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:40.540924    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr" event={"ID":"4e59871c-10d9-4862-bf5a-416ee05580ef","Type":"ContainerStarted","Data":"e16deb78ad8499d7543a02116e99d965d5e93a46b593deb72a3bf48748a48d2f"}
Jul 07 19:15:40.569396 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:40.569344    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr" podStartSLOduration=1.569327774 podStartE2EDuration="1.569327774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:40.566869268 +0000 UTC m=+1489.726209120" watchObservedRunningTime="2026-07-07 19:15:40.569327774 +0000 UTC m=+1489.728667601"
Jul 07 19:15:41.032937 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.032905    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"]
Jul 07 19:15:41.036484 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.036462    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"
Jul 07 19:15:41.039618 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.039596    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-a0e7be54-serving-cert\""
Jul 07 19:15:41.049651 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.049631    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"]
Jul 07 19:15:41.099155 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.099131    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:41.103983 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.103959    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:41.181856 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.181788    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-maas-api-tls\") pod \"maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5\" (UID: \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\") " pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"
Jul 07 19:15:41.182056 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.181914    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-openshift-service-ca\") pod \"maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5\" (UID: \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\") " pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"
Jul 07 19:15:41.182056 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.181954    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g5fl\" (UniqueName: \"kubernetes.io/projected/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-kube-api-access-6g5fl\") pod \"maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5\" (UID: \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\") " pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"
Jul 07 19:15:41.282603 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.282573    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-maas-api-tls\") pod \"maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5\" (UID: \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\") " pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"
Jul 07 19:15:41.282766 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.282628    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-openshift-service-ca\") pod \"maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5\" (UID: \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\") " pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"
Jul 07 19:15:41.282766 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.282659    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5fl\" (UniqueName: \"kubernetes.io/projected/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-kube-api-access-6g5fl\") pod \"maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5\" (UID: \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\") " pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"
Jul 07 19:15:41.283399 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.283353    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-openshift-service-ca\") pod \"maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5\" (UID: \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\") " pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"
Jul 07 19:15:41.285134 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.285114    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-maas-api-tls\") pod \"maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5\" (UID: \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\") " pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"
Jul 07 19:15:41.292879 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.292857    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g5fl\" (UniqueName: \"kubernetes.io/projected/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-kube-api-access-6g5fl\") pod \"maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5\" (UID: \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\") " pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"
Jul 07 19:15:41.348409 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.348380    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"
Jul 07 19:15:41.485176 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.485153    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"]
Jul 07 19:15:41.487169 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:15:41.487146    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b23a3ae_c920_4a05_b84a_ee95e2092f3f.slice/crio-539a305903a685abec8b07930928ef5ae6625e353750def4606f137e76f8cc6a WatchSource:0}: Error finding container 539a305903a685abec8b07930928ef5ae6625e353750def4606f137e76f8cc6a: Status 404 returned error can't find the container with id 539a305903a685abec8b07930928ef5ae6625e353750def4606f137e76f8cc6a
Jul 07 19:15:41.546628 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.546557    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5" event={"ID":"8b23a3ae-c920-4a05-b84a-ee95e2092f3f","Type":"ContainerStarted","Data":"539a305903a685abec8b07930928ef5ae6625e353750def4606f137e76f8cc6a"}
Jul 07 19:15:41.547336 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.547303    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:41.548285 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:41.548261    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:42.553992 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:42.553957    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5" event={"ID":"8b23a3ae-c920-4a05-b84a-ee95e2092f3f","Type":"ContainerStarted","Data":"99850df88bff6afccb8f3576339eae830300af3354bd59a5551598aee51b0a0e"}
Jul 07 19:15:42.572770 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:42.572721    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5" podStartSLOduration=1.203758016 podStartE2EDuration="1.572705909s" totalImagesPullingTime="368.947893ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:42.569864538 +0000 UTC m=+1491.729204381" watchObservedRunningTime="2026-07-07 19:15:42.572705909 +0000 UTC m=+1491.732045760"
Jul 07 19:15:43.558329 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:43.558303    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"
Jul 07 19:15:45.504880 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:45.504849    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"]
Jul 07 19:15:45.505290 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:45.505057    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr" podUID="4e59871c-10d9-4862-bf5a-416ee05580ef" containerName="istio-proxy" containerID="cri-o://7de7911b61077e641d3f8c7c401d21ad8f1470e93df3b1d597bba578415efdb3" gracePeriod=30
Jul 07 19:15:45.689594 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:45.689555    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"]
Jul 07 19:15:45.697129 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:45.697080    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5" podUID="8b23a3ae-c920-4a05-b84a-ee95e2092f3f" containerName="maas-api" containerID="cri-o://99850df88bff6afccb8f3576339eae830300af3354bd59a5551598aee51b0a0e" gracePeriod=30
Jul 07 19:15:45.979826 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:45.978003    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"
Jul 07 19:15:46.129072 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.128979    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-maas-api-tls\") pod \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\" (UID: \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\") "
Jul 07 19:15:46.129072 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.129068    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g5fl\" (UniqueName: \"kubernetes.io/projected/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-kube-api-access-6g5fl\") pod \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\" (UID: \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\") "
Jul 07 19:15:46.129313 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.129227    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-openshift-service-ca\") pod \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\" (UID: \"8b23a3ae-c920-4a05-b84a-ee95e2092f3f\") "
Jul 07 19:15:46.129532 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.129510    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8b23a3ae-c920-4a05-b84a-ee95e2092f3f" (UID: "8b23a3ae-c920-4a05-b84a-ee95e2092f3f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:15:46.131223 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.131189    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8b23a3ae-c920-4a05-b84a-ee95e2092f3f" (UID: "8b23a3ae-c920-4a05-b84a-ee95e2092f3f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:15:46.131223 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.131201    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-kube-api-access-6g5fl" (OuterVolumeSpecName: "kube-api-access-6g5fl") pod "8b23a3ae-c920-4a05-b84a-ee95e2092f3f" (UID: "8b23a3ae-c920-4a05-b84a-ee95e2092f3f"). InnerVolumeSpecName "kube-api-access-6g5fl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:15:46.230602 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.230567    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g5fl\" (UniqueName: \"kubernetes.io/projected/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-kube-api-access-6g5fl\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:46.230602 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.230594    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:46.230602 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.230605    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b23a3ae-c920-4a05-b84a-ee95e2092f3f-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:46.594536 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.594493    2554 generic.go:356] "Generic (PLEG): container finished" podID="8b23a3ae-c920-4a05-b84a-ee95e2092f3f" containerID="99850df88bff6afccb8f3576339eae830300af3354bd59a5551598aee51b0a0e" exitCode=0
Jul 07 19:15:46.595116 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.594545    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"
Jul 07 19:15:46.595246 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.594547    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5" event={"ID":"8b23a3ae-c920-4a05-b84a-ee95e2092f3f","Type":"ContainerDied","Data":"99850df88bff6afccb8f3576339eae830300af3354bd59a5551598aee51b0a0e"}
Jul 07 19:15:46.595290 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.595273    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5" event={"ID":"8b23a3ae-c920-4a05-b84a-ee95e2092f3f","Type":"ContainerDied","Data":"539a305903a685abec8b07930928ef5ae6625e353750def4606f137e76f8cc6a"}
Jul 07 19:15:46.595326 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.595304    2554 scope.go:117] "RemoveContainer" containerID="99850df88bff6afccb8f3576339eae830300af3354bd59a5551598aee51b0a0e"
Jul 07 19:15:46.604688 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.604670    2554 scope.go:117] "RemoveContainer" containerID="99850df88bff6afccb8f3576339eae830300af3354bd59a5551598aee51b0a0e"
Jul 07 19:15:46.604939 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:15:46.604921    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99850df88bff6afccb8f3576339eae830300af3354bd59a5551598aee51b0a0e\": container with ID starting with 99850df88bff6afccb8f3576339eae830300af3354bd59a5551598aee51b0a0e not found: ID does not exist" containerID="99850df88bff6afccb8f3576339eae830300af3354bd59a5551598aee51b0a0e"
Jul 07 19:15:46.604993 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.604947    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99850df88bff6afccb8f3576339eae830300af3354bd59a5551598aee51b0a0e"} err="failed to get container status \"99850df88bff6afccb8f3576339eae830300af3354bd59a5551598aee51b0a0e\": rpc error: code = NotFound desc = could not find container \"99850df88bff6afccb8f3576339eae830300af3354bd59a5551598aee51b0a0e\": container with ID starting with 99850df88bff6afccb8f3576339eae830300af3354bd59a5551598aee51b0a0e not found: ID does not exist"
Jul 07 19:15:46.617390 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.617369    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"]
Jul 07 19:15:46.621414 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:46.621393    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-a0e7be54-7f888b44c-b9pd5"]
Jul 07 19:15:47.478820 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:47.478413    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b23a3ae-c920-4a05-b84a-ee95e2092f3f" path="/var/lib/kubelet/pods/8b23a3ae-c920-4a05-b84a-ee95e2092f3f/volumes"
Jul 07 19:15:50.620028 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.619993    2554 generic.go:356] "Generic (PLEG): container finished" podID="4e59871c-10d9-4862-bf5a-416ee05580ef" containerID="7de7911b61077e641d3f8c7c401d21ad8f1470e93df3b1d597bba578415efdb3" exitCode=0
Jul 07 19:15:50.620568 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.620039    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr" event={"ID":"4e59871c-10d9-4862-bf5a-416ee05580ef","Type":"ContainerDied","Data":"7de7911b61077e641d3f8c7c401d21ad8f1470e93df3b1d597bba578415efdb3"}
Jul 07 19:15:50.761957 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.761925    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:50.771473 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.771418    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-podinfo\") pod \"4e59871c-10d9-4862-bf5a-416ee05580ef\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") "
Jul 07 19:15:50.771473 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.771449    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-workload-certs\") pod \"4e59871c-10d9-4862-bf5a-416ee05580ef\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") "
Jul 07 19:15:50.771639 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.771475    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-credential-socket\") pod \"4e59871c-10d9-4862-bf5a-416ee05580ef\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") "
Jul 07 19:15:50.771639 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.771507    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-data\") pod \"4e59871c-10d9-4862-bf5a-416ee05580ef\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") "
Jul 07 19:15:50.771639 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.771533    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-token\") pod \"4e59871c-10d9-4862-bf5a-416ee05580ef\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") "
Jul 07 19:15:50.771639 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.771636    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-workload-socket\") pod \"4e59871c-10d9-4862-bf5a-416ee05580ef\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") "
Jul 07 19:15:50.771893 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.771670    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwbw4\" (UniqueName: \"kubernetes.io/projected/4e59871c-10d9-4862-bf5a-416ee05580ef-kube-api-access-mwbw4\") pod \"4e59871c-10d9-4862-bf5a-416ee05580ef\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") "
Jul 07 19:15:50.771893 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.771699    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e59871c-10d9-4862-bf5a-416ee05580ef-istiod-ca-cert\") pod \"4e59871c-10d9-4862-bf5a-416ee05580ef\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") "
Jul 07 19:15:50.771893 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.771747    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-envoy\") pod \"4e59871c-10d9-4862-bf5a-416ee05580ef\" (UID: \"4e59871c-10d9-4862-bf5a-416ee05580ef\") "
Jul 07 19:15:50.771893 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.771790    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4e59871c-10d9-4862-bf5a-416ee05580ef" (UID: "4e59871c-10d9-4862-bf5a-416ee05580ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:50.771893 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.771808    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4e59871c-10d9-4862-bf5a-416ee05580ef" (UID: "4e59871c-10d9-4862-bf5a-416ee05580ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:50.772152 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.771993    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4e59871c-10d9-4862-bf5a-416ee05580ef" (UID: "4e59871c-10d9-4862-bf5a-416ee05580ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:50.772152 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.772080    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:50.772152 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.772098    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:50.772152 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.772110    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e59871c-10d9-4862-bf5a-416ee05580ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4e59871c-10d9-4862-bf5a-416ee05580ef" (UID: "4e59871c-10d9-4862-bf5a-416ee05580ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:15:50.772152 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.772114    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:50.772750 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.772727    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "4e59871c-10d9-4862-bf5a-416ee05580ef" (UID: "4e59871c-10d9-4862-bf5a-416ee05580ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:50.774155 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.774118    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4e59871c-10d9-4862-bf5a-416ee05580ef" (UID: "4e59871c-10d9-4862-bf5a-416ee05580ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:15:50.774264 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.774217    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "4e59871c-10d9-4862-bf5a-416ee05580ef" (UID: "4e59871c-10d9-4862-bf5a-416ee05580ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:15:50.774264 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.774230    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4e59871c-10d9-4862-bf5a-416ee05580ef" (UID: "4e59871c-10d9-4862-bf5a-416ee05580ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:15:50.774604 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.774575    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e59871c-10d9-4862-bf5a-416ee05580ef-kube-api-access-mwbw4" (OuterVolumeSpecName: "kube-api-access-mwbw4") pod "4e59871c-10d9-4862-bf5a-416ee05580ef" (UID: "4e59871c-10d9-4862-bf5a-416ee05580ef"). InnerVolumeSpecName "kube-api-access-mwbw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:15:50.872728 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.872697    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwbw4\" (UniqueName: \"kubernetes.io/projected/4e59871c-10d9-4862-bf5a-416ee05580ef-kube-api-access-mwbw4\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:50.872728 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.872724    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e59871c-10d9-4862-bf5a-416ee05580ef-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:50.872728 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.872733    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:50.872993 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.872741    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:50.872993 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.872751    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:50.872993 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:50.872759    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e59871c-10d9-4862-bf5a-416ee05580ef-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:15:51.365480 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:51.365449    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 19:15:51.368618 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:51.368596    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 19:15:51.626313 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:51.626249    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"
Jul 07 19:15:51.626744 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:51.626248    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr" event={"ID":"4e59871c-10d9-4862-bf5a-416ee05580ef","Type":"ContainerDied","Data":"e16deb78ad8499d7543a02116e99d965d5e93a46b593deb72a3bf48748a48d2f"}
Jul 07 19:15:51.626744 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:51.626394    2554 scope.go:117] "RemoveContainer" containerID="7de7911b61077e641d3f8c7c401d21ad8f1470e93df3b1d597bba578415efdb3"
Jul 07 19:15:51.649398 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:51.649373    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"]
Jul 07 19:15:51.651372 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:51.651347    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a0e7be54-openshift-default-74bfc757cf-ppzxr"]
Jul 07 19:15:53.474506 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:15:53.474474    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e59871c-10d9-4862-bf5a-416ee05580ef" path="/var/lib/kubelet/pods/4e59871c-10d9-4862-bf5a-416ee05580ef/volumes"
Jul 07 19:17:30.316273 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.316238    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"]
Jul 07 19:17:30.316954 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.316645    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b23a3ae-c920-4a05-b84a-ee95e2092f3f" containerName="maas-api"
Jul 07 19:17:30.316954 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.316657    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b23a3ae-c920-4a05-b84a-ee95e2092f3f" containerName="maas-api"
Jul 07 19:17:30.316954 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.316679    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e59871c-10d9-4862-bf5a-416ee05580ef" containerName="istio-proxy"
Jul 07 19:17:30.316954 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.316685    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e59871c-10d9-4862-bf5a-416ee05580ef" containerName="istio-proxy"
Jul 07 19:17:30.316954 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.316780    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b23a3ae-c920-4a05-b84a-ee95e2092f3f" containerName="maas-api"
Jul 07 19:17:30.316954 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.316810    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e59871c-10d9-4862-bf5a-416ee05580ef" containerName="istio-proxy"
Jul 07 19:17:30.319901 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.319883    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.322970 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.322953    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9822aeb5-openshift-default-dockercfg-st7dk\""
Jul 07 19:17:30.346854 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.346821    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-token\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.346997 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.346869    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-envoy\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.346997 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.346925    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-workload-certs\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.346997 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.346959    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-workload-socket\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.346997 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.346995    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-podinfo\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.347165 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.347028    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc972\" (UniqueName: \"kubernetes.io/projected/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-kube-api-access-gc972\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.347165 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.347076    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istiod-ca-cert\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.347165 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.347109    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-data\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.347272 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.347169    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-credential-socket\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.389622 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.389589    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"]
Jul 07 19:17:30.448179 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.448146    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-credential-socket\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.448179 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.448179    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-token\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.448409 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.448206    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-envoy\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.448409 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.448241    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-workload-certs\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.448409 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.448261    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-workload-socket\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.448409 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.448291    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-podinfo\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.448409 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.448318    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc972\" (UniqueName: \"kubernetes.io/projected/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-kube-api-access-gc972\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.448409 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.448391    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istiod-ca-cert\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.448680 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.448478    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-data\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.448680 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.448610    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-credential-socket\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.448903 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.448878    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-workload-socket\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.448984 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.448925    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-workload-certs\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.449065 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.449046    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-data\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.449112 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.449097    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istiod-ca-cert\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.450667 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.450647    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-envoy\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.450881 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.450863    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-podinfo\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.459092 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.459060    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-token\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.459209 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.459141    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc972\" (UniqueName: \"kubernetes.io/projected/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-kube-api-access-gc972\") pod \"e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") " pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.630481 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.630386    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:30.801503 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.801466    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"]
Jul 07 19:17:30.802717 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:17:30.802690    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc05efcf6_7f54_4422_be36_8bd1a0ceeb0c.slice/crio-e8fb0d9317874826a8000245a20419abf21edf754f09466dd1e2ad8cffb69e39 WatchSource:0}: Error finding container e8fb0d9317874826a8000245a20419abf21edf754f09466dd1e2ad8cffb69e39: Status 404 returned error can't find the container with id e8fb0d9317874826a8000245a20419abf21edf754f09466dd1e2ad8cffb69e39
Jul 07 19:17:30.804933 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.804904    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:17:30.805004 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.804971    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:17:30.805004 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:30.804999    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:17:31.110222 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:31.110187    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5" event={"ID":"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c","Type":"ContainerStarted","Data":"6d8988e2f4548f0eb91a9378b9fe91ceca3ddd30e5f51ba2f08ae76196fac190"}
Jul 07 19:17:31.110368 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:31.110241    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5" event={"ID":"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c","Type":"ContainerStarted","Data":"e8fb0d9317874826a8000245a20419abf21edf754f09466dd1e2ad8cffb69e39"}
Jul 07 19:17:31.142931 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:31.142880    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5" podStartSLOduration=1.142863342 podStartE2EDuration="1.142863342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:17:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:17:31.140984104 +0000 UTC m=+1600.300323930" watchObservedRunningTime="2026-07-07 19:17:31.142863342 +0000 UTC m=+1600.302203167"
Jul 07 19:17:31.630596 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:31.630562    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:31.635484 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:31.635458    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:32.114847 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:32.114815    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:32.115782 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:32.115763    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:33.343997 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.343968    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"]
Jul 07 19:17:33.347325 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.347308    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:33.350342 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.350317    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-9822aeb5-serving-cert\""
Jul 07 19:17:33.361753 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.361728    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"]
Jul 07 19:17:33.379495 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.379460    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smbq6\" (UniqueName: \"kubernetes.io/projected/eec5449a-c89f-40f1-b39e-2b782a056ba5-kube-api-access-smbq6\") pod \"maas-api-e2e-mt-9822aeb5-59db747588-54nrh\" (UID: \"eec5449a-c89f-40f1-b39e-2b782a056ba5\") " pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:33.379727 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.379539    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eec5449a-c89f-40f1-b39e-2b782a056ba5-maas-api-tls\") pod \"maas-api-e2e-mt-9822aeb5-59db747588-54nrh\" (UID: \"eec5449a-c89f-40f1-b39e-2b782a056ba5\") " pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:33.379727 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.379569    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eec5449a-c89f-40f1-b39e-2b782a056ba5-openshift-service-ca\") pod \"maas-api-e2e-mt-9822aeb5-59db747588-54nrh\" (UID: \"eec5449a-c89f-40f1-b39e-2b782a056ba5\") " pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:33.481234 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.481196    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eec5449a-c89f-40f1-b39e-2b782a056ba5-maas-api-tls\") pod \"maas-api-e2e-mt-9822aeb5-59db747588-54nrh\" (UID: \"eec5449a-c89f-40f1-b39e-2b782a056ba5\") " pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:33.481437 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.481338    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eec5449a-c89f-40f1-b39e-2b782a056ba5-openshift-service-ca\") pod \"maas-api-e2e-mt-9822aeb5-59db747588-54nrh\" (UID: \"eec5449a-c89f-40f1-b39e-2b782a056ba5\") " pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:33.481725 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.481703    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smbq6\" (UniqueName: \"kubernetes.io/projected/eec5449a-c89f-40f1-b39e-2b782a056ba5-kube-api-access-smbq6\") pod \"maas-api-e2e-mt-9822aeb5-59db747588-54nrh\" (UID: \"eec5449a-c89f-40f1-b39e-2b782a056ba5\") " pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:33.482358 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.482334    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eec5449a-c89f-40f1-b39e-2b782a056ba5-openshift-service-ca\") pod \"maas-api-e2e-mt-9822aeb5-59db747588-54nrh\" (UID: \"eec5449a-c89f-40f1-b39e-2b782a056ba5\") " pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:33.484061 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.484042    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eec5449a-c89f-40f1-b39e-2b782a056ba5-maas-api-tls\") pod \"maas-api-e2e-mt-9822aeb5-59db747588-54nrh\" (UID: \"eec5449a-c89f-40f1-b39e-2b782a056ba5\") " pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:33.492585 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.492553    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smbq6\" (UniqueName: \"kubernetes.io/projected/eec5449a-c89f-40f1-b39e-2b782a056ba5-kube-api-access-smbq6\") pod \"maas-api-e2e-mt-9822aeb5-59db747588-54nrh\" (UID: \"eec5449a-c89f-40f1-b39e-2b782a056ba5\") " pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:33.658437 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.658347    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:33.810595 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:33.810567    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"]
Jul 07 19:17:33.813209 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:17:33.813171    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec5449a_c89f_40f1_b39e_2b782a056ba5.slice/crio-1d273d72b63f6d66c42a2ac84bd111840d247075148e844aaa8fd76e2df86416 WatchSource:0}: Error finding container 1d273d72b63f6d66c42a2ac84bd111840d247075148e844aaa8fd76e2df86416: Status 404 returned error can't find the container with id 1d273d72b63f6d66c42a2ac84bd111840d247075148e844aaa8fd76e2df86416
Jul 07 19:17:34.128324 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:34.128282    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh" event={"ID":"eec5449a-c89f-40f1-b39e-2b782a056ba5","Type":"ContainerStarted","Data":"1d273d72b63f6d66c42a2ac84bd111840d247075148e844aaa8fd76e2df86416"}
Jul 07 19:17:35.135779 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:35.135739    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh" event={"ID":"eec5449a-c89f-40f1-b39e-2b782a056ba5","Type":"ContainerStarted","Data":"fb06de58c50fef71cf5dff315ca81a9b36f5d88c900e3acaf7262152dce818d1"}
Jul 07 19:17:35.136261 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:35.135828    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:35.155572 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:35.155523    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh" podStartSLOduration=1.663560245 podStartE2EDuration="2.155507495s" totalImagesPullingTime="491.94725ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:17:35.153824908 +0000 UTC m=+1604.313164750" watchObservedRunningTime="2026-07-07 19:17:35.155507495 +0000 UTC m=+1604.314847320"
Jul 07 19:17:41.146939 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:41.146908    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:45.765586 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:45.765550    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"]
Jul 07 19:17:45.766057 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:45.765838    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh" podUID="eec5449a-c89f-40f1-b39e-2b782a056ba5" containerName="maas-api" containerID="cri-o://fb06de58c50fef71cf5dff315ca81a9b36f5d88c900e3acaf7262152dce818d1" gracePeriod=30
Jul 07 19:17:46.049925 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.049895    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:46.213970 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.213932    2554 generic.go:356] "Generic (PLEG): container finished" podID="eec5449a-c89f-40f1-b39e-2b782a056ba5" containerID="fb06de58c50fef71cf5dff315ca81a9b36f5d88c900e3acaf7262152dce818d1" exitCode=0
Jul 07 19:17:46.214140 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.213982    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"
Jul 07 19:17:46.214140 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.213993    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh" event={"ID":"eec5449a-c89f-40f1-b39e-2b782a056ba5","Type":"ContainerDied","Data":"fb06de58c50fef71cf5dff315ca81a9b36f5d88c900e3acaf7262152dce818d1"}
Jul 07 19:17:46.214140 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.214048    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh" event={"ID":"eec5449a-c89f-40f1-b39e-2b782a056ba5","Type":"ContainerDied","Data":"1d273d72b63f6d66c42a2ac84bd111840d247075148e844aaa8fd76e2df86416"}
Jul 07 19:17:46.214140 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.214079    2554 scope.go:117] "RemoveContainer" containerID="fb06de58c50fef71cf5dff315ca81a9b36f5d88c900e3acaf7262152dce818d1"
Jul 07 19:17:46.217385 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.217364    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eec5449a-c89f-40f1-b39e-2b782a056ba5-openshift-service-ca\") pod \"eec5449a-c89f-40f1-b39e-2b782a056ba5\" (UID: \"eec5449a-c89f-40f1-b39e-2b782a056ba5\") "
Jul 07 19:17:46.217492 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.217405    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smbq6\" (UniqueName: \"kubernetes.io/projected/eec5449a-c89f-40f1-b39e-2b782a056ba5-kube-api-access-smbq6\") pod \"eec5449a-c89f-40f1-b39e-2b782a056ba5\" (UID: \"eec5449a-c89f-40f1-b39e-2b782a056ba5\") "
Jul 07 19:17:46.217553 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.217521    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eec5449a-c89f-40f1-b39e-2b782a056ba5-maas-api-tls\") pod \"eec5449a-c89f-40f1-b39e-2b782a056ba5\" (UID: \"eec5449a-c89f-40f1-b39e-2b782a056ba5\") "
Jul 07 19:17:46.217767 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.217723    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eec5449a-c89f-40f1-b39e-2b782a056ba5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eec5449a-c89f-40f1-b39e-2b782a056ba5" (UID: "eec5449a-c89f-40f1-b39e-2b782a056ba5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:17:46.217927 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.217880    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eec5449a-c89f-40f1-b39e-2b782a056ba5-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:17:46.219822 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.219772    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eec5449a-c89f-40f1-b39e-2b782a056ba5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eec5449a-c89f-40f1-b39e-2b782a056ba5" (UID: "eec5449a-c89f-40f1-b39e-2b782a056ba5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:17:46.219935 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.219909    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eec5449a-c89f-40f1-b39e-2b782a056ba5-kube-api-access-smbq6" (OuterVolumeSpecName: "kube-api-access-smbq6") pod "eec5449a-c89f-40f1-b39e-2b782a056ba5" (UID: "eec5449a-c89f-40f1-b39e-2b782a056ba5"). InnerVolumeSpecName "kube-api-access-smbq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:17:46.224180 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.224160    2554 scope.go:117] "RemoveContainer" containerID="fb06de58c50fef71cf5dff315ca81a9b36f5d88c900e3acaf7262152dce818d1"
Jul 07 19:17:46.224534 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:17:46.224512    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb06de58c50fef71cf5dff315ca81a9b36f5d88c900e3acaf7262152dce818d1\": container with ID starting with fb06de58c50fef71cf5dff315ca81a9b36f5d88c900e3acaf7262152dce818d1 not found: ID does not exist" containerID="fb06de58c50fef71cf5dff315ca81a9b36f5d88c900e3acaf7262152dce818d1"
Jul 07 19:17:46.224608 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.224546    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb06de58c50fef71cf5dff315ca81a9b36f5d88c900e3acaf7262152dce818d1"} err="failed to get container status \"fb06de58c50fef71cf5dff315ca81a9b36f5d88c900e3acaf7262152dce818d1\": rpc error: code = NotFound desc = could not find container \"fb06de58c50fef71cf5dff315ca81a9b36f5d88c900e3acaf7262152dce818d1\": container with ID starting with fb06de58c50fef71cf5dff315ca81a9b36f5d88c900e3acaf7262152dce818d1 not found: ID does not exist"
Jul 07 19:17:46.318762 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.318678    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eec5449a-c89f-40f1-b39e-2b782a056ba5-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:17:46.318762 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.318707    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smbq6\" (UniqueName: \"kubernetes.io/projected/eec5449a-c89f-40f1-b39e-2b782a056ba5-kube-api-access-smbq6\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:17:46.537346 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.537308    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"]
Jul 07 19:17:46.544359 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:46.544319    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-9822aeb5-59db747588-54nrh"]
Jul 07 19:17:47.116403 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:47.116370    2554 patch_prober.go:28] interesting pod/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 07 19:17:47.116832 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:47.116426    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5" podUID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 07 19:17:47.221367 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:47.221334    2554 generic.go:356] "Generic (PLEG): container finished" podID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" containerID="6d8988e2f4548f0eb91a9378b9fe91ceca3ddd30e5f51ba2f08ae76196fac190" exitCode=0
Jul 07 19:17:47.221539 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:47.221373    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5" event={"ID":"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c","Type":"ContainerDied","Data":"6d8988e2f4548f0eb91a9378b9fe91ceca3ddd30e5f51ba2f08ae76196fac190"}
Jul 07 19:17:47.221788 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:47.221774    2554 scope.go:117] "RemoveContainer" containerID="6d8988e2f4548f0eb91a9378b9fe91ceca3ddd30e5f51ba2f08ae76196fac190"
Jul 07 19:17:47.222915 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:47.222884    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:17:47.223029 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:47.222996    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:17:47.223093 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:47.223031    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:17:47.476411 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:47.476387    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eec5449a-c89f-40f1-b39e-2b782a056ba5" path="/var/lib/kubelet/pods/eec5449a-c89f-40f1-b39e-2b782a056ba5/volumes"
Jul 07 19:17:48.228557 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:48.228521    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5" event={"ID":"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c","Type":"ContainerStarted","Data":"051feef1ba42364bbf808f6ffdde2514b003bb7feda4d551455d92b9e22dca97"}
Jul 07 19:17:48.631324 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:48.631238    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:48.631471 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:48.631448    2554 patch_prober.go:28] interesting pod/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 07 19:17:48.631519 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:48.631492    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5" podUID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 07 19:17:49.631487 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:49.631443    2554 patch_prober.go:28] interesting pod/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 07 19:17:49.631929 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:49.631508    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5" podUID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 07 19:17:50.631651 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:50.631611    2554 patch_prober.go:28] interesting pod/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 07 19:17:50.632097 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:50.631687    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5" podUID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 07 19:17:51.631628 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:51.631587    2554 patch_prober.go:28] interesting pod/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 07 19:17:51.631866 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:51.631646    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5" podUID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 07 19:17:52.427452 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:52.427414    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"]
Jul 07 19:17:52.427665 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:52.427639    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5" podUID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" containerName="istio-proxy" containerID="cri-o://051feef1ba42364bbf808f6ffdde2514b003bb7feda4d551455d92b9e22dca97" gracePeriod=30
Jul 07 19:17:57.691865 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.691771    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:57.827664 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.827628    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istiod-ca-cert\") pod \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") "
Jul 07 19:17:57.827864 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.827672    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-podinfo\") pod \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") "
Jul 07 19:17:57.827864 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.827729    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-credential-socket\") pod \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") "
Jul 07 19:17:57.827864 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.827776    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-workload-socket\") pod \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") "
Jul 07 19:17:57.827864 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.827848    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-token\") pod \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") "
Jul 07 19:17:57.828107 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.827876    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-data\") pod \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") "
Jul 07 19:17:57.828107 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.827936    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-workload-certs\") pod \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") "
Jul 07 19:17:57.828107 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.827969    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc972\" (UniqueName: \"kubernetes.io/projected/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-kube-api-access-gc972\") pod \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") "
Jul 07 19:17:57.828107 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.828002    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-envoy\") pod \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\" (UID: \"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c\") "
Jul 07 19:17:57.828308 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.828109    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" (UID: "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:17:57.828308 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.828142    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" (UID: "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:17:57.828308 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.828167    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" (UID: "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:17:57.828539 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.828316    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:17:57.828539 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.828335    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:17:57.828539 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.828349    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:17:57.828539 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.828371    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" (UID: "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:17:57.828997 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.828961    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-data" (OuterVolumeSpecName: "istio-data") pod "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" (UID: "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:17:57.830041 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.830011    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" (UID: "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:17:57.830140 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.830090    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-token" (OuterVolumeSpecName: "istio-token") pod "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" (UID: "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:17:57.830199 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.830158    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" (UID: "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:17:57.830256 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.830238    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-kube-api-access-gc972" (OuterVolumeSpecName: "kube-api-access-gc972") pod "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" (UID: "c05efcf6-7f54-4422-be36-8bd1a0ceeb0c"). InnerVolumeSpecName "kube-api-access-gc972". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:17:57.929611 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.929572    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:17:57.929611 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.929603    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:17:57.929611 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.929616    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:17:57.929886 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.929628    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc972\" (UniqueName: \"kubernetes.io/projected/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-kube-api-access-gc972\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:17:57.929886 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.929639    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:17:57.929886 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:57.929650    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:17:58.281298 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:58.281261    2554 generic.go:356] "Generic (PLEG): container finished" podID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" containerID="051feef1ba42364bbf808f6ffdde2514b003bb7feda4d551455d92b9e22dca97" exitCode=0
Jul 07 19:17:58.281481 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:58.281317    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"
Jul 07 19:17:58.281481 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:58.281334    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5" event={"ID":"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c","Type":"ContainerDied","Data":"051feef1ba42364bbf808f6ffdde2514b003bb7feda4d551455d92b9e22dca97"}
Jul 07 19:17:58.281481 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:58.281377    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5" event={"ID":"c05efcf6-7f54-4422-be36-8bd1a0ceeb0c","Type":"ContainerDied","Data":"e8fb0d9317874826a8000245a20419abf21edf754f09466dd1e2ad8cffb69e39"}
Jul 07 19:17:58.281481 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:58.281398    2554 scope.go:117] "RemoveContainer" containerID="051feef1ba42364bbf808f6ffdde2514b003bb7feda4d551455d92b9e22dca97"
Jul 07 19:17:58.291222 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:58.291206    2554 scope.go:117] "RemoveContainer" containerID="6d8988e2f4548f0eb91a9378b9fe91ceca3ddd30e5f51ba2f08ae76196fac190"
Jul 07 19:17:58.299066 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:58.299048    2554 scope.go:117] "RemoveContainer" containerID="051feef1ba42364bbf808f6ffdde2514b003bb7feda4d551455d92b9e22dca97"
Jul 07 19:17:58.299318 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:17:58.299300    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"051feef1ba42364bbf808f6ffdde2514b003bb7feda4d551455d92b9e22dca97\": container with ID starting with 051feef1ba42364bbf808f6ffdde2514b003bb7feda4d551455d92b9e22dca97 not found: ID does not exist" containerID="051feef1ba42364bbf808f6ffdde2514b003bb7feda4d551455d92b9e22dca97"
Jul 07 19:17:58.299362 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:58.299327    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"051feef1ba42364bbf808f6ffdde2514b003bb7feda4d551455d92b9e22dca97"} err="failed to get container status \"051feef1ba42364bbf808f6ffdde2514b003bb7feda4d551455d92b9e22dca97\": rpc error: code = NotFound desc = could not find container \"051feef1ba42364bbf808f6ffdde2514b003bb7feda4d551455d92b9e22dca97\": container with ID starting with 051feef1ba42364bbf808f6ffdde2514b003bb7feda4d551455d92b9e22dca97 not found: ID does not exist"
Jul 07 19:17:58.299362 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:58.299342    2554 scope.go:117] "RemoveContainer" containerID="6d8988e2f4548f0eb91a9378b9fe91ceca3ddd30e5f51ba2f08ae76196fac190"
Jul 07 19:17:58.299549 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:17:58.299533    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d8988e2f4548f0eb91a9378b9fe91ceca3ddd30e5f51ba2f08ae76196fac190\": container with ID starting with 6d8988e2f4548f0eb91a9378b9fe91ceca3ddd30e5f51ba2f08ae76196fac190 not found: ID does not exist" containerID="6d8988e2f4548f0eb91a9378b9fe91ceca3ddd30e5f51ba2f08ae76196fac190"
Jul 07 19:17:58.299590 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:58.299553    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d8988e2f4548f0eb91a9378b9fe91ceca3ddd30e5f51ba2f08ae76196fac190"} err="failed to get container status \"6d8988e2f4548f0eb91a9378b9fe91ceca3ddd30e5f51ba2f08ae76196fac190\": rpc error: code = NotFound desc = could not find container \"6d8988e2f4548f0eb91a9378b9fe91ceca3ddd30e5f51ba2f08ae76196fac190\": container with ID starting with 6d8988e2f4548f0eb91a9378b9fe91ceca3ddd30e5f51ba2f08ae76196fac190 not found: ID does not exist"
Jul 07 19:17:58.307553 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:58.307530    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"]
Jul 07 19:17:58.314186 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:58.314164    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9822aeb5-openshift-default-57fcd74979-z9ct5"]
Jul 07 19:17:59.474782 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:17:59.474748    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" path="/var/lib/kubelet/pods/c05efcf6-7f54-4422-be36-8bd1a0ceeb0c/volumes"
Jul 07 19:18:13.064040 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.064001    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"]
Jul 07 19:18:13.064604 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.064586    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" containerName="istio-proxy"
Jul 07 19:18:13.064649 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.064607    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" containerName="istio-proxy"
Jul 07 19:18:13.064649 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.064618    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec5449a-c89f-40f1-b39e-2b782a056ba5" containerName="maas-api"
Jul 07 19:18:13.064649 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.064626    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec5449a-c89f-40f1-b39e-2b782a056ba5" containerName="maas-api"
Jul 07 19:18:13.064649 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.064639    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" containerName="istio-proxy"
Jul 07 19:18:13.064649 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.064648    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" containerName="istio-proxy"
Jul 07 19:18:13.064830 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.064744    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" containerName="istio-proxy"
Jul 07 19:18:13.064830 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.064755    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="eec5449a-c89f-40f1-b39e-2b782a056ba5" containerName="maas-api"
Jul 07 19:18:13.064830 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.064767    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c05efcf6-7f54-4422-be36-8bd1a0ceeb0c" containerName="istio-proxy"
Jul 07 19:18:13.067945 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.067925    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.070786 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.070762    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-62ed4bc1-openshift-default-dockercfg-gv4z7\""
Jul 07 19:18:13.087481 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.087453    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"]
Jul 07 19:18:13.153706 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.153665    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-podinfo\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.153931 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.153727    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-data\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.153931 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.153760    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-credential-socket\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.153931 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.153871    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-token\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.154197 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.153938    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-workload-socket\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.154197 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.153986    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-envoy\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.154197 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.154080    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istiod-ca-cert\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.154197 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.154112    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-workload-certs\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.154197 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.154162    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkt7v\" (UniqueName: \"kubernetes.io/projected/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-kube-api-access-jkt7v\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.254971 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.254931    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-credential-socket\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.255278 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.255246    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-token\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.255395 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.255316    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-workload-socket\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.255395 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.255334    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-envoy\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.255395 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.255361    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istiod-ca-cert\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.255676 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.255649    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-workload-certs\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.255767 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.255704    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkt7v\" (UniqueName: \"kubernetes.io/projected/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-kube-api-access-jkt7v\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.255868 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.255845    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-credential-socket\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.256182 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.256045    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-workload-certs\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.256182 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.256046    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-podinfo\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.256182 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.256111    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-workload-socket\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.256182 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.256132    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-data\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.256182 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.256136    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istiod-ca-cert\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.256485 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.256399    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-data\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.258032 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.258010    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-envoy\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.258684 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.258666    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-podinfo\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.271484 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.271445    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-token\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.271743 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.271713    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkt7v\" (UniqueName: \"kubernetes.io/projected/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-kube-api-access-jkt7v\") pod \"e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") " pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.377549 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.377450    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:13.522834 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.522787    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"]
Jul 07 19:18:13.525508 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:18:13.525478    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f379d89_c9ea_49f1_ba19_a23ffe96b50a.slice/crio-d2dd52560f7698048f80b7c0a5494a4fc5939a8887de23b9c1469b014d4ae018 WatchSource:0}: Error finding container d2dd52560f7698048f80b7c0a5494a4fc5939a8887de23b9c1469b014d4ae018: Status 404 returned error can't find the container with id d2dd52560f7698048f80b7c0a5494a4fc5939a8887de23b9c1469b014d4ae018
Jul 07 19:18:13.527617 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.527586    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:18:13.527675 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.527657    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:18:13.527712 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:13.527684    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:18:14.363939 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:14.363892    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf" event={"ID":"2f379d89-c9ea-49f1-ba19-a23ffe96b50a","Type":"ContainerStarted","Data":"b1532c2beafec39f27a66fcabd01c1b05ee17d2e109571b032b5e9e9178ba81a"}
Jul 07 19:18:14.364338 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:14.363963    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf" event={"ID":"2f379d89-c9ea-49f1-ba19-a23ffe96b50a","Type":"ContainerStarted","Data":"d2dd52560f7698048f80b7c0a5494a4fc5939a8887de23b9c1469b014d4ae018"}
Jul 07 19:18:14.377978 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:14.377945    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:14.382741 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:14.382716    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:14.389318 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:14.389275    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf" podStartSLOduration=1.389257201 podStartE2EDuration="1.389257201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:18:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:18:14.387428863 +0000 UTC m=+1643.546768714" watchObservedRunningTime="2026-07-07 19:18:14.389257201 +0000 UTC m=+1643.548597026"
Jul 07 19:18:15.370057 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:15.370027    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:15.371094 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:15.371075    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:16.428588 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.428554    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"]
Jul 07 19:18:16.431492 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.431469    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:16.434124 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.434102    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-62ed4bc1-serving-cert\""
Jul 07 19:18:16.445317 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.445292    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"]
Jul 07 19:18:16.485873 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.485824    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dea8356-ff14-4828-9bfd-7f7f563c75ec-openshift-service-ca\") pod \"maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7\" (UID: \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\") " pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:16.486041 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.485913    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g8kk\" (UniqueName: \"kubernetes.io/projected/8dea8356-ff14-4828-9bfd-7f7f563c75ec-kube-api-access-2g8kk\") pod \"maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7\" (UID: \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\") " pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:16.486041 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.485992    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8dea8356-ff14-4828-9bfd-7f7f563c75ec-maas-api-tls\") pod \"maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7\" (UID: \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\") " pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:16.587215 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.587180    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dea8356-ff14-4828-9bfd-7f7f563c75ec-openshift-service-ca\") pod \"maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7\" (UID: \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\") " pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:16.587393 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.587223    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g8kk\" (UniqueName: \"kubernetes.io/projected/8dea8356-ff14-4828-9bfd-7f7f563c75ec-kube-api-access-2g8kk\") pod \"maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7\" (UID: \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\") " pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:16.587393 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.587257    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8dea8356-ff14-4828-9bfd-7f7f563c75ec-maas-api-tls\") pod \"maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7\" (UID: \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\") " pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:16.587835 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.587815    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dea8356-ff14-4828-9bfd-7f7f563c75ec-openshift-service-ca\") pod \"maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7\" (UID: \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\") " pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:16.589638 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.589618    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8dea8356-ff14-4828-9bfd-7f7f563c75ec-maas-api-tls\") pod \"maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7\" (UID: \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\") " pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:16.598106 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.598086    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g8kk\" (UniqueName: \"kubernetes.io/projected/8dea8356-ff14-4828-9bfd-7f7f563c75ec-kube-api-access-2g8kk\") pod \"maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7\" (UID: \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\") " pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:16.742337 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.742305    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:16.900575 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:16.900551    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"]
Jul 07 19:18:16.901988 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:18:16.901961    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dea8356_ff14_4828_9bfd_7f7f563c75ec.slice/crio-016c707310bf65427dacac1acc5306462d2d2f2351754ef4e3776fa78aad8114 WatchSource:0}: Error finding container 016c707310bf65427dacac1acc5306462d2d2f2351754ef4e3776fa78aad8114: Status 404 returned error can't find the container with id 016c707310bf65427dacac1acc5306462d2d2f2351754ef4e3776fa78aad8114
Jul 07 19:18:17.381384 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:17.381350    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7" event={"ID":"8dea8356-ff14-4828-9bfd-7f7f563c75ec","Type":"ContainerStarted","Data":"d25297701b9cfac6ae8d3f50eea56bf4cc02a8f0b324d98a5416d6efdff7fc10"}
Jul 07 19:18:17.381567 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:17.381412    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7" event={"ID":"8dea8356-ff14-4828-9bfd-7f7f563c75ec","Type":"ContainerStarted","Data":"016c707310bf65427dacac1acc5306462d2d2f2351754ef4e3776fa78aad8114"}
Jul 07 19:18:17.381651 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:17.381630    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:17.420088 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:17.420040    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7" podStartSLOduration=1.044150561 podStartE2EDuration="1.420024458s" totalImagesPullingTime="375.873897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:18:17.418765649 +0000 UTC m=+1646.578105500" watchObservedRunningTime="2026-07-07 19:18:17.420024458 +0000 UTC m=+1646.579364283"
Jul 07 19:18:23.391759 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:23.391719    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:29.442762 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:29.442726    2554 generic.go:356] "Generic (PLEG): container finished" podID="2f379d89-c9ea-49f1-ba19-a23ffe96b50a" containerID="b1532c2beafec39f27a66fcabd01c1b05ee17d2e109571b032b5e9e9178ba81a" exitCode=0
Jul 07 19:18:29.443208 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:29.442814    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf" event={"ID":"2f379d89-c9ea-49f1-ba19-a23ffe96b50a","Type":"ContainerDied","Data":"b1532c2beafec39f27a66fcabd01c1b05ee17d2e109571b032b5e9e9178ba81a"}
Jul 07 19:18:29.443277 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:29.443258    2554 scope.go:117] "RemoveContainer" containerID="b1532c2beafec39f27a66fcabd01c1b05ee17d2e109571b032b5e9e9178ba81a"
Jul 07 19:18:29.444321 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:29.444285    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:18:29.444434 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:29.444360    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:18:29.444434 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:29.444397    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:18:30.370105 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:30.370058    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:30.450185 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:30.450141    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf" event={"ID":"2f379d89-c9ea-49f1-ba19-a23ffe96b50a","Type":"ContainerStarted","Data":"a7d0d8f22a5eb21612bf654bda5b7417b7b58a1de49aba5d3ace06acbbe55237"}
Jul 07 19:18:31.380056 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:31.379595    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:31.380056 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:31.379721    2554 patch_prober.go:28] interesting pod/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 07 19:18:31.380056 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:31.379774    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf" podUID="2f379d89-c9ea-49f1-ba19-a23ffe96b50a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 07 19:18:32.378956 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:32.378909    2554 patch_prober.go:28] interesting pod/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 07 19:18:32.379485 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:32.378980    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf" podUID="2f379d89-c9ea-49f1-ba19-a23ffe96b50a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 07 19:18:33.378252 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:33.378208    2554 patch_prober.go:28] interesting pod/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 07 19:18:33.378475 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:33.378273    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf" podUID="2f379d89-c9ea-49f1-ba19-a23ffe96b50a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 07 19:18:34.382352 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:34.382320    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:34.382745 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:34.382585    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:34.383276 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:34.383259    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:18:58.920668 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:58.920624    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"]
Jul 07 19:18:58.921210 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:58.920907    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7" podUID="8dea8356-ff14-4828-9bfd-7f7f563c75ec" containerName="maas-api" containerID="cri-o://d25297701b9cfac6ae8d3f50eea56bf4cc02a8f0b324d98a5416d6efdff7fc10" gracePeriod=30
Jul 07 19:18:59.174363 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.174303    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:59.289772 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.289728    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2g8kk\" (UniqueName: \"kubernetes.io/projected/8dea8356-ff14-4828-9bfd-7f7f563c75ec-kube-api-access-2g8kk\") pod \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\" (UID: \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\") "
Jul 07 19:18:59.289961 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.289929    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8dea8356-ff14-4828-9bfd-7f7f563c75ec-maas-api-tls\") pod \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\" (UID: \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\") "
Jul 07 19:18:59.290006 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.289984    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dea8356-ff14-4828-9bfd-7f7f563c75ec-openshift-service-ca\") pod \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\" (UID: \"8dea8356-ff14-4828-9bfd-7f7f563c75ec\") "
Jul 07 19:18:59.290385 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.290356    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dea8356-ff14-4828-9bfd-7f7f563c75ec-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8dea8356-ff14-4828-9bfd-7f7f563c75ec" (UID: "8dea8356-ff14-4828-9bfd-7f7f563c75ec"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:18:59.291914 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.291892    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dea8356-ff14-4828-9bfd-7f7f563c75ec-kube-api-access-2g8kk" (OuterVolumeSpecName: "kube-api-access-2g8kk") pod "8dea8356-ff14-4828-9bfd-7f7f563c75ec" (UID: "8dea8356-ff14-4828-9bfd-7f7f563c75ec"). InnerVolumeSpecName "kube-api-access-2g8kk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:59.291995 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.291964    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dea8356-ff14-4828-9bfd-7f7f563c75ec-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8dea8356-ff14-4828-9bfd-7f7f563c75ec" (UID: "8dea8356-ff14-4828-9bfd-7f7f563c75ec"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:18:59.391508 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.391472    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8dea8356-ff14-4828-9bfd-7f7f563c75ec-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:18:59.391508 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.391505    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dea8356-ff14-4828-9bfd-7f7f563c75ec-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:18:59.391508 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.391514    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2g8kk\" (UniqueName: \"kubernetes.io/projected/8dea8356-ff14-4828-9bfd-7f7f563c75ec-kube-api-access-2g8kk\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:18:59.595947 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.595913    2554 generic.go:356] "Generic (PLEG): container finished" podID="8dea8356-ff14-4828-9bfd-7f7f563c75ec" containerID="d25297701b9cfac6ae8d3f50eea56bf4cc02a8f0b324d98a5416d6efdff7fc10" exitCode=0
Jul 07 19:18:59.596153 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.595976    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"
Jul 07 19:18:59.596153 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.595995    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7" event={"ID":"8dea8356-ff14-4828-9bfd-7f7f563c75ec","Type":"ContainerDied","Data":"d25297701b9cfac6ae8d3f50eea56bf4cc02a8f0b324d98a5416d6efdff7fc10"}
Jul 07 19:18:59.596153 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.596125    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7" event={"ID":"8dea8356-ff14-4828-9bfd-7f7f563c75ec","Type":"ContainerDied","Data":"016c707310bf65427dacac1acc5306462d2d2f2351754ef4e3776fa78aad8114"}
Jul 07 19:18:59.596153 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.596151    2554 scope.go:117] "RemoveContainer" containerID="d25297701b9cfac6ae8d3f50eea56bf4cc02a8f0b324d98a5416d6efdff7fc10"
Jul 07 19:18:59.605023 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.605003    2554 scope.go:117] "RemoveContainer" containerID="d25297701b9cfac6ae8d3f50eea56bf4cc02a8f0b324d98a5416d6efdff7fc10"
Jul 07 19:18:59.605529 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:18:59.605352    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d25297701b9cfac6ae8d3f50eea56bf4cc02a8f0b324d98a5416d6efdff7fc10\": container with ID starting with d25297701b9cfac6ae8d3f50eea56bf4cc02a8f0b324d98a5416d6efdff7fc10 not found: ID does not exist" containerID="d25297701b9cfac6ae8d3f50eea56bf4cc02a8f0b324d98a5416d6efdff7fc10"
Jul 07 19:18:59.605529 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.605405    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d25297701b9cfac6ae8d3f50eea56bf4cc02a8f0b324d98a5416d6efdff7fc10"} err="failed to get container status \"d25297701b9cfac6ae8d3f50eea56bf4cc02a8f0b324d98a5416d6efdff7fc10\": rpc error: code = NotFound desc = could not find container \"d25297701b9cfac6ae8d3f50eea56bf4cc02a8f0b324d98a5416d6efdff7fc10\": container with ID starting with d25297701b9cfac6ae8d3f50eea56bf4cc02a8f0b324d98a5416d6efdff7fc10 not found: ID does not exist"
Jul 07 19:18:59.615426 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.615403    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"]
Jul 07 19:18:59.617286 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:18:59.617266    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-62ed4bc1-696559ddcf-9zmc7"]
Jul 07 19:19:01.474922 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:19:01.474890    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dea8356-ff14-4828-9bfd-7f7f563c75ec" path="/var/lib/kubelet/pods/8dea8356-ff14-4828-9bfd-7f7f563c75ec/volumes"
Jul 07 19:19:59.371964 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:19:59.371929    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"]
Jul 07 19:19:59.372449 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:19:59.372130    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf" podUID="2f379d89-c9ea-49f1-ba19-a23ffe96b50a" containerName="istio-proxy" containerID="cri-o://a7d0d8f22a5eb21612bf654bda5b7417b7b58a1de49aba5d3ace06acbbe55237" gracePeriod=30
Jul 07 19:20:04.384293 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.384262    2554 patch_prober.go:28] interesting pod/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 07 19:20:04.384671 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.384333    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf" podUID="2f379d89-c9ea-49f1-ba19-a23ffe96b50a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 07 19:20:04.630450 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.630425    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:20:04.795496 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.795467    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkt7v\" (UniqueName: \"kubernetes.io/projected/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-kube-api-access-jkt7v\") pod \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") "
Jul 07 19:20:04.795679 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.795514    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-workload-certs\") pod \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") "
Jul 07 19:20:04.795679 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.795531    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istiod-ca-cert\") pod \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") "
Jul 07 19:20:04.795679 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.795580    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-token\") pod \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") "
Jul 07 19:20:04.795679 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.795596    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-workload-socket\") pod \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") "
Jul 07 19:20:04.795679 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.795630    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-podinfo\") pod \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") "
Jul 07 19:20:04.796000 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.795686    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-data\") pod \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") "
Jul 07 19:20:04.796000 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.795708    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-credential-socket\") pod \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") "
Jul 07 19:20:04.796000 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.795730    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-envoy\") pod \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\" (UID: \"2f379d89-c9ea-49f1-ba19-a23ffe96b50a\") "
Jul 07 19:20:04.796000 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.795971    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2f379d89-c9ea-49f1-ba19-a23ffe96b50a" (UID: "2f379d89-c9ea-49f1-ba19-a23ffe96b50a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:20:04.796228 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.796052    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:20:04.796228 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.796076    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2f379d89-c9ea-49f1-ba19-a23ffe96b50a" (UID: "2f379d89-c9ea-49f1-ba19-a23ffe96b50a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:20:04.796228 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.796128    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2f379d89-c9ea-49f1-ba19-a23ffe96b50a" (UID: "2f379d89-c9ea-49f1-ba19-a23ffe96b50a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:20:04.796384 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.796252    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2f379d89-c9ea-49f1-ba19-a23ffe96b50a" (UID: "2f379d89-c9ea-49f1-ba19-a23ffe96b50a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:20:04.796602 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.796574    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-data" (OuterVolumeSpecName: "istio-data") pod "2f379d89-c9ea-49f1-ba19-a23ffe96b50a" (UID: "2f379d89-c9ea-49f1-ba19-a23ffe96b50a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:20:04.797931 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.797904    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2f379d89-c9ea-49f1-ba19-a23ffe96b50a" (UID: "2f379d89-c9ea-49f1-ba19-a23ffe96b50a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:20:04.798022 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.797976    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-kube-api-access-jkt7v" (OuterVolumeSpecName: "kube-api-access-jkt7v") pod "2f379d89-c9ea-49f1-ba19-a23ffe96b50a" (UID: "2f379d89-c9ea-49f1-ba19-a23ffe96b50a"). InnerVolumeSpecName "kube-api-access-jkt7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:20:04.798022 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.797984    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-token" (OuterVolumeSpecName: "istio-token") pod "2f379d89-c9ea-49f1-ba19-a23ffe96b50a" (UID: "2f379d89-c9ea-49f1-ba19-a23ffe96b50a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:20:04.798022 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.797992    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2f379d89-c9ea-49f1-ba19-a23ffe96b50a" (UID: "2f379d89-c9ea-49f1-ba19-a23ffe96b50a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:20:04.897176 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.897135    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:20:04.897176 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.897172    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:20:04.897176 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.897184    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:20:04.897387 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.897198    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:20:04.897387 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.897209    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:20:04.897387 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.897220    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:20:04.897387 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.897231    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:20:04.897387 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.897243    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkt7v\" (UniqueName: \"kubernetes.io/projected/2f379d89-c9ea-49f1-ba19-a23ffe96b50a-kube-api-access-jkt7v\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:20:04.916909 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.916876    2554 generic.go:356] "Generic (PLEG): container finished" podID="2f379d89-c9ea-49f1-ba19-a23ffe96b50a" containerID="a7d0d8f22a5eb21612bf654bda5b7417b7b58a1de49aba5d3ace06acbbe55237" exitCode=0
Jul 07 19:20:04.917039 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.916925    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"
Jul 07 19:20:04.917039 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.916959    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf" event={"ID":"2f379d89-c9ea-49f1-ba19-a23ffe96b50a","Type":"ContainerDied","Data":"a7d0d8f22a5eb21612bf654bda5b7417b7b58a1de49aba5d3ace06acbbe55237"}
Jul 07 19:20:04.917039 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.917012    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf" event={"ID":"2f379d89-c9ea-49f1-ba19-a23ffe96b50a","Type":"ContainerDied","Data":"d2dd52560f7698048f80b7c0a5494a4fc5939a8887de23b9c1469b014d4ae018"}
Jul 07 19:20:04.917039 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.917037    2554 scope.go:117] "RemoveContainer" containerID="a7d0d8f22a5eb21612bf654bda5b7417b7b58a1de49aba5d3ace06acbbe55237"
Jul 07 19:20:04.926128 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.926112    2554 scope.go:117] "RemoveContainer" containerID="b1532c2beafec39f27a66fcabd01c1b05ee17d2e109571b032b5e9e9178ba81a"
Jul 07 19:20:04.933840 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.933822    2554 scope.go:117] "RemoveContainer" containerID="a7d0d8f22a5eb21612bf654bda5b7417b7b58a1de49aba5d3ace06acbbe55237"
Jul 07 19:20:04.934104 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:20:04.934086    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7d0d8f22a5eb21612bf654bda5b7417b7b58a1de49aba5d3ace06acbbe55237\": container with ID starting with a7d0d8f22a5eb21612bf654bda5b7417b7b58a1de49aba5d3ace06acbbe55237 not found: ID does not exist" containerID="a7d0d8f22a5eb21612bf654bda5b7417b7b58a1de49aba5d3ace06acbbe55237"
Jul 07 19:20:04.934181 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.934116    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d0d8f22a5eb21612bf654bda5b7417b7b58a1de49aba5d3ace06acbbe55237"} err="failed to get container status \"a7d0d8f22a5eb21612bf654bda5b7417b7b58a1de49aba5d3ace06acbbe55237\": rpc error: code = NotFound desc = could not find container \"a7d0d8f22a5eb21612bf654bda5b7417b7b58a1de49aba5d3ace06acbbe55237\": container with ID starting with a7d0d8f22a5eb21612bf654bda5b7417b7b58a1de49aba5d3ace06acbbe55237 not found: ID does not exist"
Jul 07 19:20:04.934181 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.934138    2554 scope.go:117] "RemoveContainer" containerID="b1532c2beafec39f27a66fcabd01c1b05ee17d2e109571b032b5e9e9178ba81a"
Jul 07 19:20:04.934385 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:20:04.934368    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1532c2beafec39f27a66fcabd01c1b05ee17d2e109571b032b5e9e9178ba81a\": container with ID starting with b1532c2beafec39f27a66fcabd01c1b05ee17d2e109571b032b5e9e9178ba81a not found: ID does not exist" containerID="b1532c2beafec39f27a66fcabd01c1b05ee17d2e109571b032b5e9e9178ba81a"
Jul 07 19:20:04.934429 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.934391    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1532c2beafec39f27a66fcabd01c1b05ee17d2e109571b032b5e9e9178ba81a"} err="failed to get container status \"b1532c2beafec39f27a66fcabd01c1b05ee17d2e109571b032b5e9e9178ba81a\": rpc error: code = NotFound desc = could not find container \"b1532c2beafec39f27a66fcabd01c1b05ee17d2e109571b032b5e9e9178ba81a\": container with ID starting with b1532c2beafec39f27a66fcabd01c1b05ee17d2e109571b032b5e9e9178ba81a not found: ID does not exist"
Jul 07 19:20:04.940991 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.940971    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"]
Jul 07 19:20:04.947144 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:04.947125    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-62ed4bc1-openshift-default-7dc4d694f5-g9sbf"]
Jul 07 19:20:05.474691 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:05.474656    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f379d89-c9ea-49f1-ba19-a23ffe96b50a" path="/var/lib/kubelet/pods/2f379d89-c9ea-49f1-ba19-a23ffe96b50a/volumes"
Jul 07 19:20:51.394041 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:51.394013    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 19:20:51.399620 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:51.399601    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 19:20:56.411390 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.411358    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"]
Jul 07 19:20:56.411755 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.411745    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f379d89-c9ea-49f1-ba19-a23ffe96b50a" containerName="istio-proxy"
Jul 07 19:20:56.411829 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.411756    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f379d89-c9ea-49f1-ba19-a23ffe96b50a" containerName="istio-proxy"
Jul 07 19:20:56.411829 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.411775    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dea8356-ff14-4828-9bfd-7f7f563c75ec" containerName="maas-api"
Jul 07 19:20:56.411829 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.411780    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dea8356-ff14-4828-9bfd-7f7f563c75ec" containerName="maas-api"
Jul 07 19:20:56.411933 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.411880    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dea8356-ff14-4828-9bfd-7f7f563c75ec" containerName="maas-api"
Jul 07 19:20:56.411933 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.411891    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f379d89-c9ea-49f1-ba19-a23ffe96b50a" containerName="istio-proxy"
Jul 07 19:20:56.411933 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.411898    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f379d89-c9ea-49f1-ba19-a23ffe96b50a" containerName="istio-proxy"
Jul 07 19:20:56.414934 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.414917    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.417329 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.417303    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-54b9e6-openshift-default-dockercfg-6kp69\""
Jul 07 19:20:56.435111 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.435086    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"]
Jul 07 19:20:56.549334 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.549284    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istiod-ca-cert\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.549522 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.549351    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-credential-socket\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.549522 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.549381    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-token\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.549522 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.549402    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-podinfo\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.549522 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.549423    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52rfk\" (UniqueName: \"kubernetes.io/projected/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-kube-api-access-52rfk\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.549522 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.549472    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-workload-socket\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.549522 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.549500    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-workload-certs\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.549522 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.549516    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-data\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.549898 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.549625    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-envoy\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.650935 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.650897    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-credential-socket\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.651140 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.650945    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-token\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.651140 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.650973    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-podinfo\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.651140 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.650994    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52rfk\" (UniqueName: \"kubernetes.io/projected/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-kube-api-access-52rfk\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.651140 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.651013    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-workload-socket\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.651140 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.651032    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-workload-certs\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.651407 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.651156    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-data\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.651407 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.651252    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-envoy\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.651407 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.651310    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istiod-ca-cert\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.651407 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.651371    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-credential-socket\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.651597 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.651509    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-workload-socket\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.651642 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.651601    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-workload-certs\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.651642 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.651613    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-data\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.652085 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.652062    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istiod-ca-cert\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.653448 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.653425    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-envoy\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.653745 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.653725    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-podinfo\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.660534 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.660507    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-token\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.660534 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.660526    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52rfk\" (UniqueName: \"kubernetes.io/projected/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-kube-api-access-52rfk\") pod \"e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") " pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.726278 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.726251    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:56.868294 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.868203    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"]
Jul 07 19:20:56.870662 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:20:56.870632    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf7a2df9_3d69_4f71_b1b6_fed4bc3a3615.slice/crio-e36718391690dc210239a91625b44ff667e8c0c6c34960be13753cf53b764ac0 WatchSource:0}: Error finding container e36718391690dc210239a91625b44ff667e8c0c6c34960be13753cf53b764ac0: Status 404 returned error can't find the container with id e36718391690dc210239a91625b44ff667e8c0c6c34960be13753cf53b764ac0
Jul 07 19:20:56.872924 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.872880    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:20:56.872985 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.872957    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:20:56.873025 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:56.873001    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:20:57.184297 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:57.184214    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj" event={"ID":"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615","Type":"ContainerStarted","Data":"007aa430636ee16f7af0a2fae5a1051abfad5c4e18e4b0e3e53c99c0e7e545b8"}
Jul 07 19:20:57.184297 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:57.184272    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj" event={"ID":"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615","Type":"ContainerStarted","Data":"e36718391690dc210239a91625b44ff667e8c0c6c34960be13753cf53b764ac0"}
Jul 07 19:20:57.211709 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:57.211658    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj" podStartSLOduration=1.21163856 podStartE2EDuration="1.21163856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:20:57.209122131 +0000 UTC m=+1806.368461957" watchObservedRunningTime="2026-07-07 19:20:57.21163856 +0000 UTC m=+1806.370978385"
Jul 07 19:20:57.726577 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:57.726530    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:57.731341 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:57.731314    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:58.189628 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:58.189536    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:58.190527 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:58.190510    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:20:59.288715 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.288683    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"]
Jul 07 19:20:59.289305 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.289287    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f379d89-c9ea-49f1-ba19-a23ffe96b50a" containerName="istio-proxy"
Jul 07 19:20:59.289356 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.289309    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f379d89-c9ea-49f1-ba19-a23ffe96b50a" containerName="istio-proxy"
Jul 07 19:20:59.292830 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.292812    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:20:59.296017 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.295995    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-54b9e6-serving-cert\""
Jul 07 19:20:59.305267 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.305242    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"]
Jul 07 19:20:59.376564 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.376534    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-maas-api-tls\") pod \"maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls\" (UID: \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\") " pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:20:59.376748 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.376578    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clhbl\" (UniqueName: \"kubernetes.io/projected/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-kube-api-access-clhbl\") pod \"maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls\" (UID: \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\") " pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:20:59.376748 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.376604    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls\" (UID: \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\") " pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:20:59.477036 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.477005    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-maas-api-tls\") pod \"maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls\" (UID: \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\") " pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:20:59.477228 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.477063    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clhbl\" (UniqueName: \"kubernetes.io/projected/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-kube-api-access-clhbl\") pod \"maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls\" (UID: \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\") " pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:20:59.477228 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.477093    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls\" (UID: \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\") " pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:20:59.477769 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.477748    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls\" (UID: \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\") " pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:20:59.479458 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.479440    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-maas-api-tls\") pod \"maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls\" (UID: \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\") " pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:20:59.490888 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.490857    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clhbl\" (UniqueName: \"kubernetes.io/projected/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-kube-api-access-clhbl\") pod \"maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls\" (UID: \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\") " pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:20:59.604548 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.604514    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:20:59.760470 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.760442    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"]
Jul 07 19:20:59.760791 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:20:59.760762    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2d3658_f81f_4bdd_86eb_e3483ee680bf.slice/crio-76d889784c90c371e566728b96a5223dbc4c2547c4f6054e0b2ebeb3537577f1 WatchSource:0}: Error finding container 76d889784c90c371e566728b96a5223dbc4c2547c4f6054e0b2ebeb3537577f1: Status 404 returned error can't find the container with id 76d889784c90c371e566728b96a5223dbc4c2547c4f6054e0b2ebeb3537577f1
Jul 07 19:20:59.762652 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:20:59.762630    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:21:00.200476 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:00.200441    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls" event={"ID":"bc2d3658-f81f-4bdd-86eb-e3483ee680bf","Type":"ContainerStarted","Data":"76d889784c90c371e566728b96a5223dbc4c2547c4f6054e0b2ebeb3537577f1"}
Jul 07 19:21:01.206001 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:01.205963    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls" event={"ID":"bc2d3658-f81f-4bdd-86eb-e3483ee680bf","Type":"ContainerStarted","Data":"c29e0fbbaf9ac01017194e86b8fcf9c08633d58c4c5b7aeb5ba691519d3e3b44"}
Jul 07 19:21:01.206417 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:01.206139    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:21:01.226813 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:01.226748    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls" podStartSLOduration=1.650376397 podStartE2EDuration="2.226727647s" totalImagesPullingTime="576.35125ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:21:01.224840905 +0000 UTC m=+1810.384180748" watchObservedRunningTime="2026-07-07 19:21:01.226727647 +0000 UTC m=+1810.386067474"
Jul 07 19:21:04.356398 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.356361    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"]
Jul 07 19:21:04.360037 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.360019    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.365443 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.365412    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c575f8-openshift-default-dockercfg-bkk8k\""
Jul 07 19:21:04.373417 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.373390    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"]
Jul 07 19:21:04.415613 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.415578    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-envoy\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.415613 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.415611    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-data\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.415856 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.415640    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istiod-ca-cert\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.415856 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.415745    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-token\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.415856 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.415789    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-workload-socket\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.415856 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.415839    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-workload-certs\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.416037 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.415871    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-credential-socket\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.416037 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.415938    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scvt6\" (UniqueName: \"kubernetes.io/projected/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-kube-api-access-scvt6\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.416037 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.415957    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-podinfo\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.516595 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.516552    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scvt6\" (UniqueName: \"kubernetes.io/projected/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-kube-api-access-scvt6\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.516595 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.516595    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-podinfo\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.516886 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.516617    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-envoy\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.516886 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.516634    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-data\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.516886 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.516671    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istiod-ca-cert\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.516886 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.516705    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-token\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.516886 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.516744    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-workload-socket\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.516886 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.516772    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-workload-certs\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.516886 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.516840    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-credential-socket\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.517254 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.517230    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-workload-socket\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.517322 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.517262    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-data\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.517322 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.517307    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-credential-socket\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.517471 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.517447    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-workload-certs\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.517528 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.517483    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istiod-ca-cert\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.519486 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.519465    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-envoy\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.519601 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.519585    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-podinfo\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.525878 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.525857    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-token\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.526099 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.526078    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scvt6\" (UniqueName: \"kubernetes.io/projected/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-kube-api-access-scvt6\") pod \"e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") " pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.670723 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.670641    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:04.811180 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.811154    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"]
Jul 07 19:21:04.813598 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:21:04.813566    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1ea5a2_ca86_49cf_9f1b_bf0c81b4a5b8.slice/crio-e8e606b68c41899f365a786e407b7292c1479674a4a56fe9ad2c309997a19e09 WatchSource:0}: Error finding container e8e606b68c41899f365a786e407b7292c1479674a4a56fe9ad2c309997a19e09: Status 404 returned error can't find the container with id e8e606b68c41899f365a786e407b7292c1479674a4a56fe9ad2c309997a19e09
Jul 07 19:21:04.815989 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.815953    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:21:04.816078 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.816042    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:21:04.816126 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:04.816091    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:21:05.230280 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:05.230249    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw" event={"ID":"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8","Type":"ContainerStarted","Data":"b1bd8f8e215bfc79d26aa64383e208681f8f99cb7f3c3de87f6ee193cad443e5"}
Jul 07 19:21:05.230479 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:05.230300    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw" event={"ID":"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8","Type":"ContainerStarted","Data":"e8e606b68c41899f365a786e407b7292c1479674a4a56fe9ad2c309997a19e09"}
Jul 07 19:21:05.256652 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:05.256606    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw" podStartSLOduration=1.256590349 podStartE2EDuration="1.256590349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:21:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:21:05.253362675 +0000 UTC m=+1814.412702511" watchObservedRunningTime="2026-07-07 19:21:05.256590349 +0000 UTC m=+1814.415930241"
Jul 07 19:21:05.671683 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:05.671596    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:05.676496 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:05.676469    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:06.235484 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:06.235451    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:06.236511 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:06.236491    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:07.219980 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:07.219956    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:21:07.343928 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:07.343890    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"]
Jul 07 19:21:07.348166 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:07.348139    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:21:07.350932 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:07.350910    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-c575f8-serving-cert\""
Jul 07 19:21:07.363660 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:07.363637    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"]
Jul 07 19:21:07.445628 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:07.445593    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj\" (UID: \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\") " pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:21:07.445791 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:07.445710    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgp2t\" (UniqueName: \"kubernetes.io/projected/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-kube-api-access-vgp2t\") pod \"maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj\" (UID: \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\") " pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:21:07.445791 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:07.445740    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-maas-api-tls\") pod \"maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj\" (UID: \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\") " pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:21:07.546357 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:07.546327    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj\" (UID: \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\") " pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:21:07.546571 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:07.546396    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgp2t\" (UniqueName: \"kubernetes.io/projected/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-kube-api-access-vgp2t\") pod \"maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj\" (UID: \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\") " pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:21:07.546571 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:07.546416    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-maas-api-tls\") pod \"maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj\" (UID: \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\") " pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:21:07.546571 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:21:07.546513    2554 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-c575f8-serving-cert: secret "maas-api-e2e-inf-b-c575f8-serving-cert" not found
Jul 07 19:21:07.546571 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:21:07.546567    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-maas-api-tls podName:1ef8d1d7-aacf-48c5-8b21-87a9ca15b264 nodeName:}" failed. No retries permitted until 2026-07-07 19:21:08.04655083 +0000 UTC m=+1817.205890634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-maas-api-tls") pod "maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj" (UID: "1ef8d1d7-aacf-48c5-8b21-87a9ca15b264") : secret "maas-api-e2e-inf-b-c575f8-serving-cert" not found
Jul 07 19:21:07.547094 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:07.547068    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj\" (UID: \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\") " pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:21:07.559452 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:07.559429    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgp2t\" (UniqueName: \"kubernetes.io/projected/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-kube-api-access-vgp2t\") pod \"maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj\" (UID: \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\") " pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:21:08.052771 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:08.052735    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-maas-api-tls\") pod \"maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj\" (UID: \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\") " pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:21:08.055082 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:08.055058    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-maas-api-tls\") pod \"maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj\" (UID: \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\") " pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:21:08.260454 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:08.260422    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:21:08.447526 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:08.447500    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"]
Jul 07 19:21:08.450045 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:21:08.450018    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ef8d1d7_aacf_48c5_8b21_87a9ca15b264.slice/crio-43d64fa4363eaf4ae47b6dac1b047e07f48d67c90006f95b98f927911956d50d WatchSource:0}: Error finding container 43d64fa4363eaf4ae47b6dac1b047e07f48d67c90006f95b98f927911956d50d: Status 404 returned error can't find the container with id 43d64fa4363eaf4ae47b6dac1b047e07f48d67c90006f95b98f927911956d50d
Jul 07 19:21:09.255182 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:09.255145    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj" event={"ID":"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264","Type":"ContainerStarted","Data":"c03eeba2d8a568b649255b76df129400e971c070d4753b40fc92e07fe0eb47a2"}
Jul 07 19:21:09.255360 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:09.255206    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj" event={"ID":"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264","Type":"ContainerStarted","Data":"43d64fa4363eaf4ae47b6dac1b047e07f48d67c90006f95b98f927911956d50d"}
Jul 07 19:21:09.255408 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:09.255357    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:21:14.230999 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:14.230955    2554 patch_prober.go:28] interesting pod/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 19:21:14.231442 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:14.231032    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj" podUID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 19:21:15.271196 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:15.271165    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:21:15.293107 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:15.293051    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj" podStartSLOduration=7.936932279 podStartE2EDuration="8.293035957s" totalImagesPullingTime="356.103678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:21:09.277282373 +0000 UTC m=+1818.436622218" watchObservedRunningTime="2026-07-07 19:21:15.293035957 +0000 UTC m=+1824.452375802"
Jul 07 19:21:16.299455 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:16.299424    2554 generic.go:356] "Generic (PLEG): container finished" podID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerID="007aa430636ee16f7af0a2fae5a1051abfad5c4e18e4b0e3e53c99c0e7e545b8" exitCode=0
Jul 07 19:21:16.299868 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:16.299500    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj" event={"ID":"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615","Type":"ContainerDied","Data":"007aa430636ee16f7af0a2fae5a1051abfad5c4e18e4b0e3e53c99c0e7e545b8"}
Jul 07 19:21:16.300022 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:16.300005    2554 scope.go:117] "RemoveContainer" containerID="007aa430636ee16f7af0a2fae5a1051abfad5c4e18e4b0e3e53c99c0e7e545b8"
Jul 07 19:21:16.301027 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:16.300999    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:21:16.301093 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:16.301075    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:21:16.301132 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:16.301120    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:21:17.310075 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:17.310015    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj" event={"ID":"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615","Type":"ContainerStarted","Data":"7a9a6935e9b28293fe50379acabd7d490eaf933c8d78f0f7a7bef0daa443de19"}
Jul 07 19:21:17.726941 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:17.726904    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:21:17.727112 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:17.726977    2554 patch_prober.go:28] interesting pod/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 07 19:21:17.727112 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:17.727040    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj" podUID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 07 19:21:18.726693 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:18.726658    2554 patch_prober.go:28] interesting pod/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 07 19:21:18.727177 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:18.726729    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj" podUID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 07 19:21:19.727459 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:19.727419    2554 patch_prober.go:28] interesting pod/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 07 19:21:19.727881 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:19.727483    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj" podUID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 07 19:21:20.726612 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:20.726578    2554 patch_prober.go:28] interesting pod/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 07 19:21:20.726792 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:20.726633    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj" podUID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 07 19:21:21.644726 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:21.644119    2554 patch_prober.go:28] interesting pod/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": read tcp 10.133.0.2:38454->10.133.0.60:15021: read: connection reset by peer" start-of-body=
Jul 07 19:21:21.644726 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:21.644189    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw" podUID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": read tcp 10.133.0.2:38454->10.133.0.60:15021: read: connection reset by peer"
Jul 07 19:21:21.730733 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:21.730703    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:21:21.731001 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:21.730983    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:21:21.731737 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:21.731709    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:21:22.338661 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:22.338631    2554 generic.go:356] "Generic (PLEG): container finished" podID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerID="b1bd8f8e215bfc79d26aa64383e208681f8f99cb7f3c3de87f6ee193cad443e5" exitCode=0
Jul 07 19:21:22.338863 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:22.338703    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw" event={"ID":"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8","Type":"ContainerDied","Data":"b1bd8f8e215bfc79d26aa64383e208681f8f99cb7f3c3de87f6ee193cad443e5"}
Jul 07 19:21:22.339224 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:22.339206    2554 scope.go:117] "RemoveContainer" containerID="b1bd8f8e215bfc79d26aa64383e208681f8f99cb7f3c3de87f6ee193cad443e5"
Jul 07 19:21:22.340147 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:22.340126    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:21:22.340213 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:22.340198    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:21:22.340250 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:22.340229    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:21:23.345062 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:23.345030    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw" event={"ID":"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8","Type":"ContainerStarted","Data":"6bafdd88047c338a1ed66ad30afc9a67738dfec4e843692605ee571429072fd5"}
Jul 07 19:21:23.671865 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:23.671008    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:23.671865 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:23.671441    2554 patch_prober.go:28] interesting pod/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 07 19:21:23.671865 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:23.671489    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw" podUID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 07 19:21:24.671823 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:24.671768    2554 patch_prober.go:28] interesting pod/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 07 19:21:24.672297 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:24.671860    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw" podUID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 07 19:21:25.671256 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:25.671210    2554 patch_prober.go:28] interesting pod/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 07 19:21:25.671472 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:25.671294    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw" podUID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 07 19:21:26.671621 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:26.671576    2554 patch_prober.go:28] interesting pod/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 07 19:21:26.672156 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:26.671653    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw" podUID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 07 19:21:27.675015 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:27.674981    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:27.675431 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:27.675249    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:21:27.676122 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:21:27.676102    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:22:22.658446 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:22.657872    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"]
Jul 07 19:22:22.658446 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:22.658152    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls" podUID="bc2d3658-f81f-4bdd-86eb-e3483ee680bf" containerName="maas-api" containerID="cri-o://c29e0fbbaf9ac01017194e86b8fcf9c08633d58c4c5b7aeb5ba691519d3e3b44" gracePeriod=30
Jul 07 19:22:22.908091 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:22.908069    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:22:23.100620 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.100590    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-openshift-service-ca\") pod \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\" (UID: \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\") "
Jul 07 19:22:23.100812 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.100671    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-maas-api-tls\") pod \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\" (UID: \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\") "
Jul 07 19:22:23.100812 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.100728    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clhbl\" (UniqueName: \"kubernetes.io/projected/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-kube-api-access-clhbl\") pod \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\" (UID: \"bc2d3658-f81f-4bdd-86eb-e3483ee680bf\") "
Jul 07 19:22:23.100942 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.100919    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc2d3658-f81f-4bdd-86eb-e3483ee680bf" (UID: "bc2d3658-f81f-4bdd-86eb-e3483ee680bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:22:23.102644 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.102620    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc2d3658-f81f-4bdd-86eb-e3483ee680bf" (UID: "bc2d3658-f81f-4bdd-86eb-e3483ee680bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:22:23.102745 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.102703    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-kube-api-access-clhbl" (OuterVolumeSpecName: "kube-api-access-clhbl") pod "bc2d3658-f81f-4bdd-86eb-e3483ee680bf" (UID: "bc2d3658-f81f-4bdd-86eb-e3483ee680bf"). InnerVolumeSpecName "kube-api-access-clhbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:22:23.201980 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.201944    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:22:23.201980 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.201975    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clhbl\" (UniqueName: \"kubernetes.io/projected/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-kube-api-access-clhbl\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:22:23.202210 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.201990    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc2d3658-f81f-4bdd-86eb-e3483ee680bf-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:22:23.667008 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.666970    2554 generic.go:356] "Generic (PLEG): container finished" podID="bc2d3658-f81f-4bdd-86eb-e3483ee680bf" containerID="c29e0fbbaf9ac01017194e86b8fcf9c08633d58c4c5b7aeb5ba691519d3e3b44" exitCode=0
Jul 07 19:22:23.667008 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.667012    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"
Jul 07 19:22:23.667489 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.667062    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls" event={"ID":"bc2d3658-f81f-4bdd-86eb-e3483ee680bf","Type":"ContainerDied","Data":"c29e0fbbaf9ac01017194e86b8fcf9c08633d58c4c5b7aeb5ba691519d3e3b44"}
Jul 07 19:22:23.667489 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.667106    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls" event={"ID":"bc2d3658-f81f-4bdd-86eb-e3483ee680bf","Type":"ContainerDied","Data":"76d889784c90c371e566728b96a5223dbc4c2547c4f6054e0b2ebeb3537577f1"}
Jul 07 19:22:23.667489 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.667131    2554 scope.go:117] "RemoveContainer" containerID="c29e0fbbaf9ac01017194e86b8fcf9c08633d58c4c5b7aeb5ba691519d3e3b44"
Jul 07 19:22:23.675942 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.675924    2554 scope.go:117] "RemoveContainer" containerID="c29e0fbbaf9ac01017194e86b8fcf9c08633d58c4c5b7aeb5ba691519d3e3b44"
Jul 07 19:22:23.676198 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:22:23.676178    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c29e0fbbaf9ac01017194e86b8fcf9c08633d58c4c5b7aeb5ba691519d3e3b44\": container with ID starting with c29e0fbbaf9ac01017194e86b8fcf9c08633d58c4c5b7aeb5ba691519d3e3b44 not found: ID does not exist" containerID="c29e0fbbaf9ac01017194e86b8fcf9c08633d58c4c5b7aeb5ba691519d3e3b44"
Jul 07 19:22:23.676249 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.676206    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c29e0fbbaf9ac01017194e86b8fcf9c08633d58c4c5b7aeb5ba691519d3e3b44"} err="failed to get container status \"c29e0fbbaf9ac01017194e86b8fcf9c08633d58c4c5b7aeb5ba691519d3e3b44\": rpc error: code = NotFound desc = could not find container \"c29e0fbbaf9ac01017194e86b8fcf9c08633d58c4c5b7aeb5ba691519d3e3b44\": container with ID starting with c29e0fbbaf9ac01017194e86b8fcf9c08633d58c4c5b7aeb5ba691519d3e3b44 not found: ID does not exist"
Jul 07 19:22:23.686243 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.686214    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"]
Jul 07 19:22:23.691035 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:23.691016    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-54b9e6-55fbc59c87-2znls"]
Jul 07 19:22:25.474766 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:22:25.474732    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc2d3658-f81f-4bdd-86eb-e3483ee680bf" path="/var/lib/kubelet/pods/bc2d3658-f81f-4bdd-86eb-e3483ee680bf/volumes"
Jul 07 19:23:04.619660 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:04.619625    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"]
Jul 07 19:23:04.620259 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:04.619930    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj" podUID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerName="istio-proxy" containerID="cri-o://7a9a6935e9b28293fe50379acabd7d490eaf933c8d78f0f7a7bef0daa443de19" gracePeriod=30
Jul 07 19:23:05.646769 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:05.646729    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"]
Jul 07 19:23:05.647290 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:05.647012    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj" podUID="1ef8d1d7-aacf-48c5-8b21-87a9ca15b264" containerName="maas-api" containerID="cri-o://c03eeba2d8a568b649255b76df129400e971c070d4753b40fc92e07fe0eb47a2" gracePeriod=30
Jul 07 19:23:05.886349 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:05.886318    2554 generic.go:356] "Generic (PLEG): container finished" podID="1ef8d1d7-aacf-48c5-8b21-87a9ca15b264" containerID="c03eeba2d8a568b649255b76df129400e971c070d4753b40fc92e07fe0eb47a2" exitCode=0
Jul 07 19:23:05.886485 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:05.886389    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj" event={"ID":"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264","Type":"ContainerDied","Data":"c03eeba2d8a568b649255b76df129400e971c070d4753b40fc92e07fe0eb47a2"}
Jul 07 19:23:05.886485 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:05.886438    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj" event={"ID":"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264","Type":"ContainerDied","Data":"43d64fa4363eaf4ae47b6dac1b047e07f48d67c90006f95b98f927911956d50d"}
Jul 07 19:23:05.886485 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:05.886454    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43d64fa4363eaf4ae47b6dac1b047e07f48d67c90006f95b98f927911956d50d"
Jul 07 19:23:05.902629 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:05.902574    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:23:06.011893 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:06.011863    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-maas-api-tls\") pod \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\" (UID: \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\") "
Jul 07 19:23:06.012060 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:06.011905    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgp2t\" (UniqueName: \"kubernetes.io/projected/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-kube-api-access-vgp2t\") pod \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\" (UID: \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\") "
Jul 07 19:23:06.012060 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:06.011939    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-openshift-service-ca\") pod \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\" (UID: \"1ef8d1d7-aacf-48c5-8b21-87a9ca15b264\") "
Jul 07 19:23:06.012382 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:06.012355    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ef8d1d7-aacf-48c5-8b21-87a9ca15b264" (UID: "1ef8d1d7-aacf-48c5-8b21-87a9ca15b264"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:23:06.013986 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:06.013959    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ef8d1d7-aacf-48c5-8b21-87a9ca15b264" (UID: "1ef8d1d7-aacf-48c5-8b21-87a9ca15b264"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:23:06.014096 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:06.014076    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-kube-api-access-vgp2t" (OuterVolumeSpecName: "kube-api-access-vgp2t") pod "1ef8d1d7-aacf-48c5-8b21-87a9ca15b264" (UID: "1ef8d1d7-aacf-48c5-8b21-87a9ca15b264"). InnerVolumeSpecName "kube-api-access-vgp2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:23:06.112814 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:06.112778    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:06.112814 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:06.112819    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgp2t\" (UniqueName: \"kubernetes.io/projected/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-kube-api-access-vgp2t\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:06.113018 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:06.112829    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:06.733242 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:06.733204    2554 patch_prober.go:28] interesting pod/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 19:23:06.733602 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:06.733268    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj" podUID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 19:23:06.891935 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:06.891905    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"
Jul 07 19:23:06.916655 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:06.916630    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"]
Jul 07 19:23:06.923819 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:06.923786    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c575f8-7b7dc9f74f-4v8cj"]
Jul 07 19:23:07.475959 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:07.475917    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ef8d1d7-aacf-48c5-8b21-87a9ca15b264" path="/var/lib/kubelet/pods/1ef8d1d7-aacf-48c5-8b21-87a9ca15b264/volumes"
Jul 07 19:23:09.878271 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.878248    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:23:09.907867 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.907766    2554 generic.go:356] "Generic (PLEG): container finished" podID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerID="7a9a6935e9b28293fe50379acabd7d490eaf933c8d78f0f7a7bef0daa443de19" exitCode=0
Jul 07 19:23:09.907867 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.907831    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"
Jul 07 19:23:09.907867 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.907832    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj" event={"ID":"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615","Type":"ContainerDied","Data":"7a9a6935e9b28293fe50379acabd7d490eaf933c8d78f0f7a7bef0daa443de19"}
Jul 07 19:23:09.908146 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.907899    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj" event={"ID":"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615","Type":"ContainerDied","Data":"e36718391690dc210239a91625b44ff667e8c0c6c34960be13753cf53b764ac0"}
Jul 07 19:23:09.908146 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.907929    2554 scope.go:117] "RemoveContainer" containerID="7a9a6935e9b28293fe50379acabd7d490eaf933c8d78f0f7a7bef0daa443de19"
Jul 07 19:23:09.918420 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.918403    2554 scope.go:117] "RemoveContainer" containerID="007aa430636ee16f7af0a2fae5a1051abfad5c4e18e4b0e3e53c99c0e7e545b8"
Jul 07 19:23:09.926286 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.926267    2554 scope.go:117] "RemoveContainer" containerID="7a9a6935e9b28293fe50379acabd7d490eaf933c8d78f0f7a7bef0daa443de19"
Jul 07 19:23:09.926554 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:09.926532    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a9a6935e9b28293fe50379acabd7d490eaf933c8d78f0f7a7bef0daa443de19\": container with ID starting with 7a9a6935e9b28293fe50379acabd7d490eaf933c8d78f0f7a7bef0daa443de19 not found: ID does not exist" containerID="7a9a6935e9b28293fe50379acabd7d490eaf933c8d78f0f7a7bef0daa443de19"
Jul 07 19:23:09.926612 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.926568    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a9a6935e9b28293fe50379acabd7d490eaf933c8d78f0f7a7bef0daa443de19"} err="failed to get container status \"7a9a6935e9b28293fe50379acabd7d490eaf933c8d78f0f7a7bef0daa443de19\": rpc error: code = NotFound desc = could not find container \"7a9a6935e9b28293fe50379acabd7d490eaf933c8d78f0f7a7bef0daa443de19\": container with ID starting with 7a9a6935e9b28293fe50379acabd7d490eaf933c8d78f0f7a7bef0daa443de19 not found: ID does not exist"
Jul 07 19:23:09.926612 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.926592    2554 scope.go:117] "RemoveContainer" containerID="007aa430636ee16f7af0a2fae5a1051abfad5c4e18e4b0e3e53c99c0e7e545b8"
Jul 07 19:23:09.926920 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:09.926897    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"007aa430636ee16f7af0a2fae5a1051abfad5c4e18e4b0e3e53c99c0e7e545b8\": container with ID starting with 007aa430636ee16f7af0a2fae5a1051abfad5c4e18e4b0e3e53c99c0e7e545b8 not found: ID does not exist" containerID="007aa430636ee16f7af0a2fae5a1051abfad5c4e18e4b0e3e53c99c0e7e545b8"
Jul 07 19:23:09.926976 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.926927    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"007aa430636ee16f7af0a2fae5a1051abfad5c4e18e4b0e3e53c99c0e7e545b8"} err="failed to get container status \"007aa430636ee16f7af0a2fae5a1051abfad5c4e18e4b0e3e53c99c0e7e545b8\": rpc error: code = NotFound desc = could not find container \"007aa430636ee16f7af0a2fae5a1051abfad5c4e18e4b0e3e53c99c0e7e545b8\": container with ID starting with 007aa430636ee16f7af0a2fae5a1051abfad5c4e18e4b0e3e53c99c0e7e545b8 not found: ID does not exist"
Jul 07 19:23:09.948184 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948160    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-workload-socket\") pod \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") "
Jul 07 19:23:09.948282 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948210    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-data\") pod \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") "
Jul 07 19:23:09.948282 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948239    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-envoy\") pod \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") "
Jul 07 19:23:09.948282 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948257    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-credential-socket\") pod \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") "
Jul 07 19:23:09.948282 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948282    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52rfk\" (UniqueName: \"kubernetes.io/projected/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-kube-api-access-52rfk\") pod \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") "
Jul 07 19:23:09.948489 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948315    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-podinfo\") pod \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") "
Jul 07 19:23:09.948489 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948339    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-workload-certs\") pod \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") "
Jul 07 19:23:09.948489 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948380    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istiod-ca-cert\") pod \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") "
Jul 07 19:23:09.948489 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948454    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-token\") pod \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\" (UID: \"af7a2df9-3d69-4f71-b1b6-fed4bc3a3615\") "
Jul 07 19:23:09.948708 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948469    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" (UID: "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:09.948708 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948675    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" (UID: "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:09.948874 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948851    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:09.948941 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948889    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:09.948941 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948853    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" (UID: "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:09.948941 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.948920    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" (UID: "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:23:09.949190 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.949171    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-data" (OuterVolumeSpecName: "istio-data") pod "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" (UID: "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:09.950889 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.950867    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" (UID: "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:09.950970 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.950927    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" (UID: "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:23:09.950970 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.950947    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-token" (OuterVolumeSpecName: "istio-token") pod "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" (UID: "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:23:09.951053 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:09.950968    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-kube-api-access-52rfk" (OuterVolumeSpecName: "kube-api-access-52rfk") pod "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" (UID: "af7a2df9-3d69-4f71-b1b6-fed4bc3a3615"). InnerVolumeSpecName "kube-api-access-52rfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:23:10.049764 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:10.049727    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:10.049764 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:10.049758    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:10.049764 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:10.049767    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:10.050011 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:10.049775    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:10.050011 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:10.049782    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:10.050011 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:10.049790    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:10.050011 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:10.049827    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52rfk\" (UniqueName: \"kubernetes.io/projected/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615-kube-api-access-52rfk\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:10.235594 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:10.235559    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"]
Jul 07 19:23:10.237417 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:10.237394    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-54b9e6-openshift-default-785dfb67ff-4jnzj"]
Jul 07 19:23:11.475158 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:11.475123    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" path="/var/lib/kubelet/pods/af7a2df9-3d69-4f71-b1b6-fed4bc3a3615/volumes"
Jul 07 19:23:12.061666 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.061631    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"]
Jul 07 19:23:12.061942 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.061900    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw" podUID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerName="istio-proxy" containerID="cri-o://6bafdd88047c338a1ed66ad30afc9a67738dfec4e843692605ee571429072fd5" gracePeriod=30
Jul 07 19:23:12.677590 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.677554    2554 patch_prober.go:28] interesting pod/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 19:23:12.678048 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.677619    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw" podUID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 19:23:12.969137 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.969047    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"]
Jul 07 19:23:12.969570 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.969550    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ef8d1d7-aacf-48c5-8b21-87a9ca15b264" containerName="maas-api"
Jul 07 19:23:12.969660 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.969573    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ef8d1d7-aacf-48c5-8b21-87a9ca15b264" containerName="maas-api"
Jul 07 19:23:12.969660 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.969591    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc2d3658-f81f-4bdd-86eb-e3483ee680bf" containerName="maas-api"
Jul 07 19:23:12.969660 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.969600    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc2d3658-f81f-4bdd-86eb-e3483ee680bf" containerName="maas-api"
Jul 07 19:23:12.969660 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.969610    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerName="istio-proxy"
Jul 07 19:23:12.969660 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.969619    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerName="istio-proxy"
Jul 07 19:23:12.969660 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.969629    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerName="istio-proxy"
Jul 07 19:23:12.969660 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.969637    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerName="istio-proxy"
Jul 07 19:23:12.970047 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.969724    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc2d3658-f81f-4bdd-86eb-e3483ee680bf" containerName="maas-api"
Jul 07 19:23:12.970047 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.969740    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ef8d1d7-aacf-48c5-8b21-87a9ca15b264" containerName="maas-api"
Jul 07 19:23:12.970047 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.969750    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerName="istio-proxy"
Jul 07 19:23:12.974413 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.974391    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:12.976935 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.976911    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d34566-openshift-default-dockercfg-jjgvp\""
Jul 07 19:23:12.984289 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:12.984258    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"]
Jul 07 19:23:13.078372 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.078323    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-credential-socket\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.078612 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.078589    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-envoy\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.078776 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.078670    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-workload-socket\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.078776 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.078707    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-token\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.078776 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.078738    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-workload-certs\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.078776 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.078763    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-data\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.079044 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.078836    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh6zc\" (UniqueName: \"kubernetes.io/projected/043ad699-d9e6-4cf6-ab54-2756272095c4-kube-api-access-rh6zc\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.079044 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.078874    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-podinfo\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.079044 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.078939    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/043ad699-d9e6-4cf6-ab54-2756272095c4-istiod-ca-cert\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.180435 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.180396    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/043ad699-d9e6-4cf6-ab54-2756272095c4-istiod-ca-cert\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.180628 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.180451    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-credential-socket\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.180628 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.180469    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-envoy\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.180628 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.180506    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-workload-socket\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.180628 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.180528    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-token\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.180628 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.180553    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-workload-certs\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.180628 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.180577    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-data\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.180628 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.180629    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh6zc\" (UniqueName: \"kubernetes.io/projected/043ad699-d9e6-4cf6-ab54-2756272095c4-kube-api-access-rh6zc\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.181037 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.180708    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-podinfo\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.181037 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.180908    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-credential-socket\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.181037 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.180944    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-workload-certs\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.181245 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.181116    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-data\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.181245 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.181160    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-workload-socket\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.181369 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.181345    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/043ad699-d9e6-4cf6-ab54-2756272095c4-istiod-ca-cert\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.182792 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.182774    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-envoy\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.183027 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.183010    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-podinfo\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.190886 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.190860    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-token\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.191235 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.191216    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh6zc\" (UniqueName: \"kubernetes.io/projected/043ad699-d9e6-4cf6-ab54-2756272095c4-kube-api-access-rh6zc\") pod \"e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") " pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.286343 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.286310    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:13.428733 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.428706    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"]
Jul 07 19:23:13.430816 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:23:13.430772    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043ad699_d9e6_4cf6_ab54_2756272095c4.slice/crio-3246427425f7ca6b4465937108a4fca054f23250222a7a429f14e657be31375a WatchSource:0}: Error finding container 3246427425f7ca6b4465937108a4fca054f23250222a7a429f14e657be31375a: Status 404 returned error can't find the container with id 3246427425f7ca6b4465937108a4fca054f23250222a7a429f14e657be31375a
Jul 07 19:23:13.433025 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.432993    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:13.433110 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.433073    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:13.433181 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.433119    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:13.930212 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.930172    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf" event={"ID":"043ad699-d9e6-4cf6-ab54-2756272095c4","Type":"ContainerStarted","Data":"8f5365b7a425476d2f2d6e18bba3dbb4fb217758ecf16a1444f68fb4d2986341"}
Jul 07 19:23:13.930654 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.930242    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf" event={"ID":"043ad699-d9e6-4cf6-ab54-2756272095c4","Type":"ContainerStarted","Data":"3246427425f7ca6b4465937108a4fca054f23250222a7a429f14e657be31375a"}
Jul 07 19:23:13.951965 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:13.951921    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf" podStartSLOduration=1.951907076 podStartE2EDuration="1.951907076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:23:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:23:13.950948247 +0000 UTC m=+1943.110288108" watchObservedRunningTime="2026-07-07 19:23:13.951907076 +0000 UTC m=+1943.111246903"
Jul 07 19:23:14.286966 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:14.286932    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:14.291615 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:14.291591    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:14.935717 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:14.935678    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:14.936787 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:14.936765    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:16.186193 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.186155    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"]
Jul 07 19:23:16.186852 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.186828    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="af7a2df9-3d69-4f71-b1b6-fed4bc3a3615" containerName="istio-proxy"
Jul 07 19:23:16.190083 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.190063    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:16.192731 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.192709    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-d34566-serving-cert\""
Jul 07 19:23:16.209295 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.209271    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"]
Jul 07 19:23:16.311728 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.311692    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efa58738-3bb0-46a0-9313-889d8623d47d-maas-api-tls\") pod \"maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n\" (UID: \"efa58738-3bb0-46a0-9313-889d8623d47d\") " pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:16.311941 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.311751    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65qnt\" (UniqueName: \"kubernetes.io/projected/efa58738-3bb0-46a0-9313-889d8623d47d-kube-api-access-65qnt\") pod \"maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n\" (UID: \"efa58738-3bb0-46a0-9313-889d8623d47d\") " pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:16.311941 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.311850    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa58738-3bb0-46a0-9313-889d8623d47d-openshift-service-ca\") pod \"maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n\" (UID: \"efa58738-3bb0-46a0-9313-889d8623d47d\") " pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:16.413388 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.413351    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa58738-3bb0-46a0-9313-889d8623d47d-openshift-service-ca\") pod \"maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n\" (UID: \"efa58738-3bb0-46a0-9313-889d8623d47d\") " pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:16.413597 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.413443    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efa58738-3bb0-46a0-9313-889d8623d47d-maas-api-tls\") pod \"maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n\" (UID: \"efa58738-3bb0-46a0-9313-889d8623d47d\") " pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:16.413597 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.413488    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65qnt\" (UniqueName: \"kubernetes.io/projected/efa58738-3bb0-46a0-9313-889d8623d47d-kube-api-access-65qnt\") pod \"maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n\" (UID: \"efa58738-3bb0-46a0-9313-889d8623d47d\") " pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:16.413725 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:16.413596    2554 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-d34566-serving-cert: secret "maas-api-e2e-api-a-d34566-serving-cert" not found
Jul 07 19:23:16.413725 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:16.413658    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efa58738-3bb0-46a0-9313-889d8623d47d-maas-api-tls podName:efa58738-3bb0-46a0-9313-889d8623d47d nodeName:}" failed. No retries permitted until 2026-07-07 19:23:16.913641656 +0000 UTC m=+1946.072981460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/efa58738-3bb0-46a0-9313-889d8623d47d-maas-api-tls") pod "maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n" (UID: "efa58738-3bb0-46a0-9313-889d8623d47d") : secret "maas-api-e2e-api-a-d34566-serving-cert" not found
Jul 07 19:23:16.414133 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.414110    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa58738-3bb0-46a0-9313-889d8623d47d-openshift-service-ca\") pod \"maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n\" (UID: \"efa58738-3bb0-46a0-9313-889d8623d47d\") " pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:16.425192 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.425167    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65qnt\" (UniqueName: \"kubernetes.io/projected/efa58738-3bb0-46a0-9313-889d8623d47d-kube-api-access-65qnt\") pod \"maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n\" (UID: \"efa58738-3bb0-46a0-9313-889d8623d47d\") " pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:16.918946 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.918913    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efa58738-3bb0-46a0-9313-889d8623d47d-maas-api-tls\") pod \"maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n\" (UID: \"efa58738-3bb0-46a0-9313-889d8623d47d\") " pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:16.921375 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:16.921343    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efa58738-3bb0-46a0-9313-889d8623d47d-maas-api-tls\") pod \"maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n\" (UID: \"efa58738-3bb0-46a0-9313-889d8623d47d\") " pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:17.100614 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.100576    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:17.251925 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.251874    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"]
Jul 07 19:23:17.254140 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:23:17.253127    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa58738_3bb0_46a0_9313_889d8623d47d.slice/crio-4b93f2cff0c284b01053f1a0e80e51c5bebdde1f3f9277e246b2a84539542624 WatchSource:0}: Error finding container 4b93f2cff0c284b01053f1a0e80e51c5bebdde1f3f9277e246b2a84539542624: Status 404 returned error can't find the container with id 4b93f2cff0c284b01053f1a0e80e51c5bebdde1f3f9277e246b2a84539542624
Jul 07 19:23:17.325500 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.325467    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:23:17.423910 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.423874    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scvt6\" (UniqueName: \"kubernetes.io/projected/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-kube-api-access-scvt6\") pod \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") "
Jul 07 19:23:17.424103 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.423939    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istiod-ca-cert\") pod \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") "
Jul 07 19:23:17.424103 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.423961    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-envoy\") pod \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") "
Jul 07 19:23:17.424103 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.423987    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-data\") pod \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") "
Jul 07 19:23:17.424103 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.424030    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-token\") pod \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") "
Jul 07 19:23:17.424103 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.424049    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-workload-certs\") pod \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") "
Jul 07 19:23:17.424385 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.424111    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-workload-socket\") pod \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") "
Jul 07 19:23:17.424385 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.424136    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-podinfo\") pod \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") "
Jul 07 19:23:17.424385 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.424173    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-credential-socket\") pod \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\" (UID: \"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8\") "
Jul 07 19:23:17.424385 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.424370    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" (UID: "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:17.424607 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.424473    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" (UID: "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:17.424607 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.424502    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:17.424722 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.424692    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" (UID: "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:17.424894 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.424873    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" (UID: "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:23:17.426262 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.426235    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" (UID: "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:23:17.426385 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.426337    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" (UID: "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:17.426625 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.426600    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" (UID: "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:17.426625 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.426612    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-kube-api-access-scvt6" (OuterVolumeSpecName: "kube-api-access-scvt6") pod "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" (UID: "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8"). InnerVolumeSpecName "kube-api-access-scvt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:23:17.426779 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.426638    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" (UID: "6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:23:17.525744 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.525709    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:17.525744 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.525739    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scvt6\" (UniqueName: \"kubernetes.io/projected/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-kube-api-access-scvt6\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:17.525952 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.525751    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:17.525952 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.525765    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:17.525952 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.525774    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:17.525952 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.525781    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:17.525952 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.525789    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:17.525952 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.525824    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:17.952617 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.952507    2554 generic.go:356] "Generic (PLEG): container finished" podID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerID="6bafdd88047c338a1ed66ad30afc9a67738dfec4e843692605ee571429072fd5" exitCode=0
Jul 07 19:23:17.952617 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.952552    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"
Jul 07 19:23:17.952617 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.952606    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw" event={"ID":"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8","Type":"ContainerDied","Data":"6bafdd88047c338a1ed66ad30afc9a67738dfec4e843692605ee571429072fd5"}
Jul 07 19:23:17.952922 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.952663    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw" event={"ID":"6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8","Type":"ContainerDied","Data":"e8e606b68c41899f365a786e407b7292c1479674a4a56fe9ad2c309997a19e09"}
Jul 07 19:23:17.952922 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.952694    2554 scope.go:117] "RemoveContainer" containerID="6bafdd88047c338a1ed66ad30afc9a67738dfec4e843692605ee571429072fd5"
Jul 07 19:23:17.954344 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.954316    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n" event={"ID":"efa58738-3bb0-46a0-9313-889d8623d47d","Type":"ContainerStarted","Data":"e7b04b4f1ad20a04ea977559a7839e07ef6f30b2406b1ad20a6393d894f6f62d"}
Jul 07 19:23:17.954471 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.954360    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n" event={"ID":"efa58738-3bb0-46a0-9313-889d8623d47d","Type":"ContainerStarted","Data":"4b93f2cff0c284b01053f1a0e80e51c5bebdde1f3f9277e246b2a84539542624"}
Jul 07 19:23:17.954471 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.954397    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:17.961385 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.961366    2554 scope.go:117] "RemoveContainer" containerID="b1bd8f8e215bfc79d26aa64383e208681f8f99cb7f3c3de87f6ee193cad443e5"
Jul 07 19:23:17.969146 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.969129    2554 scope.go:117] "RemoveContainer" containerID="6bafdd88047c338a1ed66ad30afc9a67738dfec4e843692605ee571429072fd5"
Jul 07 19:23:17.969440 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:17.969409    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bafdd88047c338a1ed66ad30afc9a67738dfec4e843692605ee571429072fd5\": container with ID starting with 6bafdd88047c338a1ed66ad30afc9a67738dfec4e843692605ee571429072fd5 not found: ID does not exist" containerID="6bafdd88047c338a1ed66ad30afc9a67738dfec4e843692605ee571429072fd5"
Jul 07 19:23:17.969505 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.969446    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bafdd88047c338a1ed66ad30afc9a67738dfec4e843692605ee571429072fd5"} err="failed to get container status \"6bafdd88047c338a1ed66ad30afc9a67738dfec4e843692605ee571429072fd5\": rpc error: code = NotFound desc = could not find container \"6bafdd88047c338a1ed66ad30afc9a67738dfec4e843692605ee571429072fd5\": container with ID starting with 6bafdd88047c338a1ed66ad30afc9a67738dfec4e843692605ee571429072fd5 not found: ID does not exist"
Jul 07 19:23:17.969505 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.969473    2554 scope.go:117] "RemoveContainer" containerID="b1bd8f8e215bfc79d26aa64383e208681f8f99cb7f3c3de87f6ee193cad443e5"
Jul 07 19:23:17.969852 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:17.969763    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1bd8f8e215bfc79d26aa64383e208681f8f99cb7f3c3de87f6ee193cad443e5\": container with ID starting with b1bd8f8e215bfc79d26aa64383e208681f8f99cb7f3c3de87f6ee193cad443e5 not found: ID does not exist" containerID="b1bd8f8e215bfc79d26aa64383e208681f8f99cb7f3c3de87f6ee193cad443e5"
Jul 07 19:23:17.969852 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.969813    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1bd8f8e215bfc79d26aa64383e208681f8f99cb7f3c3de87f6ee193cad443e5"} err="failed to get container status \"b1bd8f8e215bfc79d26aa64383e208681f8f99cb7f3c3de87f6ee193cad443e5\": rpc error: code = NotFound desc = could not find container \"b1bd8f8e215bfc79d26aa64383e208681f8f99cb7f3c3de87f6ee193cad443e5\": container with ID starting with b1bd8f8e215bfc79d26aa64383e208681f8f99cb7f3c3de87f6ee193cad443e5 not found: ID does not exist"
Jul 07 19:23:17.972598 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.972573    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"]
Jul 07 19:23:17.977185 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.977162    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c575f8-openshift-default-66b494466c-w4pzw"]
Jul 07 19:23:17.994445 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:17.994400    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n" podStartSLOduration=1.615281268 podStartE2EDuration="1.994386859s" totalImagesPullingTime="379.105591ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:23:17.991175716 +0000 UTC m=+1947.150515553" watchObservedRunningTime="2026-07-07 19:23:17.994386859 +0000 UTC m=+1947.153726685"
Jul 07 19:23:19.475047 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:19.475014    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" path="/var/lib/kubelet/pods/6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8/volumes"
Jul 07 19:23:21.230731 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.230697    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"]
Jul 07 19:23:21.231619 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.231279    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerName="istio-proxy"
Jul 07 19:23:21.231619 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.231297    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerName="istio-proxy"
Jul 07 19:23:21.231619 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.231317    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerName="istio-proxy"
Jul 07 19:23:21.231619 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.231325    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerName="istio-proxy"
Jul 07 19:23:21.231619 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.231437    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerName="istio-proxy"
Jul 07 19:23:21.231619 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.231448    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f1ea5a2-ca86-49cf-9f1b-bf0c81b4a5b8" containerName="istio-proxy"
Jul 07 19:23:21.235571 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.235552    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.238761 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.238743    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-31280a-openshift-default-dockercfg-hdgfl\""
Jul 07 19:23:21.248340 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.248319    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"]
Jul 07 19:23:21.360331 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.360289    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-podinfo\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.360331 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.360330    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fe86dc7-376f-4513-a3cd-43fe102481e5-istiod-ca-cert\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.360588 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.360352    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-workload-certs\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.360588 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.360434    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7km29\" (UniqueName: \"kubernetes.io/projected/6fe86dc7-376f-4513-a3cd-43fe102481e5-kube-api-access-7km29\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.360588 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.360468    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-token\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.360588 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.360577    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-workload-socket\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.360756 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.360634    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-envoy\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.360756 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.360661    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-credential-socket\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.360756 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.360691    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-data\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.461535 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.461490    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7km29\" (UniqueName: \"kubernetes.io/projected/6fe86dc7-376f-4513-a3cd-43fe102481e5-kube-api-access-7km29\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.461723 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.461547    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-token\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.461723 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.461610    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-workload-socket\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.461723 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.461654    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-envoy\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.461723 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.461684    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-credential-socket\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.462006 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.461727    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-data\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.462006 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.461782    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-podinfo\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.462006 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.461911    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fe86dc7-376f-4513-a3cd-43fe102481e5-istiod-ca-cert\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.462006 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.461955    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-workload-certs\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.462513 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.462490    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-data\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.462648 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.462385    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-workload-socket\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.462760 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.462731    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-workload-certs\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.462969 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.462744    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-credential-socket\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.463658 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.463635    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fe86dc7-376f-4513-a3cd-43fe102481e5-istiod-ca-cert\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.471035 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.471007    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-envoy\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.471517 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.471492    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-token\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.473014 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.471833    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-podinfo\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.474155 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.474129    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7km29\" (UniqueName: \"kubernetes.io/projected/6fe86dc7-376f-4513-a3cd-43fe102481e5-kube-api-access-7km29\") pod \"e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") " pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.545834 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.545729    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:21.699885 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.699857    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"]
Jul 07 19:23:21.702631 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:23:21.702604    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe86dc7_376f_4513_a3cd_43fe102481e5.slice/crio-8ae759a74fb7651caa5a22659a3c0809bc5671c699b93fdc6c605b90d2520447 WatchSource:0}: Error finding container 8ae759a74fb7651caa5a22659a3c0809bc5671c699b93fdc6c605b90d2520447: Status 404 returned error can't find the container with id 8ae759a74fb7651caa5a22659a3c0809bc5671c699b93fdc6c605b90d2520447
Jul 07 19:23:21.705169 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.705139    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:21.705276 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.705217    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:21.705276 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.705264    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:21.976518 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.976481    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr" event={"ID":"6fe86dc7-376f-4513-a3cd-43fe102481e5","Type":"ContainerStarted","Data":"6af7a59e2ecd0773b12215fca7d5a3dc290ecce3b89950139a5cc82cebe064d0"}
Jul 07 19:23:21.976729 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:21.976543    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr" event={"ID":"6fe86dc7-376f-4513-a3cd-43fe102481e5","Type":"ContainerStarted","Data":"8ae759a74fb7651caa5a22659a3c0809bc5671c699b93fdc6c605b90d2520447"}
Jul 07 19:23:22.000850 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:22.000769    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr" podStartSLOduration=1.000746771 podStartE2EDuration="1.000746771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:23:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:23:21.999024104 +0000 UTC m=+1951.158363967" watchObservedRunningTime="2026-07-07 19:23:22.000746771 +0000 UTC m=+1951.160086599"
Jul 07 19:23:22.546410 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:22.546366    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:22.551848 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:22.551823    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:22.987906 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:22.987874    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:22.989067 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:22.989040    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:23.973082 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:23.973051    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:24.027996 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:24.027962    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"]
Jul 07 19:23:24.031816 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:24.031778    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:24.034666 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:24.034641    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-31280a-serving-cert\""
Jul 07 19:23:24.046459 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:24.046434    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"]
Jul 07 19:23:24.093227 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:24.093180    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00cbad1e-c7df-4b5e-9003-bda944cf09cd-openshift-service-ca\") pod \"maas-api-e2e-api-b-31280a-694f9dd499-4wpn7\" (UID: \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\") " pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:24.093415 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:24.093356    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttmvd\" (UniqueName: \"kubernetes.io/projected/00cbad1e-c7df-4b5e-9003-bda944cf09cd-kube-api-access-ttmvd\") pod \"maas-api-e2e-api-b-31280a-694f9dd499-4wpn7\" (UID: \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\") " pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:24.093497 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:24.093421    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00cbad1e-c7df-4b5e-9003-bda944cf09cd-maas-api-tls\") pod \"maas-api-e2e-api-b-31280a-694f9dd499-4wpn7\" (UID: \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\") " pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:24.195069 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:24.195033    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttmvd\" (UniqueName: \"kubernetes.io/projected/00cbad1e-c7df-4b5e-9003-bda944cf09cd-kube-api-access-ttmvd\") pod \"maas-api-e2e-api-b-31280a-694f9dd499-4wpn7\" (UID: \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\") " pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:24.195238 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:24.195089    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00cbad1e-c7df-4b5e-9003-bda944cf09cd-maas-api-tls\") pod \"maas-api-e2e-api-b-31280a-694f9dd499-4wpn7\" (UID: \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\") " pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:24.195238 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:24.195171    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00cbad1e-c7df-4b5e-9003-bda944cf09cd-openshift-service-ca\") pod \"maas-api-e2e-api-b-31280a-694f9dd499-4wpn7\" (UID: \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\") " pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:24.195330 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:24.195267    2554 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-31280a-serving-cert: secret "maas-api-e2e-api-b-31280a-serving-cert" not found
Jul 07 19:23:24.195382 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:24.195349    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00cbad1e-c7df-4b5e-9003-bda944cf09cd-maas-api-tls podName:00cbad1e-c7df-4b5e-9003-bda944cf09cd nodeName:}" failed. No retries permitted until 2026-07-07 19:23:24.695320714 +0000 UTC m=+1953.854660524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/00cbad1e-c7df-4b5e-9003-bda944cf09cd-maas-api-tls") pod "maas-api-e2e-api-b-31280a-694f9dd499-4wpn7" (UID: "00cbad1e-c7df-4b5e-9003-bda944cf09cd") : secret "maas-api-e2e-api-b-31280a-serving-cert" not found
Jul 07 19:23:24.195986 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:24.195946    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00cbad1e-c7df-4b5e-9003-bda944cf09cd-openshift-service-ca\") pod \"maas-api-e2e-api-b-31280a-694f9dd499-4wpn7\" (UID: \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\") " pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:24.209888 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:24.209864    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttmvd\" (UniqueName: \"kubernetes.io/projected/00cbad1e-c7df-4b5e-9003-bda944cf09cd-kube-api-access-ttmvd\") pod \"maas-api-e2e-api-b-31280a-694f9dd499-4wpn7\" (UID: \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\") " pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:24.699905 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:24.699872    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00cbad1e-c7df-4b5e-9003-bda944cf09cd-maas-api-tls\") pod \"maas-api-e2e-api-b-31280a-694f9dd499-4wpn7\" (UID: \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\") " pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:24.700077 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:24.700027    2554 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-31280a-serving-cert: secret "maas-api-e2e-api-b-31280a-serving-cert" not found
Jul 07 19:23:24.700153 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:24.700092    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00cbad1e-c7df-4b5e-9003-bda944cf09cd-maas-api-tls podName:00cbad1e-c7df-4b5e-9003-bda944cf09cd nodeName:}" failed. No retries permitted until 2026-07-07 19:23:25.700076393 +0000 UTC m=+1954.859416200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/00cbad1e-c7df-4b5e-9003-bda944cf09cd-maas-api-tls") pod "maas-api-e2e-api-b-31280a-694f9dd499-4wpn7" (UID: "00cbad1e-c7df-4b5e-9003-bda944cf09cd") : secret "maas-api-e2e-api-b-31280a-serving-cert" not found
Jul 07 19:23:25.712342 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:25.712307    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00cbad1e-c7df-4b5e-9003-bda944cf09cd-maas-api-tls\") pod \"maas-api-e2e-api-b-31280a-694f9dd499-4wpn7\" (UID: \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\") " pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:25.714733 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:25.714714    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00cbad1e-c7df-4b5e-9003-bda944cf09cd-maas-api-tls\") pod \"maas-api-e2e-api-b-31280a-694f9dd499-4wpn7\" (UID: \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\") " pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:25.843265 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:25.843237    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:26.033274 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:26.033252    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"]
Jul 07 19:23:26.035049 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:23:26.035021    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00cbad1e_c7df_4b5e_9003_bda944cf09cd.slice/crio-5b73c79d2b65676094940dd05cad4cdad06c0d9b36e0acd74d19bc8d1b8e1d22 WatchSource:0}: Error finding container 5b73c79d2b65676094940dd05cad4cdad06c0d9b36e0acd74d19bc8d1b8e1d22: Status 404 returned error can't find the container with id 5b73c79d2b65676094940dd05cad4cdad06c0d9b36e0acd74d19bc8d1b8e1d22
Jul 07 19:23:27.016987 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:27.016942    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7" event={"ID":"00cbad1e-c7df-4b5e-9003-bda944cf09cd","Type":"ContainerStarted","Data":"b11fef7880bc623f5a5d756158d7e7c173388225a06c528c4a5955e978fcef24"}
Jul 07 19:23:27.017479 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:27.017036    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7" event={"ID":"00cbad1e-c7df-4b5e-9003-bda944cf09cd","Type":"ContainerStarted","Data":"5b73c79d2b65676094940dd05cad4cdad06c0d9b36e0acd74d19bc8d1b8e1d22"}
Jul 07 19:23:27.017479 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:27.017064    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:27.040609 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:27.040539    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7" podStartSLOduration=2.699248755 podStartE2EDuration="3.04051676s" totalImagesPullingTime="341.268005ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:23:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:23:27.037153935 +0000 UTC m=+1956.196493838" watchObservedRunningTime="2026-07-07 19:23:27.04051676 +0000 UTC m=+1956.199856586"
Jul 07 19:23:29.937331 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:29.937295    2554 patch_prober.go:28] interesting pod/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 07 19:23:29.937747 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:29.937351    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf" podUID="043ad699-d9e6-4cf6-ab54-2756272095c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 07 19:23:30.034169 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:30.034138    2554 generic.go:356] "Generic (PLEG): container finished" podID="043ad699-d9e6-4cf6-ab54-2756272095c4" containerID="8f5365b7a425476d2f2d6e18bba3dbb4fb217758ecf16a1444f68fb4d2986341" exitCode=0
Jul 07 19:23:30.034329 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:30.034214    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf" event={"ID":"043ad699-d9e6-4cf6-ab54-2756272095c4","Type":"ContainerDied","Data":"8f5365b7a425476d2f2d6e18bba3dbb4fb217758ecf16a1444f68fb4d2986341"}
Jul 07 19:23:30.034601 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:30.034587    2554 scope.go:117] "RemoveContainer" containerID="8f5365b7a425476d2f2d6e18bba3dbb4fb217758ecf16a1444f68fb4d2986341"
Jul 07 19:23:30.035614 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:30.035588    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:30.035670 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:30.035659    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:30.035723 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:30.035691    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:31.040740 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:31.040705    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf" event={"ID":"043ad699-d9e6-4cf6-ab54-2756272095c4","Type":"ContainerStarted","Data":"95a06a4ee508ca59a56005b3075093f2a21ba0357109c95f6f49f8f518fb1192"}
Jul 07 19:23:31.287560 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:31.287526    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:31.287968 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:31.287940    2554 patch_prober.go:28] interesting pod/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 07 19:23:31.288164 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:31.288141    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf" podUID="043ad699-d9e6-4cf6-ab54-2756272095c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 07 19:23:32.287783 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:32.287734    2554 patch_prober.go:28] interesting pod/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 07 19:23:32.288303 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:32.287842    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf" podUID="043ad699-d9e6-4cf6-ab54-2756272095c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 07 19:23:33.027399 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:33.027371    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:33.286915 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:33.286816    2554 patch_prober.go:28] interesting pod/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 07 19:23:33.286915 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:33.286881    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf" podUID="043ad699-d9e6-4cf6-ab54-2756272095c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 07 19:23:34.286963 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:34.286924    2554 patch_prober.go:28] interesting pod/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 07 19:23:34.287548 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:34.287516    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf" podUID="043ad699-d9e6-4cf6-ab54-2756272095c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 07 19:23:35.291573 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:35.291546    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:35.292059 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:35.291947    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:35.292680 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:35.292660    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:37.507591 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:37.507561    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"]
Jul 07 19:23:37.508048 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:37.507764    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n" podUID="efa58738-3bb0-46a0-9313-889d8623d47d" containerName="maas-api" containerID="cri-o://e7b04b4f1ad20a04ea977559a7839e07ef6f30b2406b1ad20a6393d894f6f62d" gracePeriod=30
Jul 07 19:23:37.745274 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:37.745250    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:37.840084 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:37.840060    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efa58738-3bb0-46a0-9313-889d8623d47d-maas-api-tls\") pod \"efa58738-3bb0-46a0-9313-889d8623d47d\" (UID: \"efa58738-3bb0-46a0-9313-889d8623d47d\") "
Jul 07 19:23:37.840208 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:37.840097    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65qnt\" (UniqueName: \"kubernetes.io/projected/efa58738-3bb0-46a0-9313-889d8623d47d-kube-api-access-65qnt\") pod \"efa58738-3bb0-46a0-9313-889d8623d47d\" (UID: \"efa58738-3bb0-46a0-9313-889d8623d47d\") "
Jul 07 19:23:37.840208 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:37.840115    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa58738-3bb0-46a0-9313-889d8623d47d-openshift-service-ca\") pod \"efa58738-3bb0-46a0-9313-889d8623d47d\" (UID: \"efa58738-3bb0-46a0-9313-889d8623d47d\") "
Jul 07 19:23:37.840516 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:37.840490    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa58738-3bb0-46a0-9313-889d8623d47d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "efa58738-3bb0-46a0-9313-889d8623d47d" (UID: "efa58738-3bb0-46a0-9313-889d8623d47d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:23:37.842048 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:37.842022    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa58738-3bb0-46a0-9313-889d8623d47d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "efa58738-3bb0-46a0-9313-889d8623d47d" (UID: "efa58738-3bb0-46a0-9313-889d8623d47d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:23:37.842119 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:37.842076    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efa58738-3bb0-46a0-9313-889d8623d47d-kube-api-access-65qnt" (OuterVolumeSpecName: "kube-api-access-65qnt") pod "efa58738-3bb0-46a0-9313-889d8623d47d" (UID: "efa58738-3bb0-46a0-9313-889d8623d47d"). InnerVolumeSpecName "kube-api-access-65qnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:23:37.940734 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:37.940708    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efa58738-3bb0-46a0-9313-889d8623d47d-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:37.940734 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:37.940731    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65qnt\" (UniqueName: \"kubernetes.io/projected/efa58738-3bb0-46a0-9313-889d8623d47d-kube-api-access-65qnt\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:37.940901 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:37.940740    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efa58738-3bb0-46a0-9313-889d8623d47d-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:37.988735 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:37.988699    2554 patch_prober.go:28] interesting pod/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 07 19:23:37.988882 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:37.988758    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr" podUID="6fe86dc7-376f-4513-a3cd-43fe102481e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 07 19:23:38.077925 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.077844    2554 generic.go:356] "Generic (PLEG): container finished" podID="efa58738-3bb0-46a0-9313-889d8623d47d" containerID="e7b04b4f1ad20a04ea977559a7839e07ef6f30b2406b1ad20a6393d894f6f62d" exitCode=0
Jul 07 19:23:38.077925 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.077904    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"
Jul 07 19:23:38.078114 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.077933    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n" event={"ID":"efa58738-3bb0-46a0-9313-889d8623d47d","Type":"ContainerDied","Data":"e7b04b4f1ad20a04ea977559a7839e07ef6f30b2406b1ad20a6393d894f6f62d"}
Jul 07 19:23:38.078114 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.077979    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n" event={"ID":"efa58738-3bb0-46a0-9313-889d8623d47d","Type":"ContainerDied","Data":"4b93f2cff0c284b01053f1a0e80e51c5bebdde1f3f9277e246b2a84539542624"}
Jul 07 19:23:38.078114 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.078008    2554 scope.go:117] "RemoveContainer" containerID="e7b04b4f1ad20a04ea977559a7839e07ef6f30b2406b1ad20a6393d894f6f62d"
Jul 07 19:23:38.082828 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.082781    2554 generic.go:356] "Generic (PLEG): container finished" podID="6fe86dc7-376f-4513-a3cd-43fe102481e5" containerID="6af7a59e2ecd0773b12215fca7d5a3dc290ecce3b89950139a5cc82cebe064d0" exitCode=0
Jul 07 19:23:38.082960 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.082862    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr" event={"ID":"6fe86dc7-376f-4513-a3cd-43fe102481e5","Type":"ContainerDied","Data":"6af7a59e2ecd0773b12215fca7d5a3dc290ecce3b89950139a5cc82cebe064d0"}
Jul 07 19:23:38.083295 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.083279    2554 scope.go:117] "RemoveContainer" containerID="6af7a59e2ecd0773b12215fca7d5a3dc290ecce3b89950139a5cc82cebe064d0"
Jul 07 19:23:38.084544 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.084509    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:38.084631 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.084599    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:38.084675 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.084647    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:38.090559 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.090502    2554 scope.go:117] "RemoveContainer" containerID="e7b04b4f1ad20a04ea977559a7839e07ef6f30b2406b1ad20a6393d894f6f62d"
Jul 07 19:23:38.090823 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:38.090785    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7b04b4f1ad20a04ea977559a7839e07ef6f30b2406b1ad20a6393d894f6f62d\": container with ID starting with e7b04b4f1ad20a04ea977559a7839e07ef6f30b2406b1ad20a6393d894f6f62d not found: ID does not exist" containerID="e7b04b4f1ad20a04ea977559a7839e07ef6f30b2406b1ad20a6393d894f6f62d"
Jul 07 19:23:38.090914 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.090829    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b04b4f1ad20a04ea977559a7839e07ef6f30b2406b1ad20a6393d894f6f62d"} err="failed to get container status \"e7b04b4f1ad20a04ea977559a7839e07ef6f30b2406b1ad20a6393d894f6f62d\": rpc error: code = NotFound desc = could not find container \"e7b04b4f1ad20a04ea977559a7839e07ef6f30b2406b1ad20a6393d894f6f62d\": container with ID starting with e7b04b4f1ad20a04ea977559a7839e07ef6f30b2406b1ad20a6393d894f6f62d not found: ID does not exist"
Jul 07 19:23:38.172077 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.171777    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"]
Jul 07 19:23:38.174488 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:38.174458    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-d34566-5cbc44ccbc-r5v7n"]
Jul 07 19:23:39.092134 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:39.092100    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr" event={"ID":"6fe86dc7-376f-4513-a3cd-43fe102481e5","Type":"ContainerStarted","Data":"3a76bcbf40eda9d21f87837139212d520ff2296a6813ec150dd321544b6e8d29"}
Jul 07 19:23:39.479914 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:39.479876    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efa58738-3bb0-46a0-9313-889d8623d47d" path="/var/lib/kubelet/pods/efa58738-3bb0-46a0-9313-889d8623d47d/volumes"
Jul 07 19:23:39.546910 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:39.546877    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:39.547126 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:39.547104    2554 patch_prober.go:28] interesting pod/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 07 19:23:39.547173 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:39.547152    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr" podUID="6fe86dc7-376f-4513-a3cd-43fe102481e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 07 19:23:40.546895 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:40.546783    2554 patch_prober.go:28] interesting pod/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 07 19:23:40.546895 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:40.546867    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr" podUID="6fe86dc7-376f-4513-a3cd-43fe102481e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 07 19:23:41.546285 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:41.546251    2554 patch_prober.go:28] interesting pod/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 07 19:23:41.546455 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:41.546312    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr" podUID="6fe86dc7-376f-4513-a3cd-43fe102481e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 07 19:23:42.546448 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:42.546405    2554 patch_prober.go:28] interesting pod/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 07 19:23:42.546965 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:42.546474    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr" podUID="6fe86dc7-376f-4513-a3cd-43fe102481e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 07 19:23:43.405935 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:43.404850    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"]
Jul 07 19:23:43.405935 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:43.405134    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf" podUID="043ad699-d9e6-4cf6-ab54-2756272095c4" containerName="istio-proxy" containerID="cri-o://95a06a4ee508ca59a56005b3075093f2a21ba0357109c95f6f49f8f518fb1192" gracePeriod=30
Jul 07 19:23:43.550744 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:43.550707    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:43.551141 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:43.551088    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:43.551901 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:43.551873    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:44.723493 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:44.723459    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"]
Jul 07 19:23:44.723909 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:44.723651    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7" podUID="00cbad1e-c7df-4b5e-9003-bda944cf09cd" containerName="maas-api" containerID="cri-o://b11fef7880bc623f5a5d756158d7e7c173388225a06c528c4a5955e978fcef24" gracePeriod=30
Jul 07 19:23:44.978814 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:44.978783    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:45.015959 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.015935    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00cbad1e-c7df-4b5e-9003-bda944cf09cd-maas-api-tls\") pod \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\" (UID: \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\") "
Jul 07 19:23:45.016065 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.015967    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttmvd\" (UniqueName: \"kubernetes.io/projected/00cbad1e-c7df-4b5e-9003-bda944cf09cd-kube-api-access-ttmvd\") pod \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\" (UID: \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\") "
Jul 07 19:23:45.016065 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.016052    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00cbad1e-c7df-4b5e-9003-bda944cf09cd-openshift-service-ca\") pod \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\" (UID: \"00cbad1e-c7df-4b5e-9003-bda944cf09cd\") "
Jul 07 19:23:45.016492 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.016457    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00cbad1e-c7df-4b5e-9003-bda944cf09cd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "00cbad1e-c7df-4b5e-9003-bda944cf09cd" (UID: "00cbad1e-c7df-4b5e-9003-bda944cf09cd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:23:45.018043 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.018018    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00cbad1e-c7df-4b5e-9003-bda944cf09cd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "00cbad1e-c7df-4b5e-9003-bda944cf09cd" (UID: "00cbad1e-c7df-4b5e-9003-bda944cf09cd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:23:45.018043 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.018033    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00cbad1e-c7df-4b5e-9003-bda944cf09cd-kube-api-access-ttmvd" (OuterVolumeSpecName: "kube-api-access-ttmvd") pod "00cbad1e-c7df-4b5e-9003-bda944cf09cd" (UID: "00cbad1e-c7df-4b5e-9003-bda944cf09cd"). InnerVolumeSpecName "kube-api-access-ttmvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:23:45.117582 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.117554    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00cbad1e-c7df-4b5e-9003-bda944cf09cd-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:45.117582 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.117579    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00cbad1e-c7df-4b5e-9003-bda944cf09cd-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:45.117733 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.117589    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttmvd\" (UniqueName: \"kubernetes.io/projected/00cbad1e-c7df-4b5e-9003-bda944cf09cd-kube-api-access-ttmvd\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:45.123747 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.123723    2554 generic.go:356] "Generic (PLEG): container finished" podID="00cbad1e-c7df-4b5e-9003-bda944cf09cd" containerID="b11fef7880bc623f5a5d756158d7e7c173388225a06c528c4a5955e978fcef24" exitCode=0
Jul 07 19:23:45.123868 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.123776    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"
Jul 07 19:23:45.123868 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.123826    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7" event={"ID":"00cbad1e-c7df-4b5e-9003-bda944cf09cd","Type":"ContainerDied","Data":"b11fef7880bc623f5a5d756158d7e7c173388225a06c528c4a5955e978fcef24"}
Jul 07 19:23:45.123957 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.123865    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7" event={"ID":"00cbad1e-c7df-4b5e-9003-bda944cf09cd","Type":"ContainerDied","Data":"5b73c79d2b65676094940dd05cad4cdad06c0d9b36e0acd74d19bc8d1b8e1d22"}
Jul 07 19:23:45.123957 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.123890    2554 scope.go:117] "RemoveContainer" containerID="b11fef7880bc623f5a5d756158d7e7c173388225a06c528c4a5955e978fcef24"
Jul 07 19:23:45.133472 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.133455    2554 scope.go:117] "RemoveContainer" containerID="b11fef7880bc623f5a5d756158d7e7c173388225a06c528c4a5955e978fcef24"
Jul 07 19:23:45.133710 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:45.133690    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b11fef7880bc623f5a5d756158d7e7c173388225a06c528c4a5955e978fcef24\": container with ID starting with b11fef7880bc623f5a5d756158d7e7c173388225a06c528c4a5955e978fcef24 not found: ID does not exist" containerID="b11fef7880bc623f5a5d756158d7e7c173388225a06c528c4a5955e978fcef24"
Jul 07 19:23:45.133769 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.133724    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b11fef7880bc623f5a5d756158d7e7c173388225a06c528c4a5955e978fcef24"} err="failed to get container status \"b11fef7880bc623f5a5d756158d7e7c173388225a06c528c4a5955e978fcef24\": rpc error: code = NotFound desc = could not find container \"b11fef7880bc623f5a5d756158d7e7c173388225a06c528c4a5955e978fcef24\": container with ID starting with b11fef7880bc623f5a5d756158d7e7c173388225a06c528c4a5955e978fcef24 not found: ID does not exist"
Jul 07 19:23:45.150706 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.150686    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"]
Jul 07 19:23:45.163526 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.163502    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-31280a-694f9dd499-4wpn7"]
Jul 07 19:23:45.474593 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:45.474518    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00cbad1e-c7df-4b5e-9003-bda944cf09cd" path="/var/lib/kubelet/pods/00cbad1e-c7df-4b5e-9003-bda944cf09cd/volumes"
Jul 07 19:23:48.678166 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.678109    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:48.745936 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.745905    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/043ad699-d9e6-4cf6-ab54-2756272095c4-istiod-ca-cert\") pod \"043ad699-d9e6-4cf6-ab54-2756272095c4\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") "
Jul 07 19:23:48.746074 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.745955    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-workload-socket\") pod \"043ad699-d9e6-4cf6-ab54-2756272095c4\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") "
Jul 07 19:23:48.746074 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.745988    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-credential-socket\") pod \"043ad699-d9e6-4cf6-ab54-2756272095c4\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") "
Jul 07 19:23:48.746074 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.746022    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh6zc\" (UniqueName: \"kubernetes.io/projected/043ad699-d9e6-4cf6-ab54-2756272095c4-kube-api-access-rh6zc\") pod \"043ad699-d9e6-4cf6-ab54-2756272095c4\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") "
Jul 07 19:23:48.746074 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.746054    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-data\") pod \"043ad699-d9e6-4cf6-ab54-2756272095c4\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") "
Jul 07 19:23:48.746279 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.746105    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-token\") pod \"043ad699-d9e6-4cf6-ab54-2756272095c4\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") "
Jul 07 19:23:48.746279 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.746130    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-envoy\") pod \"043ad699-d9e6-4cf6-ab54-2756272095c4\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") "
Jul 07 19:23:48.746279 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.746211    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-workload-certs\") pod \"043ad699-d9e6-4cf6-ab54-2756272095c4\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") "
Jul 07 19:23:48.746279 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.746236    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-podinfo\") pod \"043ad699-d9e6-4cf6-ab54-2756272095c4\" (UID: \"043ad699-d9e6-4cf6-ab54-2756272095c4\") "
Jul 07 19:23:48.746279 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.746251    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "043ad699-d9e6-4cf6-ab54-2756272095c4" (UID: "043ad699-d9e6-4cf6-ab54-2756272095c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:48.746279 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.746257    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/043ad699-d9e6-4cf6-ab54-2756272095c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "043ad699-d9e6-4cf6-ab54-2756272095c4" (UID: "043ad699-d9e6-4cf6-ab54-2756272095c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:23:48.746596 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.746402    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "043ad699-d9e6-4cf6-ab54-2756272095c4" (UID: "043ad699-d9e6-4cf6-ab54-2756272095c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:48.746596 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.746534    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "043ad699-d9e6-4cf6-ab54-2756272095c4" (UID: "043ad699-d9e6-4cf6-ab54-2756272095c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:48.746596 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.746565    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/043ad699-d9e6-4cf6-ab54-2756272095c4-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:48.746596 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.746585    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:48.746824 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.746601    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:48.747471 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.747442    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "043ad699-d9e6-4cf6-ab54-2756272095c4" (UID: "043ad699-d9e6-4cf6-ab54-2756272095c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:48.748352 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.748321    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "043ad699-d9e6-4cf6-ab54-2756272095c4" (UID: "043ad699-d9e6-4cf6-ab54-2756272095c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:23:48.748537 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.748515    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "043ad699-d9e6-4cf6-ab54-2756272095c4" (UID: "043ad699-d9e6-4cf6-ab54-2756272095c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:23:48.748698 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.748669    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "043ad699-d9e6-4cf6-ab54-2756272095c4" (UID: "043ad699-d9e6-4cf6-ab54-2756272095c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:48.748863 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.748835    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/043ad699-d9e6-4cf6-ab54-2756272095c4-kube-api-access-rh6zc" (OuterVolumeSpecName: "kube-api-access-rh6zc") pod "043ad699-d9e6-4cf6-ab54-2756272095c4" (UID: "043ad699-d9e6-4cf6-ab54-2756272095c4"). InnerVolumeSpecName "kube-api-access-rh6zc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:23:48.847488 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.847450    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh6zc\" (UniqueName: \"kubernetes.io/projected/043ad699-d9e6-4cf6-ab54-2756272095c4-kube-api-access-rh6zc\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:48.847488 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.847483    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:48.847488 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.847496    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:48.847754 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.847509    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:48.847754 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.847519    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/043ad699-d9e6-4cf6-ab54-2756272095c4-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:48.847754 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:48.847529    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/043ad699-d9e6-4cf6-ab54-2756272095c4-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:49.144776 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:49.144741    2554 generic.go:356] "Generic (PLEG): container finished" podID="043ad699-d9e6-4cf6-ab54-2756272095c4" containerID="95a06a4ee508ca59a56005b3075093f2a21ba0357109c95f6f49f8f518fb1192" exitCode=0
Jul 07 19:23:49.144958 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:49.144823    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"
Jul 07 19:23:49.144958 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:49.144827    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf" event={"ID":"043ad699-d9e6-4cf6-ab54-2756272095c4","Type":"ContainerDied","Data":"95a06a4ee508ca59a56005b3075093f2a21ba0357109c95f6f49f8f518fb1192"}
Jul 07 19:23:49.144958 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:49.144886    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf" event={"ID":"043ad699-d9e6-4cf6-ab54-2756272095c4","Type":"ContainerDied","Data":"3246427425f7ca6b4465937108a4fca054f23250222a7a429f14e657be31375a"}
Jul 07 19:23:49.144958 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:49.144909    2554 scope.go:117] "RemoveContainer" containerID="95a06a4ee508ca59a56005b3075093f2a21ba0357109c95f6f49f8f518fb1192"
Jul 07 19:23:49.154386 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:49.154369    2554 scope.go:117] "RemoveContainer" containerID="8f5365b7a425476d2f2d6e18bba3dbb4fb217758ecf16a1444f68fb4d2986341"
Jul 07 19:23:49.164759 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:49.164742    2554 scope.go:117] "RemoveContainer" containerID="95a06a4ee508ca59a56005b3075093f2a21ba0357109c95f6f49f8f518fb1192"
Jul 07 19:23:49.165034 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:49.165016    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95a06a4ee508ca59a56005b3075093f2a21ba0357109c95f6f49f8f518fb1192\": container with ID starting with 95a06a4ee508ca59a56005b3075093f2a21ba0357109c95f6f49f8f518fb1192 not found: ID does not exist" containerID="95a06a4ee508ca59a56005b3075093f2a21ba0357109c95f6f49f8f518fb1192"
Jul 07 19:23:49.165117 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:49.165043    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95a06a4ee508ca59a56005b3075093f2a21ba0357109c95f6f49f8f518fb1192"} err="failed to get container status \"95a06a4ee508ca59a56005b3075093f2a21ba0357109c95f6f49f8f518fb1192\": rpc error: code = NotFound desc = could not find container \"95a06a4ee508ca59a56005b3075093f2a21ba0357109c95f6f49f8f518fb1192\": container with ID starting with 95a06a4ee508ca59a56005b3075093f2a21ba0357109c95f6f49f8f518fb1192 not found: ID does not exist"
Jul 07 19:23:49.165117 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:49.165065    2554 scope.go:117] "RemoveContainer" containerID="8f5365b7a425476d2f2d6e18bba3dbb4fb217758ecf16a1444f68fb4d2986341"
Jul 07 19:23:49.165287 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:49.165269    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f5365b7a425476d2f2d6e18bba3dbb4fb217758ecf16a1444f68fb4d2986341\": container with ID starting with 8f5365b7a425476d2f2d6e18bba3dbb4fb217758ecf16a1444f68fb4d2986341 not found: ID does not exist" containerID="8f5365b7a425476d2f2d6e18bba3dbb4fb217758ecf16a1444f68fb4d2986341"
Jul 07 19:23:49.165342 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:49.165296    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f5365b7a425476d2f2d6e18bba3dbb4fb217758ecf16a1444f68fb4d2986341"} err="failed to get container status \"8f5365b7a425476d2f2d6e18bba3dbb4fb217758ecf16a1444f68fb4d2986341\": rpc error: code = NotFound desc = could not find container \"8f5365b7a425476d2f2d6e18bba3dbb4fb217758ecf16a1444f68fb4d2986341\": container with ID starting with 8f5365b7a425476d2f2d6e18bba3dbb4fb217758ecf16a1444f68fb4d2986341 not found: ID does not exist"
Jul 07 19:23:49.171652 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:49.171632    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"]
Jul 07 19:23:49.176529 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:49.176508    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d34566-openshift-default-c6cb76f47-5hvxf"]
Jul 07 19:23:49.474975 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:49.474884    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="043ad699-d9e6-4cf6-ab54-2756272095c4" path="/var/lib/kubelet/pods/043ad699-d9e6-4cf6-ab54-2756272095c4/volumes"
Jul 07 19:23:50.718926 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:50.718891    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"]
Jul 07 19:23:50.719314 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:50.719105    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr" podUID="6fe86dc7-376f-4513-a3cd-43fe102481e5" containerName="istio-proxy" containerID="cri-o://3a76bcbf40eda9d21f87837139212d520ff2296a6813ec150dd321544b6e8d29" gracePeriod=30
Jul 07 19:23:51.653265 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.653211    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"]
Jul 07 19:23:51.654225 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.654201    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00cbad1e-c7df-4b5e-9003-bda944cf09cd" containerName="maas-api"
Jul 07 19:23:51.654395 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.654381    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="00cbad1e-c7df-4b5e-9003-bda944cf09cd" containerName="maas-api"
Jul 07 19:23:51.654515 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.654505    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa58738-3bb0-46a0-9313-889d8623d47d" containerName="maas-api"
Jul 07 19:23:51.654603 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.654584    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa58738-3bb0-46a0-9313-889d8623d47d" containerName="maas-api"
Jul 07 19:23:51.654721 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.654638    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="043ad699-d9e6-4cf6-ab54-2756272095c4" containerName="istio-proxy"
Jul 07 19:23:51.654721 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.654647    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="043ad699-d9e6-4cf6-ab54-2756272095c4" containerName="istio-proxy"
Jul 07 19:23:51.654721 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.654669    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="043ad699-d9e6-4cf6-ab54-2756272095c4" containerName="istio-proxy"
Jul 07 19:23:51.654721 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.654677    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="043ad699-d9e6-4cf6-ab54-2756272095c4" containerName="istio-proxy"
Jul 07 19:23:51.654940 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.654912    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="efa58738-3bb0-46a0-9313-889d8623d47d" containerName="maas-api"
Jul 07 19:23:51.654940 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.654926    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="043ad699-d9e6-4cf6-ab54-2756272095c4" containerName="istio-proxy"
Jul 07 19:23:51.655038 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.654944    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="043ad699-d9e6-4cf6-ab54-2756272095c4" containerName="istio-proxy"
Jul 07 19:23:51.655038 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.654954    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="00cbad1e-c7df-4b5e-9003-bda944cf09cd" containerName="maas-api"
Jul 07 19:23:51.658923 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.658899    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.662050 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.662030    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-44233f-openshift-default-dockercfg-svzbw\""
Jul 07 19:23:51.672091 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.672068    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-workload-certs\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.672192 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.672101    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-credential-socket\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.672192 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.672150    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istiod-ca-cert\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.672309 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.672201    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-envoy\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.672309 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.672219    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-token\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.672309 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.672238    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq45b\" (UniqueName: \"kubernetes.io/projected/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-kube-api-access-wq45b\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.672309 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.672265    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-data\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.672309 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.672289    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-workload-socket\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.672492 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.672351    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-podinfo\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.673221 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.673202    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"]
Jul 07 19:23:51.772958 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.772923    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istiod-ca-cert\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.773365 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.772984    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-envoy\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.773365 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.773013    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-token\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.773365 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.773043    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq45b\" (UniqueName: \"kubernetes.io/projected/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-kube-api-access-wq45b\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.773365 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.773072    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-data\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.773365 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.773122    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-workload-socket\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.773365 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.773164    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-podinfo\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.773365 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.773205    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-workload-certs\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.773365 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.773233    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-credential-socket\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.773720 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.773394    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-data\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.773720 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.773575    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-credential-socket\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.773720 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.773626    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-workload-socket\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.773720 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.773693    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-workload-certs\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.773900 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.773729    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istiod-ca-cert\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.775390 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.775369    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-envoy\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.775516 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.775499    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-podinfo\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.781602 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.781574    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-token\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.781709 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.781690    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq45b\" (UniqueName: \"kubernetes.io/projected/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-kube-api-access-wq45b\") pod \"e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") " pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:51.969924 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:51.969845    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:52.113740 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:52.113524    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"]
Jul 07 19:23:52.116023 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:23:52.115991    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d89d4c8_2f1a_4fde_b222_5a37a3ad1902.slice/crio-3d5581311c74c71a5d03b9088362e3e3a6a0870d4febeda79ec33798028e513b WatchSource:0}: Error finding container 3d5581311c74c71a5d03b9088362e3e3a6a0870d4febeda79ec33798028e513b: Status 404 returned error can't find the container with id 3d5581311c74c71a5d03b9088362e3e3a6a0870d4febeda79ec33798028e513b
Jul 07 19:23:52.118288 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:52.118243    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:52.118353 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:52.118342    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:52.118402 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:52.118385    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:23:52.162175 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:52.162148    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2" event={"ID":"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902","Type":"ContainerStarted","Data":"3d5581311c74c71a5d03b9088362e3e3a6a0870d4febeda79ec33798028e513b"}
Jul 07 19:23:53.169544 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:53.169512    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2" event={"ID":"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902","Type":"ContainerStarted","Data":"3b0a95367960ee1d0a7332831aa712230fc088a3315202fbc0c8c96537cb9695"}
Jul 07 19:23:53.198288 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:53.198235    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2" podStartSLOduration=2.198219766 podStartE2EDuration="2.198219766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:23:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:23:53.196815149 +0000 UTC m=+1982.356154991" watchObservedRunningTime="2026-07-07 19:23:53.198219766 +0000 UTC m=+1982.357559591"
Jul 07 19:23:53.970541 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:53.970504    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:53.975547 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:53.975518    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:54.175106 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:54.175077    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:54.175972 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:54.175951    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:23:55.257342 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.257286    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"]
Jul 07 19:23:55.259907 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.259885    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:23:55.262624 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.262604    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-44233f-serving-cert\""
Jul 07 19:23:55.278558 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.278529    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"]
Jul 07 19:23:55.307517 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.307391    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hnq8\" (UniqueName: \"kubernetes.io/projected/366d3b47-160b-4899-8297-178c6fb9ebe7-kube-api-access-9hnq8\") pod \"maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw\" (UID: \"366d3b47-160b-4899-8297-178c6fb9ebe7\") " pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:23:55.307517 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.307449    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/366d3b47-160b-4899-8297-178c6fb9ebe7-maas-api-tls\") pod \"maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw\" (UID: \"366d3b47-160b-4899-8297-178c6fb9ebe7\") " pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:23:55.307517 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.307517    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/366d3b47-160b-4899-8297-178c6fb9ebe7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw\" (UID: \"366d3b47-160b-4899-8297-178c6fb9ebe7\") " pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:23:55.408997 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.408964    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hnq8\" (UniqueName: \"kubernetes.io/projected/366d3b47-160b-4899-8297-178c6fb9ebe7-kube-api-access-9hnq8\") pod \"maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw\" (UID: \"366d3b47-160b-4899-8297-178c6fb9ebe7\") " pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:23:55.409183 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.409007    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/366d3b47-160b-4899-8297-178c6fb9ebe7-maas-api-tls\") pod \"maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw\" (UID: \"366d3b47-160b-4899-8297-178c6fb9ebe7\") " pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:23:55.409183 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.409050    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/366d3b47-160b-4899-8297-178c6fb9ebe7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw\" (UID: \"366d3b47-160b-4899-8297-178c6fb9ebe7\") " pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:23:55.409313 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:55.409193    2554 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-44233f-serving-cert: secret "maas-api-e2e-shared-a-44233f-serving-cert" not found
Jul 07 19:23:55.409313 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:55.409268    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/366d3b47-160b-4899-8297-178c6fb9ebe7-maas-api-tls podName:366d3b47-160b-4899-8297-178c6fb9ebe7 nodeName:}" failed. No retries permitted until 2026-07-07 19:23:55.909247008 +0000 UTC m=+1985.068586815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/366d3b47-160b-4899-8297-178c6fb9ebe7-maas-api-tls") pod "maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw" (UID: "366d3b47-160b-4899-8297-178c6fb9ebe7") : secret "maas-api-e2e-shared-a-44233f-serving-cert" not found
Jul 07 19:23:55.409663 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.409645    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/366d3b47-160b-4899-8297-178c6fb9ebe7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw\" (UID: \"366d3b47-160b-4899-8297-178c6fb9ebe7\") " pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:23:55.427068 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.427047    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hnq8\" (UniqueName: \"kubernetes.io/projected/366d3b47-160b-4899-8297-178c6fb9ebe7-kube-api-access-9hnq8\") pod \"maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw\" (UID: \"366d3b47-160b-4899-8297-178c6fb9ebe7\") " pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:23:55.914793 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.914759    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/366d3b47-160b-4899-8297-178c6fb9ebe7-maas-api-tls\") pod \"maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw\" (UID: \"366d3b47-160b-4899-8297-178c6fb9ebe7\") " pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:23:55.917615 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.917587    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/366d3b47-160b-4899-8297-178c6fb9ebe7-maas-api-tls\") pod \"maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw\" (UID: \"366d3b47-160b-4899-8297-178c6fb9ebe7\") " pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:23:55.980340 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:55.980281    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:56.015184 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.015160    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7km29\" (UniqueName: \"kubernetes.io/projected/6fe86dc7-376f-4513-a3cd-43fe102481e5-kube-api-access-7km29\") pod \"6fe86dc7-376f-4513-a3cd-43fe102481e5\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") "
Jul 07 19:23:56.015305 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.015197    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fe86dc7-376f-4513-a3cd-43fe102481e5-istiod-ca-cert\") pod \"6fe86dc7-376f-4513-a3cd-43fe102481e5\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") "
Jul 07 19:23:56.015305 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.015219    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-credential-socket\") pod \"6fe86dc7-376f-4513-a3cd-43fe102481e5\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") "
Jul 07 19:23:56.015390 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.015351    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-envoy\") pod \"6fe86dc7-376f-4513-a3cd-43fe102481e5\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") "
Jul 07 19:23:56.015438 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.015409    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-workload-certs\") pod \"6fe86dc7-376f-4513-a3cd-43fe102481e5\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") "
Jul 07 19:23:56.015491 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.015469    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-data\") pod \"6fe86dc7-376f-4513-a3cd-43fe102481e5\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") "
Jul 07 19:23:56.015548 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.015502    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6fe86dc7-376f-4513-a3cd-43fe102481e5" (UID: "6fe86dc7-376f-4513-a3cd-43fe102481e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:56.015548 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.015525    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-token\") pod \"6fe86dc7-376f-4513-a3cd-43fe102481e5\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") "
Jul 07 19:23:56.015656 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.015576    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-podinfo\") pod \"6fe86dc7-376f-4513-a3cd-43fe102481e5\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") "
Jul 07 19:23:56.015656 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.015591    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fe86dc7-376f-4513-a3cd-43fe102481e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6fe86dc7-376f-4513-a3cd-43fe102481e5" (UID: "6fe86dc7-376f-4513-a3cd-43fe102481e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:23:56.015656 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.015638    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-workload-socket\") pod \"6fe86dc7-376f-4513-a3cd-43fe102481e5\" (UID: \"6fe86dc7-376f-4513-a3cd-43fe102481e5\") "
Jul 07 19:23:56.015853 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.015728    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6fe86dc7-376f-4513-a3cd-43fe102481e5" (UID: "6fe86dc7-376f-4513-a3cd-43fe102481e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:56.016001 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.015977    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6fe86dc7-376f-4513-a3cd-43fe102481e5" (UID: "6fe86dc7-376f-4513-a3cd-43fe102481e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:56.016088 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.016058    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:56.016088 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.016081    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fe86dc7-376f-4513-a3cd-43fe102481e5-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:56.016238 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.016095    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:56.016238 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.016109    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:56.016436 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.016414    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "6fe86dc7-376f-4513-a3cd-43fe102481e5" (UID: "6fe86dc7-376f-4513-a3cd-43fe102481e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:56.017710 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.017688    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6fe86dc7-376f-4513-a3cd-43fe102481e5" (UID: "6fe86dc7-376f-4513-a3cd-43fe102481e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:23:56.017967 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.017944    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "6fe86dc7-376f-4513-a3cd-43fe102481e5" (UID: "6fe86dc7-376f-4513-a3cd-43fe102481e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:23:56.017967 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.017951    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6fe86dc7-376f-4513-a3cd-43fe102481e5" (UID: "6fe86dc7-376f-4513-a3cd-43fe102481e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:23:56.018097 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.018065    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fe86dc7-376f-4513-a3cd-43fe102481e5-kube-api-access-7km29" (OuterVolumeSpecName: "kube-api-access-7km29") pod "6fe86dc7-376f-4513-a3cd-43fe102481e5" (UID: "6fe86dc7-376f-4513-a3cd-43fe102481e5"). InnerVolumeSpecName "kube-api-access-7km29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:23:56.116914 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.116881    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:56.116914 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.116909    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:56.116914 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.116918    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:56.117163 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.116925    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fe86dc7-376f-4513-a3cd-43fe102481e5-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:56.117163 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.116934    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7km29\" (UniqueName: \"kubernetes.io/projected/6fe86dc7-376f-4513-a3cd-43fe102481e5-kube-api-access-7km29\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:23:56.170647 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.170616    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:23:56.190717 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.190683    2554 generic.go:356] "Generic (PLEG): container finished" podID="6fe86dc7-376f-4513-a3cd-43fe102481e5" containerID="3a76bcbf40eda9d21f87837139212d520ff2296a6813ec150dd321544b6e8d29" exitCode=0
Jul 07 19:23:56.190899 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.190736    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"
Jul 07 19:23:56.190899 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.190776    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr" event={"ID":"6fe86dc7-376f-4513-a3cd-43fe102481e5","Type":"ContainerDied","Data":"3a76bcbf40eda9d21f87837139212d520ff2296a6813ec150dd321544b6e8d29"}
Jul 07 19:23:56.190899 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.190872    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr" event={"ID":"6fe86dc7-376f-4513-a3cd-43fe102481e5","Type":"ContainerDied","Data":"8ae759a74fb7651caa5a22659a3c0809bc5671c699b93fdc6c605b90d2520447"}
Jul 07 19:23:56.191051 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.190910    2554 scope.go:117] "RemoveContainer" containerID="3a76bcbf40eda9d21f87837139212d520ff2296a6813ec150dd321544b6e8d29"
Jul 07 19:23:56.209574 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.209553    2554 scope.go:117] "RemoveContainer" containerID="6af7a59e2ecd0773b12215fca7d5a3dc290ecce3b89950139a5cc82cebe064d0"
Jul 07 19:23:56.218237 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.218212    2554 scope.go:117] "RemoveContainer" containerID="3a76bcbf40eda9d21f87837139212d520ff2296a6813ec150dd321544b6e8d29"
Jul 07 19:23:56.218546 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:56.218522    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a76bcbf40eda9d21f87837139212d520ff2296a6813ec150dd321544b6e8d29\": container with ID starting with 3a76bcbf40eda9d21f87837139212d520ff2296a6813ec150dd321544b6e8d29 not found: ID does not exist" containerID="3a76bcbf40eda9d21f87837139212d520ff2296a6813ec150dd321544b6e8d29"
Jul 07 19:23:56.218691 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.218666    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a76bcbf40eda9d21f87837139212d520ff2296a6813ec150dd321544b6e8d29"} err="failed to get container status \"3a76bcbf40eda9d21f87837139212d520ff2296a6813ec150dd321544b6e8d29\": rpc error: code = NotFound desc = could not find container \"3a76bcbf40eda9d21f87837139212d520ff2296a6813ec150dd321544b6e8d29\": container with ID starting with 3a76bcbf40eda9d21f87837139212d520ff2296a6813ec150dd321544b6e8d29 not found: ID does not exist"
Jul 07 19:23:56.218776 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.218695    2554 scope.go:117] "RemoveContainer" containerID="6af7a59e2ecd0773b12215fca7d5a3dc290ecce3b89950139a5cc82cebe064d0"
Jul 07 19:23:56.219128 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:23:56.219039    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6af7a59e2ecd0773b12215fca7d5a3dc290ecce3b89950139a5cc82cebe064d0\": container with ID starting with 6af7a59e2ecd0773b12215fca7d5a3dc290ecce3b89950139a5cc82cebe064d0 not found: ID does not exist" containerID="6af7a59e2ecd0773b12215fca7d5a3dc290ecce3b89950139a5cc82cebe064d0"
Jul 07 19:23:56.219128 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.219070    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6af7a59e2ecd0773b12215fca7d5a3dc290ecce3b89950139a5cc82cebe064d0"} err="failed to get container status \"6af7a59e2ecd0773b12215fca7d5a3dc290ecce3b89950139a5cc82cebe064d0\": rpc error: code = NotFound desc = could not find container \"6af7a59e2ecd0773b12215fca7d5a3dc290ecce3b89950139a5cc82cebe064d0\": container with ID starting with 6af7a59e2ecd0773b12215fca7d5a3dc290ecce3b89950139a5cc82cebe064d0 not found: ID does not exist"
Jul 07 19:23:56.222520 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.222495    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"]
Jul 07 19:23:56.226567 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.226546    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-31280a-openshift-default-76d75d69bc-c6gmr"]
Jul 07 19:23:56.326330 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:56.326303    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"]
Jul 07 19:23:56.328869 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:23:56.328834    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod366d3b47_160b_4899_8297_178c6fb9ebe7.slice/crio-44bb6922c7a6f55652d282576cfd25f1131add9268e7aaef9b4caedc34f95e79 WatchSource:0}: Error finding container 44bb6922c7a6f55652d282576cfd25f1131add9268e7aaef9b4caedc34f95e79: Status 404 returned error can't find the container with id 44bb6922c7a6f55652d282576cfd25f1131add9268e7aaef9b4caedc34f95e79
Jul 07 19:23:57.197853 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:57.197823    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw" event={"ID":"366d3b47-160b-4899-8297-178c6fb9ebe7","Type":"ContainerStarted","Data":"22a429c4b2d50e2cc541dcac97b33c8ba28370116038a1df8f2b75b9d6148ac1"}
Jul 07 19:23:57.198053 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:57.197869    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw" event={"ID":"366d3b47-160b-4899-8297-178c6fb9ebe7","Type":"ContainerStarted","Data":"44bb6922c7a6f55652d282576cfd25f1131add9268e7aaef9b4caedc34f95e79"}
Jul 07 19:23:57.198053 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:57.197950    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:23:57.225364 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:57.225318    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw" podStartSLOduration=1.850385232 podStartE2EDuration="2.225304379s" totalImagesPullingTime="374.919147ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:23:57.224694105 +0000 UTC m=+1986.384033934" watchObservedRunningTime="2026-07-07 19:23:57.225304379 +0000 UTC m=+1986.384644206"
Jul 07 19:23:57.474840 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:23:57.474750    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fe86dc7-376f-4513-a3cd-43fe102481e5" path="/var/lib/kubelet/pods/6fe86dc7-376f-4513-a3cd-43fe102481e5/volumes"
Jul 07 19:24:00.276407 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.276372    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"]
Jul 07 19:24:00.276821 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.276770    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fe86dc7-376f-4513-a3cd-43fe102481e5" containerName="istio-proxy"
Jul 07 19:24:00.276821 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.276781    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fe86dc7-376f-4513-a3cd-43fe102481e5" containerName="istio-proxy"
Jul 07 19:24:00.276934 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.276831    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fe86dc7-376f-4513-a3cd-43fe102481e5" containerName="istio-proxy"
Jul 07 19:24:00.276934 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.276842    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fe86dc7-376f-4513-a3cd-43fe102481e5" containerName="istio-proxy"
Jul 07 19:24:00.277010 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.276931    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fe86dc7-376f-4513-a3cd-43fe102481e5" containerName="istio-proxy"
Jul 07 19:24:00.277010 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.276949    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fe86dc7-376f-4513-a3cd-43fe102481e5" containerName="istio-proxy"
Jul 07 19:24:00.279981 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.279960    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.282852 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.282835    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-6f2191-openshift-default-dockercfg-gpv98\""
Jul 07 19:24:00.293668 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.293644    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"]
Jul 07 19:24:00.355916 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.355887    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-credential-socket\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.356053 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.355920    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkx8r\" (UniqueName: \"kubernetes.io/projected/ca776572-1a42-4f94-9766-e0855bf5fa08-kube-api-access-rkx8r\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.356053 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.355941    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-podinfo\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.356053 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.355988    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca776572-1a42-4f94-9766-e0855bf5fa08-istiod-ca-cert\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.356053 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.356049    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-workload-certs\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.356234 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.356110    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-token\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.356234 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.356169    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-workload-socket\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.356234 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.356230    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-envoy\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.356339 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.356266    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-data\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.457527 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.457495    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-workload-certs\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.457715 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.457544    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-token\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.457715 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.457572    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-workload-socket\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.457715 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.457610    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-envoy\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.457715 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.457631    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-data\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.457715 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.457660    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-credential-socket\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.457715 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.457683    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkx8r\" (UniqueName: \"kubernetes.io/projected/ca776572-1a42-4f94-9766-e0855bf5fa08-kube-api-access-rkx8r\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.457715 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.457714    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-podinfo\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.458085 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.457744    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca776572-1a42-4f94-9766-e0855bf5fa08-istiod-ca-cert\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.458085 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.457962    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-workload-certs\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.458085 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.458048    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-data\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.458190 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.458122    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-workload-socket\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.458190 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.458160    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-credential-socket\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.458410 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.458386    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca776572-1a42-4f94-9766-e0855bf5fa08-istiod-ca-cert\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.460076 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.460050    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-envoy\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.460219 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.460203    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-podinfo\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.467044 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.467017    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-token\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.467044 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.467031    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkx8r\" (UniqueName: \"kubernetes.io/projected/ca776572-1a42-4f94-9766-e0855bf5fa08-kube-api-access-rkx8r\") pod \"e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") " pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.589573 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.589496    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:00.735499 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.735472    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"]
Jul 07 19:24:00.737624 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:24:00.737594    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca776572_1a42_4f94_9766_e0855bf5fa08.slice/crio-da0f5dbf6922b0bef525ddc15d887677754d73a70abebbb9a883944e3753419c WatchSource:0}: Error finding container da0f5dbf6922b0bef525ddc15d887677754d73a70abebbb9a883944e3753419c: Status 404 returned error can't find the container with id da0f5dbf6922b0bef525ddc15d887677754d73a70abebbb9a883944e3753419c
Jul 07 19:24:00.739849 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.739819    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:24:00.739940 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.739880    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:24:00.739940 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:00.739905    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:24:01.220675 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:01.220633    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd" event={"ID":"ca776572-1a42-4f94-9766-e0855bf5fa08","Type":"ContainerStarted","Data":"07cac45502e46331718ec22e263857227f31f6c4c01d70d60434727cd73153ee"}
Jul 07 19:24:01.220866 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:01.220703    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd" event={"ID":"ca776572-1a42-4f94-9766-e0855bf5fa08","Type":"ContainerStarted","Data":"da0f5dbf6922b0bef525ddc15d887677754d73a70abebbb9a883944e3753419c"}
Jul 07 19:24:01.247761 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:01.247703    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd" podStartSLOduration=1.247673617 podStartE2EDuration="1.247673617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:24:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:24:01.245050522 +0000 UTC m=+1990.404390349" watchObservedRunningTime="2026-07-07 19:24:01.247673617 +0000 UTC m=+1990.407013444"
Jul 07 19:24:01.589985 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:01.589945    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:01.597586 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:01.597562    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:02.226189 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:02.226160    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:02.227120 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:02.227098    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:03.208468 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.208440    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:24:03.589121 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.589089    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"]
Jul 07 19:24:03.596880 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.596852    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:24:03.598444 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.598415    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"]
Jul 07 19:24:03.600700 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.600394    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-6f2191-serving-cert\""
Jul 07 19:24:03.698902 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.698852    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db992\" (UniqueName: \"kubernetes.io/projected/505a89fd-d470-426a-acf0-996f6a83b302-kube-api-access-db992\") pod \"maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc\" (UID: \"505a89fd-d470-426a-acf0-996f6a83b302\") " pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:24:03.698902 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.698905    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/505a89fd-d470-426a-acf0-996f6a83b302-maas-api-tls\") pod \"maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc\" (UID: \"505a89fd-d470-426a-acf0-996f6a83b302\") " pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:24:03.699217 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.698942    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/505a89fd-d470-426a-acf0-996f6a83b302-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc\" (UID: \"505a89fd-d470-426a-acf0-996f6a83b302\") " pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:24:03.800486 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.800447    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db992\" (UniqueName: \"kubernetes.io/projected/505a89fd-d470-426a-acf0-996f6a83b302-kube-api-access-db992\") pod \"maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc\" (UID: \"505a89fd-d470-426a-acf0-996f6a83b302\") " pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:24:03.800662 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.800508    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/505a89fd-d470-426a-acf0-996f6a83b302-maas-api-tls\") pod \"maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc\" (UID: \"505a89fd-d470-426a-acf0-996f6a83b302\") " pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:24:03.800662 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.800553    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/505a89fd-d470-426a-acf0-996f6a83b302-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc\" (UID: \"505a89fd-d470-426a-acf0-996f6a83b302\") " pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:24:03.801317 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.801292    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/505a89fd-d470-426a-acf0-996f6a83b302-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc\" (UID: \"505a89fd-d470-426a-acf0-996f6a83b302\") " pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:24:03.803083 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.803058    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/505a89fd-d470-426a-acf0-996f6a83b302-maas-api-tls\") pod \"maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc\" (UID: \"505a89fd-d470-426a-acf0-996f6a83b302\") " pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:24:03.815158 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.815131    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db992\" (UniqueName: \"kubernetes.io/projected/505a89fd-d470-426a-acf0-996f6a83b302-kube-api-access-db992\") pod \"maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc\" (UID: \"505a89fd-d470-426a-acf0-996f6a83b302\") " pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:24:03.911737 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:03.911642    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:24:04.089105 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:04.088340    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"]
Jul 07 19:24:04.091628 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:24:04.091598    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod505a89fd_d470_426a_acf0_996f6a83b302.slice/crio-1af6c6a9051faa8d03a628d4f6ec9351f758de3ebe95e751f78cdadc1a67b077 WatchSource:0}: Error finding container 1af6c6a9051faa8d03a628d4f6ec9351f758de3ebe95e751f78cdadc1a67b077: Status 404 returned error can't find the container with id 1af6c6a9051faa8d03a628d4f6ec9351f758de3ebe95e751f78cdadc1a67b077
Jul 07 19:24:04.239267 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:04.239228    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc" event={"ID":"505a89fd-d470-426a-acf0-996f6a83b302","Type":"ContainerStarted","Data":"1af6c6a9051faa8d03a628d4f6ec9351f758de3ebe95e751f78cdadc1a67b077"}
Jul 07 19:24:05.245906 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:05.245868    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc" event={"ID":"505a89fd-d470-426a-acf0-996f6a83b302","Type":"ContainerStarted","Data":"cd4b4217dedd4154ffeb8bfdb9d9cfb98c09bd6e0ba614d6418bb62cac610938"}
Jul 07 19:24:05.246365 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:05.245976    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:24:05.270688 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:05.270621    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc" podStartSLOduration=1.9524876180000001 podStartE2EDuration="2.270602862s" totalImagesPullingTime="318.115244ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:24:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:24:05.267080099 +0000 UTC m=+1994.426419926" watchObservedRunningTime="2026-07-07 19:24:05.270602862 +0000 UTC m=+1994.429942690"
Jul 07 19:24:09.802574 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:09.802136    2554 patch_prober.go:28] interesting pod/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": read tcp 10.133.0.2:50102->10.133.0.66:15021: read: connection reset by peer" start-of-body=
Jul 07 19:24:09.802574 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:09.802199    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2" podUID="1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": read tcp 10.133.0.2:50102->10.133.0.66:15021: read: connection reset by peer"
Jul 07 19:24:10.279374 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:10.278421    2554 generic.go:356] "Generic (PLEG): container finished" podID="1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" containerID="3b0a95367960ee1d0a7332831aa712230fc088a3315202fbc0c8c96537cb9695" exitCode=0
Jul 07 19:24:10.279374 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:10.278512    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2" event={"ID":"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902","Type":"ContainerDied","Data":"3b0a95367960ee1d0a7332831aa712230fc088a3315202fbc0c8c96537cb9695"}
Jul 07 19:24:10.279374 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:10.279006    2554 scope.go:117] "RemoveContainer" containerID="3b0a95367960ee1d0a7332831aa712230fc088a3315202fbc0c8c96537cb9695"
Jul 07 19:24:10.280435 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:10.280404    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:24:10.280997 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:10.280969    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:24:10.281157 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:10.281139    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:24:11.256096 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:11.256065    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:24:11.291541 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:11.291501    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2" event={"ID":"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902","Type":"ContainerStarted","Data":"f6405badab4a1b8f3b37fba1e36af2508a7cd97834515cb905e3b056af496a08"}
Jul 07 19:24:11.970929 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:11.970890    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:24:11.971145 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:11.971012    2554 patch_prober.go:28] interesting pod/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 07 19:24:11.971145 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:11.971067    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2" podUID="1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 07 19:24:12.970963 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:12.970919    2554 patch_prober.go:28] interesting pod/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 07 19:24:12.971457 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:12.971004    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2" podUID="1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 07 19:24:13.971469 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:13.971005    2554 patch_prober.go:28] interesting pod/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 07 19:24:13.971469 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:13.971070    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2" podUID="1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 07 19:24:14.971287 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:14.971177    2554 patch_prober.go:28] interesting pod/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 07 19:24:14.971287 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:14.971255    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2" podUID="1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 07 19:24:15.313866 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:15.313833    2554 generic.go:356] "Generic (PLEG): container finished" podID="ca776572-1a42-4f94-9766-e0855bf5fa08" containerID="07cac45502e46331718ec22e263857227f31f6c4c01d70d60434727cd73153ee" exitCode=0
Jul 07 19:24:15.314059 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:15.313911    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd" event={"ID":"ca776572-1a42-4f94-9766-e0855bf5fa08","Type":"ContainerDied","Data":"07cac45502e46331718ec22e263857227f31f6c4c01d70d60434727cd73153ee"}
Jul 07 19:24:15.314363 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:15.314336    2554 scope.go:117] "RemoveContainer" containerID="07cac45502e46331718ec22e263857227f31f6c4c01d70d60434727cd73153ee"
Jul 07 19:24:15.315370 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:15.315346    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:24:15.315432 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:15.315416    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:24:15.315475 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:15.315449    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 19:24:15.973537 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:15.973508    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:24:15.973933 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:15.973826    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:24:15.974540 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:15.974519    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:24:16.328689 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:16.328647    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd" event={"ID":"ca776572-1a42-4f94-9766-e0855bf5fa08","Type":"ContainerStarted","Data":"e2ea215cffbd7903aede710e9d5fdc2ae240662eb32b3e8354fe1192ad0f24b7"}
Jul 07 19:24:16.589689 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:16.589595    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:16.590770 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:16.590740    2554 patch_prober.go:28] interesting pod/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 07 19:24:16.590915 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:16.590823    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd" podUID="ca776572-1a42-4f94-9766-e0855bf5fa08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 07 19:24:17.226656 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:17.226622    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:17.590153 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:17.590054    2554 patch_prober.go:28] interesting pod/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 07 19:24:17.590153 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:17.590120    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd" podUID="ca776572-1a42-4f94-9766-e0855bf5fa08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 07 19:24:18.590499 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:18.590015    2554 patch_prober.go:28] interesting pod/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 07 19:24:18.590499 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:18.590105    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd" podUID="ca776572-1a42-4f94-9766-e0855bf5fa08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 07 19:24:19.590344 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:19.590302    2554 patch_prober.go:28] interesting pod/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 07 19:24:19.590551 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:19.590368    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd" podUID="ca776572-1a42-4f94-9766-e0855bf5fa08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 07 19:24:20.593322 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:20.593292    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:24:20.594323 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:24:20.594303    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:25:51.422824 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:25:51.422784    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 19:25:51.433527 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:25:51.433503    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6nshg_423f17ea-41e4-4dd9-91a0-5ce6d13f31ee/ovn-acl-logging/0.log"
Jul 07 19:27:51.589429 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:27:51.589387    2554 scope.go:117] "RemoveContainer" containerID="c03eeba2d8a568b649255b76df129400e971c070d4753b40fc92e07fe0eb47a2"
Jul 07 19:28:57.178649 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.178613    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"]
Jul 07 19:28:57.179135 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.178826    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw" podUID="366d3b47-160b-4899-8297-178c6fb9ebe7" containerName="maas-api" containerID="cri-o://22a429c4b2d50e2cc541dcac97b33c8ba28370116038a1df8f2b75b9d6148ac1" gracePeriod=30
Jul 07 19:28:57.439615 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.439555    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:28:57.486006 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.485980    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hnq8\" (UniqueName: \"kubernetes.io/projected/366d3b47-160b-4899-8297-178c6fb9ebe7-kube-api-access-9hnq8\") pod \"366d3b47-160b-4899-8297-178c6fb9ebe7\" (UID: \"366d3b47-160b-4899-8297-178c6fb9ebe7\") "
Jul 07 19:28:57.486168 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.486020    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/366d3b47-160b-4899-8297-178c6fb9ebe7-maas-api-tls\") pod \"366d3b47-160b-4899-8297-178c6fb9ebe7\" (UID: \"366d3b47-160b-4899-8297-178c6fb9ebe7\") "
Jul 07 19:28:57.486168 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.486106    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/366d3b47-160b-4899-8297-178c6fb9ebe7-openshift-service-ca\") pod \"366d3b47-160b-4899-8297-178c6fb9ebe7\" (UID: \"366d3b47-160b-4899-8297-178c6fb9ebe7\") "
Jul 07 19:28:57.486516 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.486492    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/366d3b47-160b-4899-8297-178c6fb9ebe7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "366d3b47-160b-4899-8297-178c6fb9ebe7" (UID: "366d3b47-160b-4899-8297-178c6fb9ebe7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:28:57.488104 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.488078    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/366d3b47-160b-4899-8297-178c6fb9ebe7-kube-api-access-9hnq8" (OuterVolumeSpecName: "kube-api-access-9hnq8") pod "366d3b47-160b-4899-8297-178c6fb9ebe7" (UID: "366d3b47-160b-4899-8297-178c6fb9ebe7"). InnerVolumeSpecName "kube-api-access-9hnq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:28:57.488197 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.488153    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/366d3b47-160b-4899-8297-178c6fb9ebe7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "366d3b47-160b-4899-8297-178c6fb9ebe7" (UID: "366d3b47-160b-4899-8297-178c6fb9ebe7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:28:57.587482 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.587451    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/366d3b47-160b-4899-8297-178c6fb9ebe7-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:28:57.587482 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.587477    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hnq8\" (UniqueName: \"kubernetes.io/projected/366d3b47-160b-4899-8297-178c6fb9ebe7-kube-api-access-9hnq8\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:28:57.587482 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.587488    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/366d3b47-160b-4899-8297-178c6fb9ebe7-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:28:57.767225 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.767192    2554 generic.go:356] "Generic (PLEG): container finished" podID="366d3b47-160b-4899-8297-178c6fb9ebe7" containerID="22a429c4b2d50e2cc541dcac97b33c8ba28370116038a1df8f2b75b9d6148ac1" exitCode=0
Jul 07 19:28:57.767440 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.767235    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"
Jul 07 19:28:57.767440 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.767237    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw" event={"ID":"366d3b47-160b-4899-8297-178c6fb9ebe7","Type":"ContainerDied","Data":"22a429c4b2d50e2cc541dcac97b33c8ba28370116038a1df8f2b75b9d6148ac1"}
Jul 07 19:28:57.767440 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.767364    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw" event={"ID":"366d3b47-160b-4899-8297-178c6fb9ebe7","Type":"ContainerDied","Data":"44bb6922c7a6f55652d282576cfd25f1131add9268e7aaef9b4caedc34f95e79"}
Jul 07 19:28:57.767631 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.767421    2554 scope.go:117] "RemoveContainer" containerID="22a429c4b2d50e2cc541dcac97b33c8ba28370116038a1df8f2b75b9d6148ac1"
Jul 07 19:28:57.776974 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.776955    2554 scope.go:117] "RemoveContainer" containerID="22a429c4b2d50e2cc541dcac97b33c8ba28370116038a1df8f2b75b9d6148ac1"
Jul 07 19:28:57.777218 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:28:57.777201    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22a429c4b2d50e2cc541dcac97b33c8ba28370116038a1df8f2b75b9d6148ac1\": container with ID starting with 22a429c4b2d50e2cc541dcac97b33c8ba28370116038a1df8f2b75b9d6148ac1 not found: ID does not exist" containerID="22a429c4b2d50e2cc541dcac97b33c8ba28370116038a1df8f2b75b9d6148ac1"
Jul 07 19:28:57.777279 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.777229    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22a429c4b2d50e2cc541dcac97b33c8ba28370116038a1df8f2b75b9d6148ac1"} err="failed to get container status \"22a429c4b2d50e2cc541dcac97b33c8ba28370116038a1df8f2b75b9d6148ac1\": rpc error: code = NotFound desc = could not find container \"22a429c4b2d50e2cc541dcac97b33c8ba28370116038a1df8f2b75b9d6148ac1\": container with ID starting with 22a429c4b2d50e2cc541dcac97b33c8ba28370116038a1df8f2b75b9d6148ac1 not found: ID does not exist"
Jul 07 19:28:57.790256 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.790230    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"]
Jul 07 19:28:57.797344 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:57.797321    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-44233f-89db7fc9d-rplsw"]
Jul 07 19:28:59.474788 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:28:59.474752    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="366d3b47-160b-4899-8297-178c6fb9ebe7" path="/var/lib/kubelet/pods/366d3b47-160b-4899-8297-178c6fb9ebe7/volumes"
Jul 07 19:29:39.450983 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:39.450947    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"]
Jul 07 19:29:39.452620 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:39.451265    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2" podUID="1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" containerName="istio-proxy" containerID="cri-o://f6405badab4a1b8f3b37fba1e36af2508a7cd97834515cb905e3b056af496a08" gracePeriod=30
Jul 07 19:29:40.152647 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.152611    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"]
Jul 07 19:29:40.152918 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.152891    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc" podUID="505a89fd-d470-426a-acf0-996f6a83b302" containerName="maas-api" containerID="cri-o://cd4b4217dedd4154ffeb8bfdb9d9cfb98c09bd6e0ba614d6418bb62cac610938" gracePeriod=30
Jul 07 19:29:40.402418 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.402388    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:29:40.498147 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.498113    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db992\" (UniqueName: \"kubernetes.io/projected/505a89fd-d470-426a-acf0-996f6a83b302-kube-api-access-db992\") pod \"505a89fd-d470-426a-acf0-996f6a83b302\" (UID: \"505a89fd-d470-426a-acf0-996f6a83b302\") "
Jul 07 19:29:40.498617 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.498202    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/505a89fd-d470-426a-acf0-996f6a83b302-openshift-service-ca\") pod \"505a89fd-d470-426a-acf0-996f6a83b302\" (UID: \"505a89fd-d470-426a-acf0-996f6a83b302\") "
Jul 07 19:29:40.498617 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.498258    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/505a89fd-d470-426a-acf0-996f6a83b302-maas-api-tls\") pod \"505a89fd-d470-426a-acf0-996f6a83b302\" (UID: \"505a89fd-d470-426a-acf0-996f6a83b302\") "
Jul 07 19:29:40.498617 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.498540    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/505a89fd-d470-426a-acf0-996f6a83b302-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "505a89fd-d470-426a-acf0-996f6a83b302" (UID: "505a89fd-d470-426a-acf0-996f6a83b302"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:29:40.500254 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.500220    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/505a89fd-d470-426a-acf0-996f6a83b302-kube-api-access-db992" (OuterVolumeSpecName: "kube-api-access-db992") pod "505a89fd-d470-426a-acf0-996f6a83b302" (UID: "505a89fd-d470-426a-acf0-996f6a83b302"). InnerVolumeSpecName "kube-api-access-db992". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:29:40.500365 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.500287    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/505a89fd-d470-426a-acf0-996f6a83b302-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "505a89fd-d470-426a-acf0-996f6a83b302" (UID: "505a89fd-d470-426a-acf0-996f6a83b302"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:29:40.599880 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.599844    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/505a89fd-d470-426a-acf0-996f6a83b302-maas-api-tls\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:40.599880 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.599874    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db992\" (UniqueName: \"kubernetes.io/projected/505a89fd-d470-426a-acf0-996f6a83b302-kube-api-access-db992\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:40.599880 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.599884    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/505a89fd-d470-426a-acf0-996f6a83b302-openshift-service-ca\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:40.986245 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.986214    2554 generic.go:356] "Generic (PLEG): container finished" podID="505a89fd-d470-426a-acf0-996f6a83b302" containerID="cd4b4217dedd4154ffeb8bfdb9d9cfb98c09bd6e0ba614d6418bb62cac610938" exitCode=0
Jul 07 19:29:40.986428 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.986261    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"
Jul 07 19:29:40.986428 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.986270    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc" event={"ID":"505a89fd-d470-426a-acf0-996f6a83b302","Type":"ContainerDied","Data":"cd4b4217dedd4154ffeb8bfdb9d9cfb98c09bd6e0ba614d6418bb62cac610938"}
Jul 07 19:29:40.986428 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.986313    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc" event={"ID":"505a89fd-d470-426a-acf0-996f6a83b302","Type":"ContainerDied","Data":"1af6c6a9051faa8d03a628d4f6ec9351f758de3ebe95e751f78cdadc1a67b077"}
Jul 07 19:29:40.986428 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.986336    2554 scope.go:117] "RemoveContainer" containerID="cd4b4217dedd4154ffeb8bfdb9d9cfb98c09bd6e0ba614d6418bb62cac610938"
Jul 07 19:29:40.995586 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.995567    2554 scope.go:117] "RemoveContainer" containerID="cd4b4217dedd4154ffeb8bfdb9d9cfb98c09bd6e0ba614d6418bb62cac610938"
Jul 07 19:29:40.995899 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:29:40.995879    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd4b4217dedd4154ffeb8bfdb9d9cfb98c09bd6e0ba614d6418bb62cac610938\": container with ID starting with cd4b4217dedd4154ffeb8bfdb9d9cfb98c09bd6e0ba614d6418bb62cac610938 not found: ID does not exist" containerID="cd4b4217dedd4154ffeb8bfdb9d9cfb98c09bd6e0ba614d6418bb62cac610938"
Jul 07 19:29:40.995975 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:40.995913    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd4b4217dedd4154ffeb8bfdb9d9cfb98c09bd6e0ba614d6418bb62cac610938"} err="failed to get container status \"cd4b4217dedd4154ffeb8bfdb9d9cfb98c09bd6e0ba614d6418bb62cac610938\": rpc error: code = NotFound desc = could not find container \"cd4b4217dedd4154ffeb8bfdb9d9cfb98c09bd6e0ba614d6418bb62cac610938\": container with ID starting with cd4b4217dedd4154ffeb8bfdb9d9cfb98c09bd6e0ba614d6418bb62cac610938 not found: ID does not exist"
Jul 07 19:29:41.011109 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:41.011076    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"]
Jul 07 19:29:41.014394 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:41.014372    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6f2191-84594d678d-nv6vc"]
Jul 07 19:29:41.474595 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:41.474516    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="505a89fd-d470-426a-acf0-996f6a83b302" path="/var/lib/kubelet/pods/505a89fd-d470-426a-acf0-996f6a83b302/volumes"
Jul 07 19:29:44.702411 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.702383    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:29:44.841133 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841096    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-envoy\") pod \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") "
Jul 07 19:29:44.841327 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841173    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-workload-certs\") pod \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") "
Jul 07 19:29:44.841327 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841207    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-credential-socket\") pod \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") "
Jul 07 19:29:44.841327 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841227    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-token\") pod \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") "
Jul 07 19:29:44.841327 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841255    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-workload-socket\") pod \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") "
Jul 07 19:29:44.841327 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841288    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-podinfo\") pod \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") "
Jul 07 19:29:44.841327 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841324    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wq45b\" (UniqueName: \"kubernetes.io/projected/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-kube-api-access-wq45b\") pod \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") "
Jul 07 19:29:44.841651 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841358    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istiod-ca-cert\") pod \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") "
Jul 07 19:29:44.841651 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841381    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-data\") pod \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\" (UID: \"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902\") "
Jul 07 19:29:44.841651 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841515    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" (UID: "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:44.841651 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841544    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" (UID: "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:44.841897 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841721    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:44.841897 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841744    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:44.841991 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841884    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" (UID: "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:44.841991 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.841894    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" (UID: "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:29:44.842410 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.842383    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" (UID: "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:44.843520 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.843500    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" (UID: "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:29:44.843616 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.843598    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-kube-api-access-wq45b" (OuterVolumeSpecName: "kube-api-access-wq45b") pod "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" (UID: "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902"). InnerVolumeSpecName "kube-api-access-wq45b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:29:44.843829 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.843792    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" (UID: "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:44.843882 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.843857    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" (UID: "1d89d4c8-2f1a-4fde-b222-5a37a3ad1902"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:29:44.943235 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.943198    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:44.943235 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.943231    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:44.943429 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.943246    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wq45b\" (UniqueName: \"kubernetes.io/projected/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-kube-api-access-wq45b\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:44.943429 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.943260    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:44.943429 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.943273    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:44.943429 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.943284    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:44.943429 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:44.943296    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:45.012912 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:45.012874    2554 generic.go:356] "Generic (PLEG): container finished" podID="1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" containerID="f6405badab4a1b8f3b37fba1e36af2508a7cd97834515cb905e3b056af496a08" exitCode=0
Jul 07 19:29:45.013035 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:45.012929    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"
Jul 07 19:29:45.013035 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:45.012962    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2" event={"ID":"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902","Type":"ContainerDied","Data":"f6405badab4a1b8f3b37fba1e36af2508a7cd97834515cb905e3b056af496a08"}
Jul 07 19:29:45.013035 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:45.013018    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2" event={"ID":"1d89d4c8-2f1a-4fde-b222-5a37a3ad1902","Type":"ContainerDied","Data":"3d5581311c74c71a5d03b9088362e3e3a6a0870d4febeda79ec33798028e513b"}
Jul 07 19:29:45.013168 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:45.013041    2554 scope.go:117] "RemoveContainer" containerID="f6405badab4a1b8f3b37fba1e36af2508a7cd97834515cb905e3b056af496a08"
Jul 07 19:29:45.022143 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:45.022124    2554 scope.go:117] "RemoveContainer" containerID="3b0a95367960ee1d0a7332831aa712230fc088a3315202fbc0c8c96537cb9695"
Jul 07 19:29:45.030229 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:45.030212    2554 scope.go:117] "RemoveContainer" containerID="f6405badab4a1b8f3b37fba1e36af2508a7cd97834515cb905e3b056af496a08"
Jul 07 19:29:45.030468 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:29:45.030448    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6405badab4a1b8f3b37fba1e36af2508a7cd97834515cb905e3b056af496a08\": container with ID starting with f6405badab4a1b8f3b37fba1e36af2508a7cd97834515cb905e3b056af496a08 not found: ID does not exist" containerID="f6405badab4a1b8f3b37fba1e36af2508a7cd97834515cb905e3b056af496a08"
Jul 07 19:29:45.030546 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:45.030481    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6405badab4a1b8f3b37fba1e36af2508a7cd97834515cb905e3b056af496a08"} err="failed to get container status \"f6405badab4a1b8f3b37fba1e36af2508a7cd97834515cb905e3b056af496a08\": rpc error: code = NotFound desc = could not find container \"f6405badab4a1b8f3b37fba1e36af2508a7cd97834515cb905e3b056af496a08\": container with ID starting with f6405badab4a1b8f3b37fba1e36af2508a7cd97834515cb905e3b056af496a08 not found: ID does not exist"
Jul 07 19:29:45.030546 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:45.030505    2554 scope.go:117] "RemoveContainer" containerID="3b0a95367960ee1d0a7332831aa712230fc088a3315202fbc0c8c96537cb9695"
Jul 07 19:29:45.030760 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:29:45.030742    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b0a95367960ee1d0a7332831aa712230fc088a3315202fbc0c8c96537cb9695\": container with ID starting with 3b0a95367960ee1d0a7332831aa712230fc088a3315202fbc0c8c96537cb9695 not found: ID does not exist" containerID="3b0a95367960ee1d0a7332831aa712230fc088a3315202fbc0c8c96537cb9695"
Jul 07 19:29:45.030813 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:45.030766    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b0a95367960ee1d0a7332831aa712230fc088a3315202fbc0c8c96537cb9695"} err="failed to get container status \"3b0a95367960ee1d0a7332831aa712230fc088a3315202fbc0c8c96537cb9695\": rpc error: code = NotFound desc = could not find container \"3b0a95367960ee1d0a7332831aa712230fc088a3315202fbc0c8c96537cb9695\": container with ID starting with 3b0a95367960ee1d0a7332831aa712230fc088a3315202fbc0c8c96537cb9695 not found: ID does not exist"
Jul 07 19:29:45.036715 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:45.036691    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"]
Jul 07 19:29:45.041600 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:45.041579    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-44233f-openshift-default-9d7bcc5c5-hzlv2"]
Jul 07 19:29:45.475368 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:45.475333    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" path="/var/lib/kubelet/pods/1d89d4c8-2f1a-4fde-b222-5a37a3ad1902/volumes"
Jul 07 19:29:46.768642 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:46.768612    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"]
Jul 07 19:29:46.769178 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:46.768870    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd" podUID="ca776572-1a42-4f94-9766-e0855bf5fa08" containerName="istio-proxy" containerID="cri-o://e2ea215cffbd7903aede710e9d5fdc2ae240662eb32b3e8354fe1192ad0f24b7" gracePeriod=30
Jul 07 19:29:50.596182 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:50.596145    2554 patch_prober.go:28] interesting pod/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 19:29:50.596556 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:50.596230    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd" podUID="ca776572-1a42-4f94-9766-e0855bf5fa08" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 19:29:52.030105 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.030081    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:29:52.048170 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.048141    2554 generic.go:356] "Generic (PLEG): container finished" podID="ca776572-1a42-4f94-9766-e0855bf5fa08" containerID="e2ea215cffbd7903aede710e9d5fdc2ae240662eb32b3e8354fe1192ad0f24b7" exitCode=0
Jul 07 19:29:52.048301 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.048192    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"
Jul 07 19:29:52.048301 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.048198    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd" event={"ID":"ca776572-1a42-4f94-9766-e0855bf5fa08","Type":"ContainerDied","Data":"e2ea215cffbd7903aede710e9d5fdc2ae240662eb32b3e8354fe1192ad0f24b7"}
Jul 07 19:29:52.048301 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.048239    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd" event={"ID":"ca776572-1a42-4f94-9766-e0855bf5fa08","Type":"ContainerDied","Data":"da0f5dbf6922b0bef525ddc15d887677754d73a70abebbb9a883944e3753419c"}
Jul 07 19:29:52.048301 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.048260    2554 scope.go:117] "RemoveContainer" containerID="e2ea215cffbd7903aede710e9d5fdc2ae240662eb32b3e8354fe1192ad0f24b7"
Jul 07 19:29:52.058070 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.058049    2554 scope.go:117] "RemoveContainer" containerID="07cac45502e46331718ec22e263857227f31f6c4c01d70d60434727cd73153ee"
Jul 07 19:29:52.065855 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.065832    2554 scope.go:117] "RemoveContainer" containerID="e2ea215cffbd7903aede710e9d5fdc2ae240662eb32b3e8354fe1192ad0f24b7"
Jul 07 19:29:52.066129 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:29:52.066108    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2ea215cffbd7903aede710e9d5fdc2ae240662eb32b3e8354fe1192ad0f24b7\": container with ID starting with e2ea215cffbd7903aede710e9d5fdc2ae240662eb32b3e8354fe1192ad0f24b7 not found: ID does not exist" containerID="e2ea215cffbd7903aede710e9d5fdc2ae240662eb32b3e8354fe1192ad0f24b7"
Jul 07 19:29:52.066189 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.066137    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2ea215cffbd7903aede710e9d5fdc2ae240662eb32b3e8354fe1192ad0f24b7"} err="failed to get container status \"e2ea215cffbd7903aede710e9d5fdc2ae240662eb32b3e8354fe1192ad0f24b7\": rpc error: code = NotFound desc = could not find container \"e2ea215cffbd7903aede710e9d5fdc2ae240662eb32b3e8354fe1192ad0f24b7\": container with ID starting with e2ea215cffbd7903aede710e9d5fdc2ae240662eb32b3e8354fe1192ad0f24b7 not found: ID does not exist"
Jul 07 19:29:52.066189 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.066155    2554 scope.go:117] "RemoveContainer" containerID="07cac45502e46331718ec22e263857227f31f6c4c01d70d60434727cd73153ee"
Jul 07 19:29:52.066423 ip-10-0-128-118 kubenswrapper[2554]: E0707 19:29:52.066407    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07cac45502e46331718ec22e263857227f31f6c4c01d70d60434727cd73153ee\": container with ID starting with 07cac45502e46331718ec22e263857227f31f6c4c01d70d60434727cd73153ee not found: ID does not exist" containerID="07cac45502e46331718ec22e263857227f31f6c4c01d70d60434727cd73153ee"
Jul 07 19:29:52.066465 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.066428    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07cac45502e46331718ec22e263857227f31f6c4c01d70d60434727cd73153ee"} err="failed to get container status \"07cac45502e46331718ec22e263857227f31f6c4c01d70d60434727cd73153ee\": rpc error: code = NotFound desc = could not find container \"07cac45502e46331718ec22e263857227f31f6c4c01d70d60434727cd73153ee\": container with ID starting with 07cac45502e46331718ec22e263857227f31f6c4c01d70d60434727cd73153ee not found: ID does not exist"
Jul 07 19:29:52.116393 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.116367    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-data\") pod \"ca776572-1a42-4f94-9766-e0855bf5fa08\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") "
Jul 07 19:29:52.116558 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.116402    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca776572-1a42-4f94-9766-e0855bf5fa08-istiod-ca-cert\") pod \"ca776572-1a42-4f94-9766-e0855bf5fa08\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") "
Jul 07 19:29:52.116558 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.116432    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-token\") pod \"ca776572-1a42-4f94-9766-e0855bf5fa08\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") "
Jul 07 19:29:52.116558 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.116465    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkx8r\" (UniqueName: \"kubernetes.io/projected/ca776572-1a42-4f94-9766-e0855bf5fa08-kube-api-access-rkx8r\") pod \"ca776572-1a42-4f94-9766-e0855bf5fa08\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") "
Jul 07 19:29:52.116558 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.116493    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-credential-socket\") pod \"ca776572-1a42-4f94-9766-e0855bf5fa08\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") "
Jul 07 19:29:52.116558 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.116521    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-podinfo\") pod \"ca776572-1a42-4f94-9766-e0855bf5fa08\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") "
Jul 07 19:29:52.116858 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.116568    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-envoy\") pod \"ca776572-1a42-4f94-9766-e0855bf5fa08\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") "
Jul 07 19:29:52.116858 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.116617    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-workload-socket\") pod \"ca776572-1a42-4f94-9766-e0855bf5fa08\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") "
Jul 07 19:29:52.116858 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.116657    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-workload-certs\") pod \"ca776572-1a42-4f94-9766-e0855bf5fa08\" (UID: \"ca776572-1a42-4f94-9766-e0855bf5fa08\") "
Jul 07 19:29:52.116858 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.116816    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ca776572-1a42-4f94-9766-e0855bf5fa08" (UID: "ca776572-1a42-4f94-9766-e0855bf5fa08"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:52.116858 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.116832    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca776572-1a42-4f94-9766-e0855bf5fa08-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ca776572-1a42-4f94-9766-e0855bf5fa08" (UID: "ca776572-1a42-4f94-9766-e0855bf5fa08"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:29:52.117136 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.117003    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ca776572-1a42-4f94-9766-e0855bf5fa08" (UID: "ca776572-1a42-4f94-9766-e0855bf5fa08"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:52.117136 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.117046    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ca776572-1a42-4f94-9766-e0855bf5fa08" (UID: "ca776572-1a42-4f94-9766-e0855bf5fa08"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:52.117136 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.117053    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca776572-1a42-4f94-9766-e0855bf5fa08-istiod-ca-cert\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:52.117136 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.117069    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-credential-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:52.117344 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.117244    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-data" (OuterVolumeSpecName: "istio-data") pod "ca776572-1a42-4f94-9766-e0855bf5fa08" (UID: "ca776572-1a42-4f94-9766-e0855bf5fa08"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:52.118750 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.118716    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ca776572-1a42-4f94-9766-e0855bf5fa08" (UID: "ca776572-1a42-4f94-9766-e0855bf5fa08"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:29:52.118900 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.118793    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-token" (OuterVolumeSpecName: "istio-token") pod "ca776572-1a42-4f94-9766-e0855bf5fa08" (UID: "ca776572-1a42-4f94-9766-e0855bf5fa08"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:29:52.118900 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.118832    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca776572-1a42-4f94-9766-e0855bf5fa08-kube-api-access-rkx8r" (OuterVolumeSpecName: "kube-api-access-rkx8r") pod "ca776572-1a42-4f94-9766-e0855bf5fa08" (UID: "ca776572-1a42-4f94-9766-e0855bf5fa08"). InnerVolumeSpecName "kube-api-access-rkx8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:29:52.118989 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.118911    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ca776572-1a42-4f94-9766-e0855bf5fa08" (UID: "ca776572-1a42-4f94-9766-e0855bf5fa08"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:29:52.141736 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.141680    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gj85x_113732e4-4b05-4049-b144-2338272e3a23/manager/0.log"
Jul 07 19:29:52.218263 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.218233    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-token\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:52.218263 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.218258    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkx8r\" (UniqueName: \"kubernetes.io/projected/ca776572-1a42-4f94-9766-e0855bf5fa08-kube-api-access-rkx8r\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:52.218263 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.218267    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-podinfo\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:52.218484 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.218277    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-envoy\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:52.218484 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.218286    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-workload-socket\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:52.218484 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.218295    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-workload-certs\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:52.218484 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.218303    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca776572-1a42-4f94-9766-e0855bf5fa08-istio-data\") on node \"ip-10-0-128-118.ec2.internal\" DevicePath \"\""
Jul 07 19:29:52.262396 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.262370    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hf5jm_fed60534-9655-4759-ab42-f722b1bf1f20/manager/0.log"
Jul 07 19:29:52.379545 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.376119    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"]
Jul 07 19:29:52.382338 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.382310    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-6f2191-openshift-default-55b48ff97f-nfvsd"]
Jul 07 19:29:52.390168 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.390132    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5fcf4f568d-7znxx_bf8448f0-d085-4f78-91a7-e3ca17534ddd/maas-api/0.log"
Jul 07 19:29:52.750987 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:52.750958    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74cdf475f-wg7f4_ab8931c9-cab8-42ea-bf20-d0b81e16e1ef/manager/0.log"
Jul 07 19:29:53.106640 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:53.106556    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6465cd6bcf-d2r84_54277aa2-6b22-4c76-a7b0-1c8173aef939/copy-manifests/0.log"
Jul 07 19:29:53.114559 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:53.114540    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6465cd6bcf-d2r84_54277aa2-6b22-4c76-a7b0-1c8173aef939/manager/0.log"
Jul 07 19:29:53.474589 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:53.474509    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca776572-1a42-4f94-9766-e0855bf5fa08" path="/var/lib/kubelet/pods/ca776572-1a42-4f94-9766-e0855bf5fa08/volumes"
Jul 07 19:29:53.483315 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:53.483295    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-764d8_410bced3-113f-42f0-a965-4a9eaafa88f7/postgres/0.log"
Jul 07 19:29:54.924290 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:54.924262    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qzg7p_bad913ef-2d27-4444-bb1b-8f6f8b466b86/manager/0.log"
Jul 07 19:29:55.043111 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:55.043078    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cgnl5_60978477-8e49-453a-ba82-f5e479edd8ea/manager/0.log"
Jul 07 19:29:55.153486 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:55.153460    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6mt8f_17b87a87-3137-49e8-bfc5-3119d5a25974/kuadrant-console-plugin/0.log"
Jul 07 19:29:55.271825 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:55.271787    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-c7kgr_57d65a96-222f-4361-874d-8d4a2673fdff/registry-server/0.log"
Jul 07 19:29:55.644481 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:55.644393    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qptkl_3c372f48-e347-4aae-84e9-eae58d31cd37/manager/0.log"
Jul 07 19:29:56.009761 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:56.009727    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf458g9b_d5f842c3-1411-4252-bccd-2cb4fd9b0296/istio-proxy/0.log"
Jul 07 19:29:56.381942 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:56.381840    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bc96858-pn7fs_46e8bd7d-5903-4ca0-a985-fb0dd1dc7168/kube-auth-proxy/0.log"
Jul 07 19:29:56.503164 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:56.503121    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4tmq_7403f0c3-7607-4d6a-9b33-232877bea187/istio-proxy/1.log"
Jul 07 19:29:56.624023 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:56.623996    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-q68pg_f66922a2-9690-47d6-a1c8-8a43dbeeb1b7/payload-pre-processing/0.log"
Jul 07 19:29:56.746918 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:56.746888    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x8vgz_7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8/payload-processing/0.log"
Jul 07 19:29:57.226494 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:57.226466    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-6dbmc_b1bee22e-30d1-4a52-9e82-78d2bfcfd0cd/main/0.log"
Jul 07 19:29:57.468349 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:29:57.468319    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-dzkxr_2591f05f-566f-44b2-b054-98b2a42ba7e0/main/0.log"
Jul 07 19:30:05.148574 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:05.148543    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f76tc_9467a0f3-0b26-4d87-b1de-0fcf62a224ec/global-pull-secret-syncer/0.log"
Jul 07 19:30:05.291975 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:05.291946    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bd6mt_41ccf198-2ae4-4b4d-908b-dcdff0614253/konnectivity-agent/0.log"
Jul 07 19:30:05.348486 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:05.348458    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-118.ec2.internal_157622ff2cd69c4f1b3676d86c923065/haproxy/0.log"
Jul 07 19:30:10.378210 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:10.378180    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qzg7p_bad913ef-2d27-4444-bb1b-8f6f8b466b86/manager/0.log"
Jul 07 19:30:10.412419 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:10.412393    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cgnl5_60978477-8e49-453a-ba82-f5e479edd8ea/manager/0.log"
Jul 07 19:30:10.446320 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:10.446295    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6mt8f_17b87a87-3137-49e8-bfc5-3119d5a25974/kuadrant-console-plugin/0.log"
Jul 07 19:30:10.496320 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:10.496293    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-c7kgr_57d65a96-222f-4361-874d-8d4a2673fdff/registry-server/0.log"
Jul 07 19:30:10.764098 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:10.764055    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qptkl_3c372f48-e347-4aae-84e9-eae58d31cd37/manager/0.log"
Jul 07 19:30:12.739296 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:12.739272    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-pfdjn_3c92739e-dfff-4707-a4e0-a59624579add/monitoring-plugin/0.log"
Jul 07 19:30:12.969189 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:12.969142    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqwmx_9c674a43-baea-4422-897d-2c3d3c9add1e/node-exporter/0.log"
Jul 07 19:30:12.994566 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:12.994475    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqwmx_9c674a43-baea-4422-897d-2c3d3c9add1e/kube-rbac-proxy/0.log"
Jul 07 19:30:13.025033 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:13.025013    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqwmx_9c674a43-baea-4422-897d-2c3d3c9add1e/init-textfile/0.log"
Jul 07 19:30:13.584022 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:13.583969    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67587cbcb6-6hlnj_c8c8a24c-43b5-46d6-8647-0cd74c0110e0/thanos-query/0.log"
Jul 07 19:30:13.614153 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:13.614103    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67587cbcb6-6hlnj_c8c8a24c-43b5-46d6-8647-0cd74c0110e0/kube-rbac-proxy-web/0.log"
Jul 07 19:30:13.641093 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:13.641069    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67587cbcb6-6hlnj_c8c8a24c-43b5-46d6-8647-0cd74c0110e0/kube-rbac-proxy/0.log"
Jul 07 19:30:13.668242 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:13.668222    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67587cbcb6-6hlnj_c8c8a24c-43b5-46d6-8647-0cd74c0110e0/prom-label-proxy/0.log"
Jul 07 19:30:13.696892 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:13.696852    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67587cbcb6-6hlnj_c8c8a24c-43b5-46d6-8647-0cd74c0110e0/kube-rbac-proxy-rules/0.log"
Jul 07 19:30:13.725360 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:13.725326    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67587cbcb6-6hlnj_c8c8a24c-43b5-46d6-8647-0cd74c0110e0/kube-rbac-proxy-metrics/0.log"
Jul 07 19:30:14.732455 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732420    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"]
Jul 07 19:30:14.732850 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732813    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="366d3b47-160b-4899-8297-178c6fb9ebe7" containerName="maas-api"
Jul 07 19:30:14.732850 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732829    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="366d3b47-160b-4899-8297-178c6fb9ebe7" containerName="maas-api"
Jul 07 19:30:14.732850 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732842    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" containerName="istio-proxy"
Jul 07 19:30:14.732850 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732851    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" containerName="istio-proxy"
Jul 07 19:30:14.732987 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732861    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" containerName="istio-proxy"
Jul 07 19:30:14.732987 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732867    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" containerName="istio-proxy"
Jul 07 19:30:14.732987 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732873    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="505a89fd-d470-426a-acf0-996f6a83b302" containerName="maas-api"
Jul 07 19:30:14.732987 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732878    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="505a89fd-d470-426a-acf0-996f6a83b302" containerName="maas-api"
Jul 07 19:30:14.732987 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732884    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca776572-1a42-4f94-9766-e0855bf5fa08" containerName="istio-proxy"
Jul 07 19:30:14.732987 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732889    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca776572-1a42-4f94-9766-e0855bf5fa08" containerName="istio-proxy"
Jul 07 19:30:14.732987 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732902    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca776572-1a42-4f94-9766-e0855bf5fa08" containerName="istio-proxy"
Jul 07 19:30:14.732987 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732909    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca776572-1a42-4f94-9766-e0855bf5fa08" containerName="istio-proxy"
Jul 07 19:30:14.732987 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732970    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca776572-1a42-4f94-9766-e0855bf5fa08" containerName="istio-proxy"
Jul 07 19:30:14.732987 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732978    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d89d4c8-2f1a-4fde-b222-5a37a3ad1902" containerName="istio-proxy"
Jul 07 19:30:14.732987 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732983    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="505a89fd-d470-426a-acf0-996f6a83b302" containerName="maas-api"
Jul 07 19:30:14.732987 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732991    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca776572-1a42-4f94-9766-e0855bf5fa08" containerName="istio-proxy"
Jul 07 19:30:14.733339 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.732998    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="366d3b47-160b-4899-8297-178c6fb9ebe7" containerName="maas-api"
Jul 07 19:30:14.736022 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.736004    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.743829 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.741176    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4nkfb\"/\"default-dockercfg-br8pn\""
Jul 07 19:30:14.743829 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.741462    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4nkfb\"/\"openshift-service-ca.crt\""
Jul 07 19:30:14.743829 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.742438    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4nkfb\"/\"kube-root-ca.crt\""
Jul 07 19:30:14.751023 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.751000    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"]
Jul 07 19:30:14.822553 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.822507    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44c00b12-4976-47b8-97dc-7f91b8d33aee-lib-modules\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.822553 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.822554    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/44c00b12-4976-47b8-97dc-7f91b8d33aee-podres\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.822773 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.822596    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xpxb\" (UniqueName: \"kubernetes.io/projected/44c00b12-4976-47b8-97dc-7f91b8d33aee-kube-api-access-2xpxb\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.822773 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.822629    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44c00b12-4976-47b8-97dc-7f91b8d33aee-sys\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.822773 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.822687    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/44c00b12-4976-47b8-97dc-7f91b8d33aee-proc\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.915007 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.914976    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-hzff8_dc458f9c-4c0f-40f0-84c3-b14b7daa7c08/networking-console-plugin/0.log"
Jul 07 19:30:14.923620 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.923597    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/44c00b12-4976-47b8-97dc-7f91b8d33aee-proc\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.923748 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.923671    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44c00b12-4976-47b8-97dc-7f91b8d33aee-lib-modules\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.923748 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.923699    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/44c00b12-4976-47b8-97dc-7f91b8d33aee-podres\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.923748 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.923720    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/44c00b12-4976-47b8-97dc-7f91b8d33aee-proc\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.923748 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.923741    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xpxb\" (UniqueName: \"kubernetes.io/projected/44c00b12-4976-47b8-97dc-7f91b8d33aee-kube-api-access-2xpxb\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.924001 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.923834    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44c00b12-4976-47b8-97dc-7f91b8d33aee-sys\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.924001 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.923851    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/44c00b12-4976-47b8-97dc-7f91b8d33aee-lib-modules\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.924001 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.923862    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/44c00b12-4976-47b8-97dc-7f91b8d33aee-podres\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.924001 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.923926    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/44c00b12-4976-47b8-97dc-7f91b8d33aee-sys\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:14.933117 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:14.933099    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xpxb\" (UniqueName: \"kubernetes.io/projected/44c00b12-4976-47b8-97dc-7f91b8d33aee-kube-api-access-2xpxb\") pod \"perf-node-gather-daemonset-96fgk\" (UID: \"44c00b12-4976-47b8-97dc-7f91b8d33aee\") " pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:15.049751 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:15.049650    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:15.184643 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:15.184615    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"]
Jul 07 19:30:15.186600 ip-10-0-128-118 kubenswrapper[2554]: W0707 19:30:15.186570    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod44c00b12_4976_47b8_97dc_7f91b8d33aee.slice/crio-2d12618d390bcba857d8641fc4f8450fb1c3b04994ecd7bc212713d8707e1012 WatchSource:0}: Error finding container 2d12618d390bcba857d8641fc4f8450fb1c3b04994ecd7bc212713d8707e1012: Status 404 returned error can't find the container with id 2d12618d390bcba857d8641fc4f8450fb1c3b04994ecd7bc212713d8707e1012
Jul 07 19:30:16.071964 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:16.071931    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d6f565794-4h6m4_9b51b5b1-0339-4a8d-95a1-f6ebe6bcc388/console/0.log"
Jul 07 19:30:16.109064 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:16.109037    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-zsqss_bba9d0d3-22b2-4b68-9e09-18900df3c331/download-server/0.log"
Jul 07 19:30:16.169828 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:16.169774    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk" event={"ID":"44c00b12-4976-47b8-97dc-7f91b8d33aee","Type":"ContainerStarted","Data":"056ea0e8ac94eb984ee7903e9adf9f74eeca44fa378cb24658af276cd88b1814"}
Jul 07 19:30:16.170005 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:16.169855    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk" event={"ID":"44c00b12-4976-47b8-97dc-7f91b8d33aee","Type":"ContainerStarted","Data":"2d12618d390bcba857d8641fc4f8450fb1c3b04994ecd7bc212713d8707e1012"}
Jul 07 19:30:16.170005 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:16.169899    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:16.192127 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:16.192078    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk" podStartSLOduration=2.19206208 podStartE2EDuration="2.19206208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:30:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:30:16.190633107 +0000 UTC m=+2365.349972934" watchObservedRunningTime="2026-07-07 19:30:16.19206208 +0000 UTC m=+2365.351401905"
Jul 07 19:30:17.991301 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:17.991273    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z4g8n_6511f0b7-aea0-4426-94dc-005303e704a9/dns/0.log"
Jul 07 19:30:18.016312 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:18.016286    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z4g8n_6511f0b7-aea0-4426-94dc-005303e704a9/kube-rbac-proxy/0.log"
Jul 07 19:30:18.084300 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:18.084273    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f5gzx_19bf2468-4a15-4e76-9c66-6d26e6a73d93/dns-node-resolver/0.log"
Jul 07 19:30:18.761839 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:18.761790    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bbt8z_eddf68ee-cdbb-4e8e-8b32-b86fb51faaec/node-ca/0.log"
Jul 07 19:30:19.752820 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:19.752769    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf458g9b_d5f842c3-1411-4252-bccd-2cb4fd9b0296/istio-proxy/0.log"
Jul 07 19:30:20.008823 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:20.008729    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bc96858-pn7fs_46e8bd7d-5903-4ca0-a985-fb0dd1dc7168/kube-auth-proxy/0.log"
Jul 07 19:30:20.043749 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:20.043717    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4tmq_7403f0c3-7607-4d6a-9b33-232877bea187/istio-proxy/0.log"
Jul 07 19:30:20.072312 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:20.072283    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4tmq_7403f0c3-7607-4d6a-9b33-232877bea187/istio-proxy/1.log"
Jul 07 19:30:20.107912 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:20.107882    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-q68pg_f66922a2-9690-47d6-a1c8-8a43dbeeb1b7/payload-pre-processing/0.log"
Jul 07 19:30:20.158367 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:20.158339    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x8vgz_7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8/payload-processing/0.log"
Jul 07 19:30:20.877518 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:20.877488    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-44ls7_c8400145-1a5f-4af0-9788-2220d231366b/serve-healthcheck-canary/0.log"
Jul 07 19:30:21.643038 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:21.643006    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qk2v2_50cd60eb-0be0-44ce-bfc4-924b7be73740/kube-rbac-proxy/0.log"
Jul 07 19:30:21.669259 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:21.669232    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qk2v2_50cd60eb-0be0-44ce-bfc4-924b7be73740/exporter/0.log"
Jul 07 19:30:21.695393 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:21.695344    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qk2v2_50cd60eb-0be0-44ce-bfc4-924b7be73740/extractor/0.log"
Jul 07 19:30:22.185024 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:22.184998    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4nkfb/perf-node-gather-daemonset-96fgk"
Jul 07 19:30:23.978851 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:23.978815    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-gj85x_113732e4-4b05-4049-b144-2338272e3a23/manager/0.log"
Jul 07 19:30:24.131634 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:24.131489    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hf5jm_fed60534-9655-4759-ab42-f722b1bf1f20/manager/0.log"
Jul 07 19:30:24.176975 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:24.176946    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5fcf4f568d-7znxx_bf8448f0-d085-4f78-91a7-e3ca17534ddd/maas-api/0.log"
Jul 07 19:30:24.383687 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:24.383582    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74cdf475f-wg7f4_ab8931c9-cab8-42ea-bf20-d0b81e16e1ef/manager/0.log"
Jul 07 19:30:24.518665 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:24.518634    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6465cd6bcf-d2r84_54277aa2-6b22-4c76-a7b0-1c8173aef939/manager/0.log"
Jul 07 19:30:24.549694 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:24.549668    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6465cd6bcf-d2r84_54277aa2-6b22-4c76-a7b0-1c8173aef939/copy-manifests/0.log"
Jul 07 19:30:24.771435 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:24.771407    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-764d8_410bced3-113f-42f0-a965-4a9eaafa88f7/postgres/0.log"
Jul 07 19:30:25.212607 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:25.212529    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf458g9b_d5f842c3-1411-4252-bccd-2cb4fd9b0296/istio-proxy/0.log"
Jul 07 19:30:25.434901 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:25.434876    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bc96858-pn7fs_46e8bd7d-5903-4ca0-a985-fb0dd1dc7168/kube-auth-proxy/0.log"
Jul 07 19:30:25.455779 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:25.455739    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4tmq_7403f0c3-7607-4d6a-9b33-232877bea187/istio-proxy/0.log"
Jul 07 19:30:25.486192 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:25.486163    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4tmq_7403f0c3-7607-4d6a-9b33-232877bea187/istio-proxy/1.log"
Jul 07 19:30:25.520845 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:25.520817    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-q68pg_f66922a2-9690-47d6-a1c8-8a43dbeeb1b7/payload-pre-processing/0.log"
Jul 07 19:30:25.568032 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:25.568005    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x8vgz_7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8/payload-processing/0.log"
Jul 07 19:30:26.795687 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:26.795658    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf458g9b_d5f842c3-1411-4252-bccd-2cb4fd9b0296/istio-proxy/0.log"
Jul 07 19:30:27.031219 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:27.031192    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-566bc96858-pn7fs_46e8bd7d-5903-4ca0-a985-fb0dd1dc7168/kube-auth-proxy/0.log"
Jul 07 19:30:27.057788 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:27.057694    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4tmq_7403f0c3-7607-4d6a-9b33-232877bea187/istio-proxy/0.log"
Jul 07 19:30:27.090131 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:27.090093    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4tmq_7403f0c3-7607-4d6a-9b33-232877bea187/istio-proxy/1.log"
Jul 07 19:30:27.114991 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:27.114957    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-q68pg_f66922a2-9690-47d6-a1c8-8a43dbeeb1b7/payload-pre-processing/0.log"
Jul 07 19:30:27.160518 ip-10-0-128-118 kubenswrapper[2554]: I0707 19:30:27.160488    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-x8vgz_7f77b55e-a96b-4cea-bb5b-15d63eb3ffd8/payload-processing/0.log"