Jul 06 19:03:48.810822 ip-10-0-133-117 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 19:03:48.810834 ip-10-0-133-117 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 19:03:48.810841 ip-10-0-133-117 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 19:03:48.811113 ip-10-0-133-117 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 19:03:58.039114 ip-10-0-133-117 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 19:03:58.039128 ip-10-0-133-117 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7c79bd17824f47ecb5da4fea56a07ad8 --
Jul 06 19:05:26.275042 ip-10-0-133-117 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 19:05:26.687287 ip-10-0-133-117 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:05:26.687287 ip-10-0-133-117 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 19:05:26.687287 ip-10-0-133-117 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:05:26.687287 ip-10-0-133-117 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 19:05:26.687287 ip-10-0-133-117 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:05:26.687287 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.653959    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 19:05:26.687287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658200    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:26.687287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658212    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:26.687287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658215    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:26.687287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658220    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:26.687287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658223    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:26.687287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658226    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:26.687287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658230    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658233    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658236    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658239    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658242    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658250    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658253    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658256    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658259    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658262    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658264    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658267    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658270    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658272    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658275    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658277    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658280    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658282    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658285    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658288    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:26.689324 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658290    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658293    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658295    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658298    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658300    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658303    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658306    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658309    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658311    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658314    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658316    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658319    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658322    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658325    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658328    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658331    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658334    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658339    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658343    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658346    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:26.708824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658349    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658351    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658355    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658359    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658363    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658365    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658368    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658370    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658373    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658376    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658379    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658382    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658384    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658387    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658389    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658392    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658395    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658397    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658399    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658402    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:26.732140 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658404    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:26.726692 ip-10-0-133-117 systemd[1]: Started Kubernetes Kubelet.
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658407    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658409    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658412    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658415    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658417    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658421    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658423    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658426    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658428    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658431    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658434    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658436    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658439    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658441    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658447    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658450    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658453    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658457    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658459    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:26.750989 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658462    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658465    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658468    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658470    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658473    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658475    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658477    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658480    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658482    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658485    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658487    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658490    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.658492    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659188    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659195    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659199    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659201    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659205    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659208    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659211    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:26.766947 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659214    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659217    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659222    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659224    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659227    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659230    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659232    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659235    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659238    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659240    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659243    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659245    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659248    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659251    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659253    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659257    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659260    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659263    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659267    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:26.768877 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659270    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659274    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659277    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659280    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659282    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659286    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659289    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659292    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659294    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659297    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659299    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659302    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659304    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659307    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659310    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659314    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659316    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659319    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659321    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:26.790932 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659324    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659326    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659329    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659332    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659334    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659337    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659339    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659342    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659345    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659347    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659351    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659353    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659356    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659358    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659361    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659363    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659366    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659368    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659372    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659375    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:26.958355 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659377    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659380    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659382    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659384    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659387    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659389    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659392    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659395    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659398    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659401    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659403    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659406    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659409    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659411    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659414    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659416    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659419    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659421    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659424    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659426    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:26.959366 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659429    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659433    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659436    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659439    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659442    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659445    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659447    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659450    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659453    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659455    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659459    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659462    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659464    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.659467    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660228    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660234    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660238    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660241    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660244    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660247    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:26.960573 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660251    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660254    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660257    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660260    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660262    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660265    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660267    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660270    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660273    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660275    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660278    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660280    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660283    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660285    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660289    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660292    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660295    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660297    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660300    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:26.961256 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660303    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660305    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660308    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660312    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660314    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660317    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660319    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660322    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660324    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660327    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660329    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660332    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660334    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660339    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660341    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660344    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660347    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660350    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660352    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660355    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:26.962634 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660358    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660360    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660363    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660365    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660368    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660370    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660373    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660375    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660378    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660380    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660383    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660385    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660387    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660390    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660392    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660397    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660399    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660401    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660404    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660406    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:26.963287 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660409    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660411    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660414    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660416    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660418    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660423    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660426    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660429    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660432    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660435    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660439    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660442    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660445    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660448    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660451    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660454    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660457    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660459    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660462    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:26.963900 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660465    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660468    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660470    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660473    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660476    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660478    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660481    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660483    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660487    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660491    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660494    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660496    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660499    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660502    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.660504    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660565    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660571    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660577    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660583    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660587    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660590    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 19:05:26.964508 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660594    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660598    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660601    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660604    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660607    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660611    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660614    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660616    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660619    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660622    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660625    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660628    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660632    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660635    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660638    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660641    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660644    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660648    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660650    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660661    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660665    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660668    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660671    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660674    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 19:05:26.965138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660677    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660680    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660684    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660687    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660690    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660694    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660701    2580 flags.go:64] FLAG: --enable-server="true"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660719    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660727    2580 flags.go:64] FLAG: --event-burst="100"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660731    2580 flags.go:64] FLAG: --event-qps="50"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660736    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660739    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660742    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660746    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660749    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660752    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660755    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660758    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660761    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660764    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660767    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660770    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660773    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660776    2580 flags.go:64] FLAG: --feature-gates=""
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660779    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 19:05:26.965907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660782    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660785    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660790    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660793    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660796    2580 flags.go:64] FLAG: --help="false"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660799    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660802    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660805    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660807    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660811    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660819    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660822    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660826    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660829    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660832    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660835    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660843    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660846    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660849    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660852    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660855    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660857    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660860    2580 flags.go:64] FLAG: --lock-file=""
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660863    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 19:05:27.039073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660866    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660869    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660874    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660877    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660880    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660882    2580 flags.go:64] FLAG: --logging-format="text"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660885    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660888    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660891    2580 flags.go:64] FLAG: --manifest-url=""
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660894    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660899    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660902    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660910    2580 flags.go:64] FLAG: --max-pods="110"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660913    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660916    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660919    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660922    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660925    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660928    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660930    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660938    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660941    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660944    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 19:05:27.040019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660947    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660950    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660955    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660958    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660961    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660964    2580 flags.go:64] FLAG: --port="10250"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660967    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660970    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0791b072732d65628"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660973    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660975    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660978    2580 flags.go:64] FLAG: --register-node="true"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660981    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660985    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660988    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660990    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660993    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660996    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.660999    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661002    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661006    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661008    2580 flags.go:64] FLAG: --runonce="false"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661011    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661014    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661017    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661020    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 19:05:27.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661023    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661026    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661028    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661031    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661034    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661038    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661041    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661044    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661047    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661050    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661053    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661058    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661061    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661063    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661068    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661071    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661074    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661077    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661079    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661082    2580 flags.go:64] FLAG: --v="2"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661086    2580 flags.go:64] FLAG: --version="false"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661090    2580 flags.go:64] FLAG: --vmodule=""
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661094    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.661097    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661427    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:27.041487 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661438    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661445    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661449    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661454    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661465    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661470    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661475    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661479    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661484    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661489    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661493    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661497    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661504    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661509    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661513    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661517    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661522    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661532    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661538    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661543    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:27.042320 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661547    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661551    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661556    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661560    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661564    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661569    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661573    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661578    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661582    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661591    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661595    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661600    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661604    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661610    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661614    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661618    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661623    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661627    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661632    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661636    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:27.042933 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661640    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661644    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661653    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661658    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661664    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661668    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661672    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661677    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661681    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661685    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661689    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661694    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661699    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661703    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661730    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661736    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661742    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661748    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661753    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:27.043466 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661758    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661762    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661766    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661771    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661775    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661779    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661786    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661795    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661800    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661804    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661809    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661813    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661818    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661822    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661829    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661834    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661839    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661844    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661849    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:27.044021 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661858    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661863    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661867    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661871    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661876    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661880    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661885    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661889    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661893    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661898    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661902    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661907    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661911    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661919    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661923    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661927    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661931    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661936    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661940    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:27.044521 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.661945    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:27.045092 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.662648    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:05:27.045092 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.669467    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 19:05:27.045092 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.669481    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 19:05:27.045092 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.669500    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 19:05:27.045092 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.669506    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 19:05:27.045092 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669571    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:27.045092 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669576    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:27.045092 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669580    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:27.045092 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669583    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:27.045092 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669585    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:27.045092 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669588    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:27.045092 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669591    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:27.045092 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669593    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:27.045092 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669596    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669599    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669601    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669604    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669607    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669610    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669613    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669616    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669618    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669621    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669623    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669626    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669628    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669631    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669633    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669636    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669638    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669641    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669644    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669646    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:27.045524 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669649    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669652    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669656    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669659    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669662    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669665    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669668    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669671    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669674    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669677    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669679    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669682    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669684    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669687    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669690    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669692    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669695    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669700    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669718    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:27.046137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669722    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669725    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669728    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669731    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669733    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669736    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669740    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669743    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669746    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669749    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669752    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669754    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669757    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669760    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669763    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669765    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669768    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669770    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669773    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669775    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:27.046652 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669778    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669780    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669783    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669785    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669788    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669790    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669793    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669795    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669798    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669800    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669804    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669807    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669809    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669812    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669814    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669817    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669820    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669822    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669826    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669828    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:27.047242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669831    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:27.048062 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669833    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:27.048062 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669837    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:27.048062 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669841    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:27.048062 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669844    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:27.048062 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669846    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:27.048062 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669850    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:27.048062 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669854    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:27.048062 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669857    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:27.048062 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669860    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:27.048062 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669863    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:27.048062 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669866    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:27.048062 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.669871    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:05:27.048062 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669976    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:05:27.048062 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669981    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669984    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669988    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669992    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669995    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.669997    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670001    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670004    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670008    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670010    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670013    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670016    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670019    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670021    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670024    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670027    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670029    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670033    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670035    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:05:27.048496 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670038    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670040    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670043    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670046    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670048    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670052    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670065    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670068    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670071    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670074    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670077    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670079    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670082    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670084    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670087    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670089    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670092    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670094    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670097    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:05:27.159623 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670099    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670102    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670105    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670108    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670111    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670113    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670116    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670118    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670121    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670123    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670126    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670130    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670132    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670135    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670138    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670140    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670143    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670146    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670148    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670151    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:05:27.160238 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670154    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670156    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670159    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670161    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670164    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670166    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670169    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670171    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670174    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670176    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670179    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670181    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670184    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670186    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670190    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670192    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670195    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670197    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670200    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670202    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:05:27.160875 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670205    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670207    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670210    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670216    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670219    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670221    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670223    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670226    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670229    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670231    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670234    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670237    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670240    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670244    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670247    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670250    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670253    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670256    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670259    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:05:27.161491 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:26.670261    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:05:27.162119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.670266    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:05:27.162119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.670366    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 19:05:27.162119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.672193    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 19:05:27.162119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.673453    2580 server.go:1019] "Starting client certificate rotation"
Jul 06 19:05:27.162119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.673733    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:05:27.162119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.674499    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:05:27.162119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.676281    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:05:27.162119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.677831    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:05:27.162119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.692857    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 06 19:05:27.162119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.695920    2580 log.go:25] "Validated CRI v1 image API"
Jul 06 19:05:27.162119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.696718    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 19:05:27.162119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.701501    2580 fs.go:135] Filesystem UUIDs: map[2b21ab5b-6a7b-452b-9d16-86588af541be:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cb9bc158-5d50-4f08-a89d-549006b4c43d:/dev/nvme0n1p4]
Jul 06 19:05:27.162532 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.701515    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 19:05:27.162746 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.707284    2580 manager.go:216] Machine: {Timestamp:2026-07-06 19:05:26.705884956 +0000 UTC m=+0.316012291 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099725 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aae18d7791b9b4d433ebc385f1bc3 SystemUUID:ec2aae18-d779-1b9b-4d43-3ebc385f1bc3 BootID:7c79bd17-824f-47ec-b5da-4fea56a07ad8 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e7:96:62:0c:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e7:96:62:0c:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:74:49:3a:be:b7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 19:05:27.162746 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.707383    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 19:05:27.162746 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.707458    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 19:05:27.162746 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.709857    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:05:27.162746 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.710125    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 19:05:27.162746 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.710145    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 19:05:27.162746 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.711290    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.711299    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.711307    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.711911    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.713013    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.715796    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.715916    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.715943    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.715952    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.715962    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.715970    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.715978    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.716299    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.716313    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.718304    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.720162    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.720190    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.721162    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.721176    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.721182    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.721187    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.721195    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.721201    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.721208    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.721213    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.721220    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.721228    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.721250    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.721259    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.721953    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.721960    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.725194    2580 server.go:1268] "Started kubelet"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.725272    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.725385    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.725442    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.726951    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.728726    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.729624    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.730389    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 19:05:27.163038 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.730402    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.733495    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.734874    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.734889    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.734957    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-117.ec2.internal\" not found"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.735453    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.735456    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.735465    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.735563    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.735572    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.735822    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.735836    2580 factory.go:55] Registering systemd factory
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.735844    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.736074    2580 factory.go:153] Registering CRI-O factory
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.736089    2580 factory.go:223] Registration of the crio container factory successfully
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.736111    2580 factory.go:103] Registering Raw factory
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.736124    2580 manager.go:1196] Started watching for new ooms in manager
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.736527    2580 manager.go:349] Starting recovery of all containers
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.736659    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-117.ec2.internal.18bfc8c5316a4e3e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-117.ec2.internal,UID:ip-10-0-133-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-117.ec2.internal,},FirstTimestamp:2026-07-06 19:05:26.725168702 +0000 UTC m=+0.335296037,LastTimestamp:2026-07-06 19:05:26.725168702 +0000 UTC m=+0.335296037,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-117.ec2.internal,}"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.741597    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.741675    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.746475    2580 manager.go:354] Recovery completed
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.750974    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.753216    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.753256    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.753270    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.753801    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.753811    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.753826    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.754102    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:27.164054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.755365    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.755235    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-117.ec2.internal.18bfc8c53316af72  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-117.ec2.internal,UID:ip-10-0-133-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-117.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-117.ec2.internal,},FirstTimestamp:2026-07-06 19:05:26.753242994 +0000 UTC m=+0.363370328,LastTimestamp:2026-07-06 19:05:26.753242994 +0000 UTC m=+0.363370328,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-117.ec2.internal,}"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.755408    2580 policy_none.go:49] "None policy: Start"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.755419    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.755426    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.755442    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.755443    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.756699    2580 policy_none.go:47] "Start"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.758782    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v77p4"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.765782    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-117.ec2.internal.18bfc8c53316f535  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-117.ec2.internal,UID:ip-10-0-133-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-117.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-117.ec2.internal,},FirstTimestamp:2026-07-06 19:05:26.753260853 +0000 UTC m=+0.363388188,LastTimestamp:2026-07-06 19:05:26.753260853 +0000 UTC m=+0.363388188,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-117.ec2.internal,}"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.767495    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v77p4"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.825257    2580 manager.go:337] "Starting Device Plugin manager"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.825287    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.825298    2580 server.go:87] "Starting device plugin registration server"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.825553    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.825565    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.825676    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.825770    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.825778    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.826262    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.826316    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-117.ec2.internal\" not found"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.842928    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.844050    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.844088    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.844108    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.844148    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.846227    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:27.164889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.926147    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.927154    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.927180    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.927192    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.927222    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.939388    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.939407    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-117.ec2.internal\": node \"ip-10-0-133-117.ec2.internal\" not found"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.944433    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-117.ec2.internal"]
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.944495    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.946043    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.946075    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.946085    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.947092    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.947204    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.947231    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.948127    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.948128    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.948179    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.948191    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.948153    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.948228    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.949336    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.949368    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.950021    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.950042    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:26.950061    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.959194    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-117.ec2.internal\" not found"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:26.993532    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-117.ec2.internal\" not found" node="ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:27.029655    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-117.ec2.internal\" not found" node="ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.165626 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.036620    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd8a86fcd23301d920fac345ba1c9920-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal\" (UID: \"cd8a86fcd23301d920fac345ba1c9920\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.166443 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.036640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd8a86fcd23301d920fac345ba1c9920-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal\" (UID: \"cd8a86fcd23301d920fac345ba1c9920\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.166443 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.036658    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aef998b8d3d262608292fb209e53a208-config\") pod \"kube-apiserver-proxy-ip-10-0-133-117.ec2.internal\" (UID: \"aef998b8d3d262608292fb209e53a208\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.166443 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:27.059975    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-117.ec2.internal\" not found"
Jul 06 19:05:27.166443 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.137169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd8a86fcd23301d920fac345ba1c9920-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal\" (UID: \"cd8a86fcd23301d920fac345ba1c9920\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.166443 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.137209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd8a86fcd23301d920fac345ba1c9920-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal\" (UID: \"cd8a86fcd23301d920fac345ba1c9920\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.166443 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.137225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aef998b8d3d262608292fb209e53a208-config\") pod \"kube-apiserver-proxy-ip-10-0-133-117.ec2.internal\" (UID: \"aef998b8d3d262608292fb209e53a208\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.166443 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.137256    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd8a86fcd23301d920fac345ba1c9920-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal\" (UID: \"cd8a86fcd23301d920fac345ba1c9920\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.166443 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.137264    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aef998b8d3d262608292fb209e53a208-config\") pod \"kube-apiserver-proxy-ip-10-0-133-117.ec2.internal\" (UID: \"aef998b8d3d262608292fb209e53a208\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.166443 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.137266    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd8a86fcd23301d920fac345ba1c9920-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal\" (UID: \"cd8a86fcd23301d920fac345ba1c9920\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.166443 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:27.160307    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-117.ec2.internal\" not found"
Jul 06 19:05:27.277063 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:27.260500    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-117.ec2.internal\" not found"
Jul 06 19:05:27.350552 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.296647    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.350552 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.332620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.459618 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:27.361081    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-117.ec2.internal\" not found"
Jul 06 19:05:27.461697 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:27.461471    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-117.ec2.internal\" not found"
Jul 06 19:05:27.564035 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:27.561956    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-117.ec2.internal\" not found"
Jul 06 19:05:27.654724 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.614436    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:27.748228 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:27.663976    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-117.ec2.internal\" not found"
Jul 06 19:05:27.748228 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.673300    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 19:05:27.748228 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.673430    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:05:27.748228 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.673461    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:05:27.837257 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:27.764468    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-117.ec2.internal\" not found"
Jul 06 19:05:27.837257 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.769746    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:00:27 +0000 UTC" deadline="2028-01-21 03:36:35.391270292 +0000 UTC"
Jul 06 19:05:27.837257 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.769784    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13520h31m7.621490337s"
Jul 06 19:05:27.846997 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.845459    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:27.925722 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.862889    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:05:27.995402 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.937707    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.995402 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.960192    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:05:27.995402 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.961251    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-117.ec2.internal"
Jul 06 19:05:27.995402 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.969926    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:05:27.995402 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:27.976147    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:28.728283 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.717658    2580 apiserver.go:52] "Watching apiserver"
Jul 06 19:05:28.728283 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.725056    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:05:28.728283 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.726331    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-t87sk","kube-system/konnectivity-agent-rxxnr","openshift-cluster-node-tuning-operator/tuned-pvjfs","openshift-dns/node-resolver-j8549","openshift-image-registry/node-ca-s5rb8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal","openshift-multus/multus-gzjr5","openshift-multus/network-metrics-daemon-pth4c","openshift-network-diagnostics/network-check-target-6p7zh","kube-system/global-pull-secret-syncer-6zm9c","kube-system/kube-apiserver-proxy-ip-10-0-133-117.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl","openshift-multus/multus-additional-cni-plugins-z8x7q","openshift-network-operator/iptables-alerter-4tz48"]
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.729528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.732274    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.732283    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qbwwn\""
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.732419    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.732842    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.732988    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.734284    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.735307    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.735465    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.735679    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.735934    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kq4vc\""
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.736053    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.737884    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.737977    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jqxjf\""
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.738131    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.738138    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j8549"
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.740267    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.740297    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dvdjr\""
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.740535    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:05:28.741247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.740729    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s5rb8"
Jul 06 19:05:28.744968 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.743144    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4tz48"
Jul 06 19:05:28.744968 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.743600    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2stg7\""
Jul 06 19:05:28.744968 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.743658    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:05:28.744968 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.743733    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:05:28.744968 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.743802    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-hostroot\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745234    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30f84023-2d8b-4e26-85b9-fa4c29a181c0-cnibin\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745262    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/30f84023-2d8b-4e26-85b9-fa4c29a181c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745327    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-var-lib-kubelet\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtv6q\" (UniqueName: \"kubernetes.io/projected/f57113cb-3b9f-4d8e-b70e-8d04ba9bf414-kube-api-access-xtv6q\") pod \"node-resolver-j8549\" (UID: \"f57113cb-3b9f-4d8e-b70e-8d04ba9bf414\") " pod="openshift-dns/node-resolver-j8549"
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745388    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-system-cni-dir\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-os-release\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-var-lib-cni-multus\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-multus-daemon-config\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-modprobe-d\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-sysctl-d\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745634    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-run-multus-certs\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.746668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745695    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-etc-kubernetes\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.747812 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:28.745698    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:28.747812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-428kw\" (UniqueName: \"kubernetes.io/projected/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-kube-api-access-428kw\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.747812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-run\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.747812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-run-netns\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.747812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30f84023-2d8b-4e26-85b9-fa4c29a181c0-os-release\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.747812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745907    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/30f84023-2d8b-4e26-85b9-fa4c29a181c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.747812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745952    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-sysctl-conf\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.747812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.745977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-cnibin\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.747812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746065    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-multus-socket-dir-parent\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.747812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746092    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-sysconfig\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.747812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-sys\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.747812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746200    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-tuned\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.747812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-multus-conf-dir\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.747812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746294    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30f84023-2d8b-4e26-85b9-fa4c29a181c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746340    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa99e021-b6c6-478c-bb15-98c1555945f4-tmp\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f57113cb-3b9f-4d8e-b70e-8d04ba9bf414-hosts-file\") pod \"node-resolver-j8549\" (UID: \"f57113cb-3b9f-4d8e-b70e-8d04ba9bf414\") " pod="openshift-dns/node-resolver-j8549"
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746408    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fkm4f\""
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746411    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f57113cb-3b9f-4d8e-b70e-8d04ba9bf414-tmp-dir\") pod \"node-resolver-j8549\" (UID: \"f57113cb-3b9f-4d8e-b70e-8d04ba9bf414\") " pod="openshift-dns/node-resolver-j8549"
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30f84023-2d8b-4e26-85b9-fa4c29a181c0-system-cni-dir\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746465    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746471    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-systemd\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746495    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-lib-modules\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-host\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746550    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-run-k8s-cni-cncf-io\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-var-lib-cni-bin\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30f84023-2d8b-4e26-85b9-fa4c29a181c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sscbf\" (UniqueName: \"kubernetes.io/projected/30f84023-2d8b-4e26-85b9-fa4c29a181c0-kube-api-access-sscbf\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-kubernetes\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.750850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2xtq\" (UniqueName: \"kubernetes.io/projected/fa99e021-b6c6-478c-bb15-98c1555945f4-kube-api-access-w2xtq\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.753972 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-multus-cni-dir\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.753972 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-cni-binary-copy\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.753972 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.746848    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-var-lib-kubelet\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.753972 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.749427    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.753972 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.750026    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:05:28.753972 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.752289    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rxxnr"
Jul 06 19:05:28.754936 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.754916    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:05:28.755101 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.755037    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:05:28.755545 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.755379    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:05:28.755545 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.755417    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:05:28.757344 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.757050    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s7cmv\""
Jul 06 19:05:28.757344 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.757070    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:05:28.757344 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.757095    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6kdmq\""
Jul 06 19:05:28.757344 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.757224    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:05:28.757860 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.757438    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:28.757860 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:28.757520    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:28.757860 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.757675    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:05:28.757860 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.757765    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:05:28.757860 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.757765    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:05:28.762413 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.762392    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:28.762508 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:28.762465    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:28.765009 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.764982    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.767883 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.767673    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:05:28.767883 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.767743    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 19:05:28.768274 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.768259    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:05:28.769375 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.769210    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2qg8f\""
Jul 06 19:05:28.786225 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.786203    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x28vw"
Jul 06 19:05:28.797640 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.797610    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x28vw"
Jul 06 19:05:28.836801 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.836762    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 19:05:28.847136 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847078    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sscbf\" (UniqueName: \"kubernetes.io/projected/30f84023-2d8b-4e26-85b9-fa4c29a181c0-kube-api-access-sscbf\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.847136 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-node-log\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.847356 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847156    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-dbus\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:28.847356 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-kubernetes\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.847356 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-multus-cni-dir\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.847356 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-cni-binary-copy\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.847356 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/30f84023-2d8b-4e26-85b9-fa4c29a181c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.847356 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847299    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/08b7a2ec-da87-41ff-b581-e0c745521671-agent-certs\") pod \"konnectivity-agent-rxxnr\" (UID: \"08b7a2ec-da87-41ff-b581-e0c745521671\") " pod="kube-system/konnectivity-agent-rxxnr"
Jul 06 19:05:28.847356 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-system-cni-dir\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.847356 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-os-release\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.847747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-var-lib-cni-multus\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.847747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-multus-daemon-config\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.847747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847429    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-kubelet\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.847747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847432    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-multus-cni-dir\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.847747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-etc-openvswitch\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.847747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-sysctl-d\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.847747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-run-multus-certs\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.847747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-run-systemd\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.847747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847566    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-kubernetes\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.847747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847581    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6svl\" (UniqueName: \"kubernetes.io/projected/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-kube-api-access-g6svl\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.847747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847590    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-system-cni-dir\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.847747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-run-netns\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.847747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30f84023-2d8b-4e26-85b9-fa4c29a181c0-os-release\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.847747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847662    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/08b7a2ec-da87-41ff-b581-e0c745521671-konnectivity-ca\") pod \"konnectivity-agent-rxxnr\" (UID: \"08b7a2ec-da87-41ff-b581-e0c745521671\") " pod="kube-system/konnectivity-agent-rxxnr"
Jul 06 19:05:28.848350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4c7z\" (UniqueName: \"kubernetes.io/projected/b09aa790-cc9a-4341-bedc-7c18351e27d5-kube-api-access-h4c7z\") pod \"network-metrics-daemon-pth4c\" (UID: \"b09aa790-cc9a-4341-bedc-7c18351e27d5\") " pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:28.848350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847733    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksd8t\" (UniqueName: \"kubernetes.io/projected/1cd32162-3d42-4547-91cf-f7e66346e72b-kube-api-access-ksd8t\") pod \"iptables-alerter-4tz48\" (UID: \"1cd32162-3d42-4547-91cf-f7e66346e72b\") " pod="openshift-network-operator/iptables-alerter-4tz48"
Jul 06 19:05:28.848350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847768    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.848350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-sys-fs\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.848350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-sysctl-conf\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.848350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-cnibin\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.848350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847892    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-systemd-units\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.848350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-sys\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.848350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-tuned\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.848350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5-serviceca\") pod \"node-ca-s5rb8\" (UID: \"1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5\") " pod="openshift-image-registry/node-ca-s5rb8"
Jul 06 19:05:28.848350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.847986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-run-openvswitch\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.848350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-ovn-node-metrics-cert\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.848350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848038    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-ovnkube-script-lib\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.848350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848075    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-socket-dir\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.849024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30f84023-2d8b-4e26-85b9-fa4c29a181c0-system-cni-dir\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.849024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs\") pod \"network-metrics-daemon-pth4c\" (UID: \"b09aa790-cc9a-4341-bedc-7c18351e27d5\") " pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:28.849024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-run-ovn\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.849024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-ovnkube-config\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.849024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848219    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-cni-binary-copy\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.849024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-lib-modules\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.849024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1cd32162-3d42-4547-91cf-f7e66346e72b-iptables-alerter-script\") pod \"iptables-alerter-4tz48\" (UID: \"1cd32162-3d42-4547-91cf-f7e66346e72b\") " pod="openshift-network-operator/iptables-alerter-4tz48"
Jul 06 19:05:28.849024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848295    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-cni-bin\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.849024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848319    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.849024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2xtq\" (UniqueName: \"kubernetes.io/projected/fa99e021-b6c6-478c-bb15-98c1555945f4-kube-api-access-w2xtq\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.849024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-var-lib-kubelet\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.849024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-hostroot\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.849024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30f84023-2d8b-4e26-85b9-fa4c29a181c0-cnibin\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.849024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-kubelet-config\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848463    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-sysctl-conf\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-registration-dir\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-var-lib-kubelet\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtv6q\" (UniqueName: \"kubernetes.io/projected/f57113cb-3b9f-4d8e-b70e-8d04ba9bf414-kube-api-access-xtv6q\") pod \"node-resolver-j8549\" (UID: \"f57113cb-3b9f-4d8e-b70e-8d04ba9bf414\") " pod="openshift-dns/node-resolver-j8549"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848545    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-cnibin\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-cni-netd\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-modprobe-d\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848655    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-etc-kubernetes\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848696    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-428kw\" (UniqueName: \"kubernetes.io/projected/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-kube-api-access-428kw\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848723    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-slash\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848730    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-os-release\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-log-socket\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-run\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848800    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-var-lib-cni-multus\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.849671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848816    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-run-netns\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/30f84023-2d8b-4e26-85b9-fa4c29a181c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848872    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2znr\" (UniqueName: \"kubernetes.io/projected/1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5-kube-api-access-m2znr\") pod \"node-ca-s5rb8\" (UID: \"1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5\") " pod="openshift-image-registry/node-ca-s5rb8"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848868    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-sys\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848895    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30f84023-2d8b-4e26-85b9-fa4c29a181c0-os-release\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.848908    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/30f84023-2d8b-4e26-85b9-fa4c29a181c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849008    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-run-netns\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849109    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-sysctl-d\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849127    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30f84023-2d8b-4e26-85b9-fa4c29a181c0-cnibin\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849145    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-hostroot\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849214    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-modprobe-d\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849234    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-run\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849284    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-run-multus-certs\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849364    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-multus-daemon-config\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849408    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 19:05:28.850406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849430    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-etc-kubernetes\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.851073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849509    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-lib-modules\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.851073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849547    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-var-lib-kubelet\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.851073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849568    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30f84023-2d8b-4e26-85b9-fa4c29a181c0-system-cni-dir\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.851073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkwdz\" (UniqueName: \"kubernetes.io/projected/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-kube-api-access-rkwdz\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.851073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-multus-socket-dir-parent\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.851073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5-host\") pod \"node-ca-s5rb8\" (UID: \"1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5\") " pod="openshift-image-registry/node-ca-s5rb8"
Jul 06 19:05:28.851073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849665    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-env-overrides\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.851073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849693    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:28.851073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-sysconfig\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.851073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849731    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/30f84023-2d8b-4e26-85b9-fa4c29a181c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.851073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849747    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-multus-conf-dir\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.851073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30f84023-2d8b-4e26-85b9-fa4c29a181c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.851073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849837    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-var-lib-kubelet\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.851073 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxnwl\" (UniqueName: \"kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl\") pod \"network-check-target-6p7zh\" (UID: \"5fc9e75a-05d0-4604-8402-6aa5c4969689\") " pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:28.851825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849855    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-multus-conf-dir\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.851825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849892    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-multus-socket-dir-parent\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.851825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849936    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-run-ovn-kubernetes\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.851825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849966    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-device-dir\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.851825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849984    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-sysconfig\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.851825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.849996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa99e021-b6c6-478c-bb15-98c1555945f4-tmp\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.851825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.850026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f57113cb-3b9f-4d8e-b70e-8d04ba9bf414-hosts-file\") pod \"node-resolver-j8549\" (UID: \"f57113cb-3b9f-4d8e-b70e-8d04ba9bf414\") " pod="openshift-dns/node-resolver-j8549"
Jul 06 19:05:28.851825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.850061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f57113cb-3b9f-4d8e-b70e-8d04ba9bf414-tmp-dir\") pod \"node-resolver-j8549\" (UID: \"f57113cb-3b9f-4d8e-b70e-8d04ba9bf414\") " pod="openshift-dns/node-resolver-j8549"
Jul 06 19:05:28.851825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.850073    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f57113cb-3b9f-4d8e-b70e-8d04ba9bf414-hosts-file\") pod \"node-resolver-j8549\" (UID: \"f57113cb-3b9f-4d8e-b70e-8d04ba9bf414\") " pod="openshift-dns/node-resolver-j8549"
Jul 06 19:05:28.851825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.850105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cd32162-3d42-4547-91cf-f7e66346e72b-host-slash\") pod \"iptables-alerter-4tz48\" (UID: \"1cd32162-3d42-4547-91cf-f7e66346e72b\") " pod="openshift-network-operator/iptables-alerter-4tz48"
Jul 06 19:05:28.851825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.850354    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30f84023-2d8b-4e26-85b9-fa4c29a181c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.851825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.850484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-var-lib-openvswitch\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.851825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.850517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-etc-selinux\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.851825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.850545    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-systemd\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.852745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.850588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-host\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.852745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.850613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-run-k8s-cni-cncf-io\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.852745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.850638    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-var-lib-cni-bin\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.852745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.850666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30f84023-2d8b-4e26-85b9-fa4c29a181c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.852745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.851194    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30f84023-2d8b-4e26-85b9-fa4c29a181c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.852745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.851219    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-systemd\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.852745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.851264    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-run-k8s-cni-cncf-io\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.852745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.851302    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-host-var-lib-cni-bin\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.852745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.851384    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa99e021-b6c6-478c-bb15-98c1555945f4-host\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.852745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.851449    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f57113cb-3b9f-4d8e-b70e-8d04ba9bf414-tmp-dir\") pod \"node-resolver-j8549\" (UID: \"f57113cb-3b9f-4d8e-b70e-8d04ba9bf414\") " pod="openshift-dns/node-resolver-j8549"
Jul 06 19:05:28.852745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.851867    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal" event={"ID":"cd8a86fcd23301d920fac345ba1c9920","Type":"ContainerStarted","Data":"6725a438e133d5f44db5a4565e1426936873987a9a2c5271f0ee67ba37f0213e"}
Jul 06 19:05:28.853849 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.853821    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa99e021-b6c6-478c-bb15-98c1555945f4-tmp\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.854236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.854204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-117.ec2.internal" event={"ID":"aef998b8d3d262608292fb209e53a208","Type":"ContainerStarted","Data":"fb577a84b329337fcd07be13b517df416464bda9dc2adb2eef48bca326a9b5bf"}
Jul 06 19:05:28.854849 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.854822    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa99e021-b6c6-478c-bb15-98c1555945f4-etc-tuned\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.857992 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.857964    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtv6q\" (UniqueName: \"kubernetes.io/projected/f57113cb-3b9f-4d8e-b70e-8d04ba9bf414-kube-api-access-xtv6q\") pod \"node-resolver-j8549\" (UID: \"f57113cb-3b9f-4d8e-b70e-8d04ba9bf414\") " pod="openshift-dns/node-resolver-j8549"
Jul 06 19:05:28.859094 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.859066    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sscbf\" (UniqueName: \"kubernetes.io/projected/30f84023-2d8b-4e26-85b9-fa4c29a181c0-kube-api-access-sscbf\") pod \"multus-additional-cni-plugins-z8x7q\" (UID: \"30f84023-2d8b-4e26-85b9-fa4c29a181c0\") " pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:28.859283 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.859254    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-428kw\" (UniqueName: \"kubernetes.io/projected/1ad9261a-5ea1-4d76-87ab-7efe1e0214c9-kube-api-access-428kw\") pod \"multus-gzjr5\" (UID: \"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9\") " pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:28.860958 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.860934    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2xtq\" (UniqueName: \"kubernetes.io/projected/fa99e021-b6c6-478c-bb15-98c1555945f4-kube-api-access-w2xtq\") pod \"tuned-pvjfs\" (UID: \"fa99e021-b6c6-478c-bb15-98c1555945f4\") " pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:28.951446 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-run-systemd\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.951611 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951466    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6svl\" (UniqueName: \"kubernetes.io/projected/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-kube-api-access-g6svl\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.951611 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951495    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/08b7a2ec-da87-41ff-b581-e0c745521671-konnectivity-ca\") pod \"konnectivity-agent-rxxnr\" (UID: \"08b7a2ec-da87-41ff-b581-e0c745521671\") " pod="kube-system/konnectivity-agent-rxxnr"
Jul 06 19:05:28.951611 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951562    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-run-systemd\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.951824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4c7z\" (UniqueName: \"kubernetes.io/projected/b09aa790-cc9a-4341-bedc-7c18351e27d5-kube-api-access-h4c7z\") pod \"network-metrics-daemon-pth4c\" (UID: \"b09aa790-cc9a-4341-bedc-7c18351e27d5\") " pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:28.951824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksd8t\" (UniqueName: \"kubernetes.io/projected/1cd32162-3d42-4547-91cf-f7e66346e72b-kube-api-access-ksd8t\") pod \"iptables-alerter-4tz48\" (UID: \"1cd32162-3d42-4547-91cf-f7e66346e72b\") " pod="openshift-network-operator/iptables-alerter-4tz48"
Jul 06 19:05:28.951824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.951824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-sys-fs\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.951824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-systemd-units\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.951824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951775    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5-serviceca\") pod \"node-ca-s5rb8\" (UID: \"1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5\") " pod="openshift-image-registry/node-ca-s5rb8"
Jul 06 19:05:28.951824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-run-openvswitch\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.951824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951822    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-ovn-node-metrics-cert\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-ovnkube-script-lib\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-socket-dir\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.952236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951894    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs\") pod \"network-metrics-daemon-pth4c\" (UID: \"b09aa790-cc9a-4341-bedc-7c18351e27d5\") " pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:28.952236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-run-ovn\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-ovnkube-config\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1cd32162-3d42-4547-91cf-f7e66346e72b-iptables-alerter-script\") pod \"iptables-alerter-4tz48\" (UID: \"1cd32162-3d42-4547-91cf-f7e66346e72b\") " pod="openshift-network-operator/iptables-alerter-4tz48"
Jul 06 19:05:28.952236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.951988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-cni-bin\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952048    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-kubelet-config\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:28.952236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-registration-dir\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.952236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-cni-netd\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952116    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/08b7a2ec-da87-41ff-b581-e0c745521671-konnectivity-ca\") pod \"konnectivity-agent-rxxnr\" (UID: \"08b7a2ec-da87-41ff-b581-e0c745521671\") " pod="kube-system/konnectivity-agent-rxxnr"
Jul 06 19:05:28.952236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952143    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-slash\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952151    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-systemd-units\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-log-socket\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2znr\" (UniqueName: \"kubernetes.io/projected/1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5-kube-api-access-m2znr\") pod \"node-ca-s5rb8\" (UID: \"1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5\") " pod="openshift-image-registry/node-ca-s5rb8"
Jul 06 19:05:28.952940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-run-netns\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952233    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-sys-fs\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.952940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkwdz\" (UniqueName: \"kubernetes.io/projected/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-kube-api-access-rkwdz\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.952940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5-host\") pod \"node-ca-s5rb8\" (UID: \"1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5\") " pod="openshift-image-registry/node-ca-s5rb8"
Jul 06 19:05:28.952940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952274    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-run-openvswitch\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952340    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952393    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-kubelet-config\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:28.952940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952443    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-registration-dir\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.952940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952480    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-cni-netd\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952520    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-slash\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952559    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-log-socket\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.952940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952608    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952691    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1cd32162-3d42-4547-91cf-f7e66346e72b-iptables-alerter-script\") pod \"iptables-alerter-4tz48\" (UID: \"1cd32162-3d42-4547-91cf-f7e66346e72b\") " pod="openshift-network-operator/iptables-alerter-4tz48"
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952694    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5-serviceca\") pod \"node-ca-s5rb8\" (UID: \"1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5\") " pod="openshift-image-registry/node-ca-s5rb8"
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952732    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-cni-bin\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952702    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-ovnkube-script-lib\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-env-overrides\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952858    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-socket-dir\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.952865    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-run-netns\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:28.952902    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:28.952948    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:28.953028    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret podName:c3a18cca-96fa-4abb-b1e8-d061a4a0599c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:29.453005802 +0000 UTC m=+3.063133132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret") pod "global-pull-secret-syncer-6zm9c" (UID: "c3a18cca-96fa-4abb-b1e8-d061a4a0599c") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953028    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-run-ovn\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnwl\" (UniqueName: \"kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl\") pod \"network-check-target-6p7zh\" (UID: \"5fc9e75a-05d0-4604-8402-6aa5c4969689\") " pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953157    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5-host\") pod \"node-ca-s5rb8\" (UID: \"1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5\") " pod="openshift-image-registry/node-ca-s5rb8"
Jul 06 19:05:28.953620 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-run-ovn-kubernetes\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.954386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953218    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-run-ovn-kubernetes\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.954386 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:28.953226    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs podName:b09aa790-cc9a-4341-bedc-7c18351e27d5 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:29.453190334 +0000 UTC m=+3.063317673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs") pod "network-metrics-daemon-pth4c" (UID: "b09aa790-cc9a-4341-bedc-7c18351e27d5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:28.954386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-device-dir\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.954386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cd32162-3d42-4547-91cf-f7e66346e72b-host-slash\") pod \"iptables-alerter-4tz48\" (UID: \"1cd32162-3d42-4547-91cf-f7e66346e72b\") " pod="openshift-network-operator/iptables-alerter-4tz48"
Jul 06 19:05:28.954386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-var-lib-openvswitch\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.954386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-etc-selinux\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.954386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-node-log\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.954386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953373    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cd32162-3d42-4547-91cf-f7e66346e72b-host-slash\") pod \"iptables-alerter-4tz48\" (UID: \"1cd32162-3d42-4547-91cf-f7e66346e72b\") " pod="openshift-network-operator/iptables-alerter-4tz48"
Jul 06 19:05:28.954386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953452    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-var-lib-openvswitch\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.954386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953456    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-node-log\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.954386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953451    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-env-overrides\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.954386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953516    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-device-dir\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.954386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953531    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-ovnkube-config\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.954386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-dbus\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:28.955177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953554    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-etc-selinux\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.955177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/08b7a2ec-da87-41ff-b581-e0c745521671-agent-certs\") pod \"konnectivity-agent-rxxnr\" (UID: \"08b7a2ec-da87-41ff-b581-e0c745521671\") " pod="kube-system/konnectivity-agent-rxxnr"
Jul 06 19:05:28.955177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953646    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-dbus\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:28.955177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-kubelet\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.955177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-etc-openvswitch\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.955177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953799    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-etc-openvswitch\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.955177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.953837    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-host-kubelet\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.956477 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.956382    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-ovn-node-metrics-cert\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.956477 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.956449    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/08b7a2ec-da87-41ff-b581-e0c745521671-agent-certs\") pod \"konnectivity-agent-rxxnr\" (UID: \"08b7a2ec-da87-41ff-b581-e0c745521671\") " pod="kube-system/konnectivity-agent-rxxnr"
Jul 06 19:05:28.965373 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.964989    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6svl\" (UniqueName: \"kubernetes.io/projected/f89b0431-4e23-43e4-88db-3ffeeb5a2ae4-kube-api-access-g6svl\") pod \"ovnkube-node-t87sk\" (UID: \"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4\") " pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:28.965926 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:28.965902    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:28.966018 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:28.965933    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:28.966018 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:28.965946    2580 projected.go:196] Error preparing data for projected volume kube-api-access-zxnwl for pod openshift-network-diagnostics/network-check-target-6p7zh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:28.966018 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:28.966014    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl podName:5fc9e75a-05d0-4604-8402-6aa5c4969689 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:29.465997711 +0000 UTC m=+3.076125061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zxnwl" (UniqueName: "kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl") pod "network-check-target-6p7zh" (UID: "5fc9e75a-05d0-4604-8402-6aa5c4969689") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:28.968344 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.968298    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkwdz\" (UniqueName: \"kubernetes.io/projected/ef99408b-5cc5-41cc-bfa9-56d2cab6b27c-kube-api-access-rkwdz\") pod \"aws-ebs-csi-driver-node-cp8bl\" (UID: \"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:28.969781 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.969758    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2znr\" (UniqueName: \"kubernetes.io/projected/1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5-kube-api-access-m2znr\") pod \"node-ca-s5rb8\" (UID: \"1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5\") " pod="openshift-image-registry/node-ca-s5rb8"
Jul 06 19:05:28.971745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.971711    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4c7z\" (UniqueName: \"kubernetes.io/projected/b09aa790-cc9a-4341-bedc-7c18351e27d5-kube-api-access-h4c7z\") pod \"network-metrics-daemon-pth4c\" (UID: \"b09aa790-cc9a-4341-bedc-7c18351e27d5\") " pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:28.971839 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:28.971766    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksd8t\" (UniqueName: \"kubernetes.io/projected/1cd32162-3d42-4547-91cf-f7e66346e72b-kube-api-access-ksd8t\") pod \"iptables-alerter-4tz48\" (UID: \"1cd32162-3d42-4547-91cf-f7e66346e72b\") " pod="openshift-network-operator/iptables-alerter-4tz48"
Jul 06 19:05:29.045617 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.045523    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gzjr5"
Jul 06 19:05:29.054507 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.054324    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z8x7q"
Jul 06 19:05:29.059824 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:29.059790    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad9261a_5ea1_4d76_87ab_7efe1e0214c9.slice/crio-56a831dcf28dc2a3052a4b0477cce43356bf529681d1d29f6144b2a71e80e16a WatchSource:0}: Error finding container 56a831dcf28dc2a3052a4b0477cce43356bf529681d1d29f6144b2a71e80e16a: Status 404 returned error can't find the container with id 56a831dcf28dc2a3052a4b0477cce43356bf529681d1d29f6144b2a71e80e16a
Jul 06 19:05:29.064669 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.064419    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pvjfs"
Jul 06 19:05:29.067339 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:29.067242    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f84023_2d8b_4e26_85b9_fa4c29a181c0.slice/crio-ab44db87b7fb70ec39de5fdd1d73212e0ff299279d7f4357d2058581ee8182be WatchSource:0}: Error finding container ab44db87b7fb70ec39de5fdd1d73212e0ff299279d7f4357d2058581ee8182be: Status 404 returned error can't find the container with id ab44db87b7fb70ec39de5fdd1d73212e0ff299279d7f4357d2058581ee8182be
Jul 06 19:05:29.071457 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.071383    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j8549"
Jul 06 19:05:29.079466 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.079440    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s5rb8"
Jul 06 19:05:29.079649 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:29.079626    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa99e021_b6c6_478c_bb15_98c1555945f4.slice/crio-31009a50d4f910b4dab194cc607a1781fa95078c86de2ad1db30778b11f645de WatchSource:0}: Error finding container 31009a50d4f910b4dab194cc607a1781fa95078c86de2ad1db30778b11f645de: Status 404 returned error can't find the container with id 31009a50d4f910b4dab194cc607a1781fa95078c86de2ad1db30778b11f645de
Jul 06 19:05:29.088745 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:29.088721    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf57113cb_3b9f_4d8e_b70e_8d04ba9bf414.slice/crio-9fe94950d031a57c68be9d4a85cc2adf5ceaa462bf4426508e255e8428596fb3 WatchSource:0}: Error finding container 9fe94950d031a57c68be9d4a85cc2adf5ceaa462bf4426508e255e8428596fb3: Status 404 returned error can't find the container with id 9fe94950d031a57c68be9d4a85cc2adf5ceaa462bf4426508e255e8428596fb3
Jul 06 19:05:29.092285 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:29.092175    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df345a6_542e_4d6a_b96e_9b4d2e3ef7a5.slice/crio-6b8e921ff60f36ab33771fb6c37afef42f476972a6f9a316472b6d86e2dd3b07 WatchSource:0}: Error finding container 6b8e921ff60f36ab33771fb6c37afef42f476972a6f9a316472b6d86e2dd3b07: Status 404 returned error can't find the container with id 6b8e921ff60f36ab33771fb6c37afef42f476972a6f9a316472b6d86e2dd3b07
Jul 06 19:05:29.175940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.175886    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4tz48"
Jul 06 19:05:29.189302 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:29.189267    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd32162_3d42_4547_91cf_f7e66346e72b.slice/crio-746f3e523aa8692f77a4941644007d7f6abe38c8bc057fd9a7b359c114ab626e WatchSource:0}: Error finding container 746f3e523aa8692f77a4941644007d7f6abe38c8bc057fd9a7b359c114ab626e: Status 404 returned error can't find the container with id 746f3e523aa8692f77a4941644007d7f6abe38c8bc057fd9a7b359c114ab626e
Jul 06 19:05:29.197273 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.197250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:29.206290 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.206270    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rxxnr"
Jul 06 19:05:29.207884 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:29.207855    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89b0431_4e23_43e4_88db_3ffeeb5a2ae4.slice/crio-9d37ea09733b4322d336365c4e8dd514a9b26a60f72744f4d23864590cbe22b2 WatchSource:0}: Error finding container 9d37ea09733b4322d336365c4e8dd514a9b26a60f72744f4d23864590cbe22b2: Status 404 returned error can't find the container with id 9d37ea09733b4322d336365c4e8dd514a9b26a60f72744f4d23864590cbe22b2
Jul 06 19:05:29.213903 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.213881    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl"
Jul 06 19:05:29.220096 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:29.220072    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b7a2ec_da87_41ff_b581_e0c745521671.slice/crio-f9de2d7404c1a59ddabd9a398398c9cda087711d323c9959d34d5316af315dc5 WatchSource:0}: Error finding container f9de2d7404c1a59ddabd9a398398c9cda087711d323c9959d34d5316af315dc5: Status 404 returned error can't find the container with id f9de2d7404c1a59ddabd9a398398c9cda087711d323c9959d34d5316af315dc5
Jul 06 19:05:29.222938 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.222910    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:29.225237 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:05:29.225218    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef99408b_5cc5_41cc_bfa9_56d2cab6b27c.slice/crio-fb3dcdea9dd05663ab9eb0c4e23808dc7f157426b7df8def0ca79458a889edb3 WatchSource:0}: Error finding container fb3dcdea9dd05663ab9eb0c4e23808dc7f157426b7df8def0ca79458a889edb3: Status 404 returned error can't find the container with id fb3dcdea9dd05663ab9eb0c4e23808dc7f157426b7df8def0ca79458a889edb3
Jul 06 19:05:29.457192 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.457156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs\") pod \"network-metrics-daemon-pth4c\" (UID: \"b09aa790-cc9a-4341-bedc-7c18351e27d5\") " pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:29.457390 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.457226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:29.457390 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:29.457354    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:29.457390 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:29.457358    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:29.457606 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:29.457425    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret podName:c3a18cca-96fa-4abb-b1e8-d061a4a0599c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:30.457408065 +0000 UTC m=+4.067535407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret") pod "global-pull-secret-syncer-6zm9c" (UID: "c3a18cca-96fa-4abb-b1e8-d061a4a0599c") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:29.457606 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:29.457445    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs podName:b09aa790-cc9a-4341-bedc-7c18351e27d5 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:30.457435122 +0000 UTC m=+4.067562451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs") pod "network-metrics-daemon-pth4c" (UID: "b09aa790-cc9a-4341-bedc-7c18351e27d5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:29.558344 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.558302    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnwl\" (UniqueName: \"kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl\") pod \"network-check-target-6p7zh\" (UID: \"5fc9e75a-05d0-4604-8402-6aa5c4969689\") " pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:29.558554 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:29.558497    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:29.558554 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:29.558525    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:29.558554 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:29.558540    2580 projected.go:196] Error preparing data for projected volume kube-api-access-zxnwl for pod openshift-network-diagnostics/network-check-target-6p7zh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:29.558729 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:29.558613    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl podName:5fc9e75a-05d0-4604-8402-6aa5c4969689 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:30.558597851 +0000 UTC m=+4.168725194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxnwl" (UniqueName: "kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl") pod "network-check-target-6p7zh" (UID: "5fc9e75a-05d0-4604-8402-6aa5c4969689") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:29.621470 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.621433    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:05:29.801134 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.801019    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:00:29 +0000 UTC" deadline="2028-03-30 02:03:33.863401492 +0000 UTC"
Jul 06 19:05:29.801134 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.801075    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15174h58m4.062329279s"
Jul 06 19:05:29.857405 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.857358    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl" event={"ID":"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c","Type":"ContainerStarted","Data":"fb3dcdea9dd05663ab9eb0c4e23808dc7f157426b7df8def0ca79458a889edb3"}
Jul 06 19:05:29.858764 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.858711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk" event={"ID":"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4","Type":"ContainerStarted","Data":"9d37ea09733b4322d336365c4e8dd514a9b26a60f72744f4d23864590cbe22b2"}
Jul 06 19:05:29.859948 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.859920    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s5rb8" event={"ID":"1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5","Type":"ContainerStarted","Data":"6b8e921ff60f36ab33771fb6c37afef42f476972a6f9a316472b6d86e2dd3b07"}
Jul 06 19:05:29.861121 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.861093    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j8549" event={"ID":"f57113cb-3b9f-4d8e-b70e-8d04ba9bf414","Type":"ContainerStarted","Data":"9fe94950d031a57c68be9d4a85cc2adf5ceaa462bf4426508e255e8428596fb3"}
Jul 06 19:05:29.862281 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.862244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pvjfs" event={"ID":"fa99e021-b6c6-478c-bb15-98c1555945f4","Type":"ContainerStarted","Data":"31009a50d4f910b4dab194cc607a1781fa95078c86de2ad1db30778b11f645de"}
Jul 06 19:05:29.863487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.863467    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8x7q" event={"ID":"30f84023-2d8b-4e26-85b9-fa4c29a181c0","Type":"ContainerStarted","Data":"ab44db87b7fb70ec39de5fdd1d73212e0ff299279d7f4357d2058581ee8182be"}
Jul 06 19:05:29.864640 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.864609    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gzjr5" event={"ID":"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9","Type":"ContainerStarted","Data":"56a831dcf28dc2a3052a4b0477cce43356bf529681d1d29f6144b2a71e80e16a"}
Jul 06 19:05:29.866514 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.866490    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rxxnr" event={"ID":"08b7a2ec-da87-41ff-b581-e0c745521671","Type":"ContainerStarted","Data":"f9de2d7404c1a59ddabd9a398398c9cda087711d323c9959d34d5316af315dc5"}
Jul 06 19:05:29.867632 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:29.867606    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4tz48" event={"ID":"1cd32162-3d42-4547-91cf-f7e66346e72b","Type":"ContainerStarted","Data":"746f3e523aa8692f77a4941644007d7f6abe38c8bc057fd9a7b359c114ab626e"}
Jul 06 19:05:30.466913 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:30.466871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs\") pod \"network-metrics-daemon-pth4c\" (UID: \"b09aa790-cc9a-4341-bedc-7c18351e27d5\") " pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:30.467093 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:30.466941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:30.467093 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:30.467078    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:30.467224 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:30.467143    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret podName:c3a18cca-96fa-4abb-b1e8-d061a4a0599c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:32.467124489 +0000 UTC m=+6.077251831 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret") pod "global-pull-secret-syncer-6zm9c" (UID: "c3a18cca-96fa-4abb-b1e8-d061a4a0599c") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:30.467816 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:30.467749    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:30.467928 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:30.467828    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs podName:b09aa790-cc9a-4341-bedc-7c18351e27d5 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:32.467810538 +0000 UTC m=+6.077937865 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs") pod "network-metrics-daemon-pth4c" (UID: "b09aa790-cc9a-4341-bedc-7c18351e27d5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:30.568183 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:30.568142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnwl\" (UniqueName: \"kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl\") pod \"network-check-target-6p7zh\" (UID: \"5fc9e75a-05d0-4604-8402-6aa5c4969689\") " pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:30.568506 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:30.568349    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:30.568506 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:30.568373    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:30.568506 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:30.568387    2580 projected.go:196] Error preparing data for projected volume kube-api-access-zxnwl for pod openshift-network-diagnostics/network-check-target-6p7zh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:30.568506 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:30.568451    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl podName:5fc9e75a-05d0-4604-8402-6aa5c4969689 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:32.568430146 +0000 UTC m=+6.178557494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxnwl" (UniqueName: "kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl") pod "network-check-target-6p7zh" (UID: "5fc9e75a-05d0-4604-8402-6aa5c4969689") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:30.802044 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:30.801966    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:00:29 +0000 UTC" deadline="2027-12-20 03:27:07.135231152 +0000 UTC"
Jul 06 19:05:30.802044 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:30.802009    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12752h21m36.33322725s"
Jul 06 19:05:30.847871 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:30.847842    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:30.847994 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:30.847972    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:30.848402 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:30.848380    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:30.848495 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:30.848481    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:30.848560 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:30.848544    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:30.848653 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:30.848633    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:31.893331 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:31.893094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-117.ec2.internal" event={"ID":"aef998b8d3d262608292fb209e53a208","Type":"ContainerStarted","Data":"7ec9cdaa2e3e5ced72c37570a28e7ce2fe6110f885726787ec6fe3ebf9b05200"}
Jul 06 19:05:31.911261 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:31.911227    2580 generic.go:356] "Generic (PLEG): container finished" podID="cd8a86fcd23301d920fac345ba1c9920" containerID="68cce68665e4928eea86321127a61c03fa29535779287deae19d034dc85d474a" exitCode=0
Jul 06 19:05:31.911420 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:31.911286    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal" event={"ID":"cd8a86fcd23301d920fac345ba1c9920","Type":"ContainerDied","Data":"68cce68665e4928eea86321127a61c03fa29535779287deae19d034dc85d474a"}
Jul 06 19:05:31.933354 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:31.933293    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-117.ec2.internal" podStartSLOduration=3.933269534 podStartE2EDuration="3.933269534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:31.913294035 +0000 UTC m=+5.523421398" watchObservedRunningTime="2026-07-06 19:05:31.933269534 +0000 UTC m=+5.543396882"
Jul 06 19:05:32.486308 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:32.486150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs\") pod \"network-metrics-daemon-pth4c\" (UID: \"b09aa790-cc9a-4341-bedc-7c18351e27d5\") " pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:32.486308 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:32.486221    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:32.486308 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:32.486283    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:32.486667 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:32.486359    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs podName:b09aa790-cc9a-4341-bedc-7c18351e27d5 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:36.48633956 +0000 UTC m=+10.096466892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs") pod "network-metrics-daemon-pth4c" (UID: "b09aa790-cc9a-4341-bedc-7c18351e27d5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:32.486667 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:32.486426    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:32.486667 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:32.486509    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret podName:c3a18cca-96fa-4abb-b1e8-d061a4a0599c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:36.486486516 +0000 UTC m=+10.096613844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret") pod "global-pull-secret-syncer-6zm9c" (UID: "c3a18cca-96fa-4abb-b1e8-d061a4a0599c") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:32.587526 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:32.587480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnwl\" (UniqueName: \"kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl\") pod \"network-check-target-6p7zh\" (UID: \"5fc9e75a-05d0-4604-8402-6aa5c4969689\") " pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:32.587722 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:32.587677    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:32.587722 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:32.587700    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:32.587722 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:32.587714    2580 projected.go:196] Error preparing data for projected volume kube-api-access-zxnwl for pod openshift-network-diagnostics/network-check-target-6p7zh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:32.587944 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:32.587794    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl podName:5fc9e75a-05d0-4604-8402-6aa5c4969689 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:36.587773843 +0000 UTC m=+10.197901185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxnwl" (UniqueName: "kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl") pod "network-check-target-6p7zh" (UID: "5fc9e75a-05d0-4604-8402-6aa5c4969689") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:32.846026 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:32.845905    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:32.846242 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:32.846046    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:32.846521 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:32.846497    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:32.846632 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:32.846607    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:32.848667 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:32.848642    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:32.848825 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:32.848801    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:34.845225 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:34.845195    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:34.845872 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:34.845334    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:34.845872 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:34.845743    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:34.846132 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:34.845888    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:34.846132 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:34.845941    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:34.846132 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:34.846020    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:36.524586 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:36.524528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:36.525068 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:36.524613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs\") pod \"network-metrics-daemon-pth4c\" (UID: \"b09aa790-cc9a-4341-bedc-7c18351e27d5\") " pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:36.525068 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:36.524783    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:36.525068 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:36.524815    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:36.525068 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:36.524848    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs podName:b09aa790-cc9a-4341-bedc-7c18351e27d5 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:44.524827874 +0000 UTC m=+18.134955211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs") pod "network-metrics-daemon-pth4c" (UID: "b09aa790-cc9a-4341-bedc-7c18351e27d5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:36.525068 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:36.524876    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret podName:c3a18cca-96fa-4abb-b1e8-d061a4a0599c nodeName:}" failed. No retries permitted until 2026-07-06 19:05:44.524857983 +0000 UTC m=+18.134985502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret") pod "global-pull-secret-syncer-6zm9c" (UID: "c3a18cca-96fa-4abb-b1e8-d061a4a0599c") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:36.625748 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:36.625701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnwl\" (UniqueName: \"kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl\") pod \"network-check-target-6p7zh\" (UID: \"5fc9e75a-05d0-4604-8402-6aa5c4969689\") " pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:36.625921 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:36.625869    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:36.625921 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:36.625887    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:36.625921 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:36.625897    2580 projected.go:196] Error preparing data for projected volume kube-api-access-zxnwl for pod openshift-network-diagnostics/network-check-target-6p7zh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:36.626060 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:36.625950    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl podName:5fc9e75a-05d0-4604-8402-6aa5c4969689 nodeName:}" failed. No retries permitted until 2026-07-06 19:05:44.625932382 +0000 UTC m=+18.236059704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxnwl" (UniqueName: "kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl") pod "network-check-target-6p7zh" (UID: "5fc9e75a-05d0-4604-8402-6aa5c4969689") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:36.845905 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:36.845828    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:36.846061 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:36.845943    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:36.846061 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:36.846044    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:36.846205 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:36.846162    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:36.846328 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:36.846276    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:36.846392 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:36.846369    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:38.844983 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:38.844662    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:38.844983 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:38.844719    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:38.844983 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:38.844821    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:38.844983 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:38.844876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:38.844983 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:38.844874    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:38.844983 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:38.844950    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:40.845427 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:40.845392    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:40.845821 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:40.845387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:40.845821 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:40.845499    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:40.845821 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:40.845396    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:40.845821 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:40.845593    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:40.845821 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:40.845648    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:42.845094 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:42.845040    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:42.845094 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:42.845090    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:42.845585 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:42.845040    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:42.845585 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:42.845199    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:42.845585 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:42.845284    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:42.845585 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:42.845369    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:44.586764 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:44.586721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs\") pod \"network-metrics-daemon-pth4c\" (UID: \"b09aa790-cc9a-4341-bedc-7c18351e27d5\") " pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:44.587232 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:44.586778    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:44.587232 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:44.586834    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:44.587232 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:44.586878    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:44.587232 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:44.586900    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs podName:b09aa790-cc9a-4341-bedc-7c18351e27d5 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:00.586885707 +0000 UTC m=+34.197013029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs") pod "network-metrics-daemon-pth4c" (UID: "b09aa790-cc9a-4341-bedc-7c18351e27d5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:05:44.587232 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:44.586940    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret podName:c3a18cca-96fa-4abb-b1e8-d061a4a0599c nodeName:}" failed. No retries permitted until 2026-07-06 19:06:00.586923029 +0000 UTC m=+34.197050351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret") pod "global-pull-secret-syncer-6zm9c" (UID: "c3a18cca-96fa-4abb-b1e8-d061a4a0599c") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:05:44.687556 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:44.687516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnwl\" (UniqueName: \"kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl\") pod \"network-check-target-6p7zh\" (UID: \"5fc9e75a-05d0-4604-8402-6aa5c4969689\") " pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:44.687733 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:44.687693    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:05:44.687790 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:44.687738    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:05:44.687790 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:44.687754    2580 projected.go:196] Error preparing data for projected volume kube-api-access-zxnwl for pod openshift-network-diagnostics/network-check-target-6p7zh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:44.687882 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:44.687823    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl podName:5fc9e75a-05d0-4604-8402-6aa5c4969689 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:00.687803946 +0000 UTC m=+34.297931277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxnwl" (UniqueName: "kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl") pod "network-check-target-6p7zh" (UID: "5fc9e75a-05d0-4604-8402-6aa5c4969689") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:05:44.845314 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:44.845223    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:44.845469 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:44.845223    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:44.845469 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:44.845350    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:44.845469 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:44.845448    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:44.845643 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:44.845223    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:44.845643 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:44.845568    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:46.845524 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:46.845480    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:46.845991 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:46.845630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:46.845991 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:46.845645    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:46.845991 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:46.845720    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:46.845991 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:46.845752    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:46.845991 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:46.845863    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:48.844843 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:48.844814    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:48.845296 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:48.844820    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:48.845296 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:48.844931    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:48.845296 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:48.844960    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:48.845296 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:48.845018    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:48.845296 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:48.845109    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:48.961933 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:48.961691    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal" event={"ID":"cd8a86fcd23301d920fac345ba1c9920","Type":"ContainerStarted","Data":"ef87f2a77cfd46d84bb1ef3261c92b60ca5d46f9c391481421b11d9f45e9feb1"}
Jul 06 19:05:48.964219 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:48.964168    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pvjfs" event={"ID":"fa99e021-b6c6-478c-bb15-98c1555945f4","Type":"ContainerStarted","Data":"91afd16aa7aa171a0900b0fb76c29886199bd8424d1daca877c56f6d15f6b18f"}
Jul 06 19:05:48.966994 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:48.966963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gzjr5" event={"ID":"1ad9261a-5ea1-4d76-87ab-7efe1e0214c9","Type":"ContainerStarted","Data":"79eefd1f25110c3936ff1f9895ea2c6ece988b109fa63727f5684113d8b6868b"}
Jul 06 19:05:48.970625 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:48.970257    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rxxnr" event={"ID":"08b7a2ec-da87-41ff-b581-e0c745521671","Type":"ContainerStarted","Data":"99a1e4ccbdc7f677b2c05101e381d58a148da872f4c4f808a7072b76055fa99a"}
Jul 06 19:05:48.977240 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:48.977193    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-117.ec2.internal" podStartSLOduration=20.977179513 podStartE2EDuration="20.977179513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:48.977033686 +0000 UTC m=+22.587161031" watchObservedRunningTime="2026-07-06 19:05:48.977179513 +0000 UTC m=+22.587306857"
Jul 06 19:05:48.995519 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:48.994827    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rxxnr" podStartSLOduration=10.301849484 podStartE2EDuration="21.994804463s" totalImagesPullingTime="11.692954979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:48.994315111 +0000 UTC m=+22.604442455" watchObservedRunningTime="2026-07-06 19:05:48.994804463 +0000 UTC m=+22.604931809"
Jul 06 19:05:49.016092 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:49.016003    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gzjr5" podStartSLOduration=2.238756623 podStartE2EDuration="22.015985746s" totalImagesPullingTime="19.777229123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:49.015952846 +0000 UTC m=+22.626080192" watchObservedRunningTime="2026-07-06 19:05:49.015985746 +0000 UTC m=+22.626113090"
Jul 06 19:05:49.033971 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:49.033918    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pvjfs" podStartSLOduration=2.349171448 podStartE2EDuration="22.033893285s" totalImagesPullingTime="19.684721837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:49.033143255 +0000 UTC m=+22.643270599" watchObservedRunningTime="2026-07-06 19:05:49.033893285 +0000 UTC m=+22.644020630"
Jul 06 19:05:49.973432 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:49.973218    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl" event={"ID":"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c","Type":"ContainerStarted","Data":"170bf1662591919ffa9ed64a42261537f87f2ab132290d16cede0208a223d5d2"}
Jul 06 19:05:49.976008 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:49.975983    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk" event={"ID":"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4","Type":"ContainerStarted","Data":"95d481f4f0d0cb9e5c6123fba43b482992dd9ca9a31a6c8d67c7812c203d1da3"}
Jul 06 19:05:49.976120 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:49.976051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk" event={"ID":"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4","Type":"ContainerStarted","Data":"5649a5a7b32acd4f26b3d6af2f030eef9b9a3f941bff68c552deb48d2e160554"}
Jul 06 19:05:49.976120 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:49.976081    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk" event={"ID":"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4","Type":"ContainerStarted","Data":"8c4018c46b5540888b0d789afdca2d478deb30c029370883b354ed3cf7f95cf3"}
Jul 06 19:05:49.976197 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:49.976123    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk" event={"ID":"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4","Type":"ContainerStarted","Data":"7ae8b99eac9e58a9cd69c6bca4ca50fc47371a6ad53810a182fd37e2ee62c068"}
Jul 06 19:05:49.976197 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:49.976155    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk" event={"ID":"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4","Type":"ContainerStarted","Data":"71eaf1ac655d34d314360da51bf13a7469e4477918e7538abb498aea6cd6dd05"}
Jul 06 19:05:49.976269 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:49.976200    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk" event={"ID":"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4","Type":"ContainerStarted","Data":"2e9957859968f057d097a720f2973cc85947e4ff28b2d0e18550eed310fa97ab"}
Jul 06 19:05:49.977286 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:49.977266    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s5rb8" event={"ID":"1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5","Type":"ContainerStarted","Data":"2af908472040af728656934d49967ca43a0b90b3e0ce7582bbdd1d1c2e5a0214"}
Jul 06 19:05:49.978525 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:49.978505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j8549" event={"ID":"f57113cb-3b9f-4d8e-b70e-8d04ba9bf414","Type":"ContainerStarted","Data":"d3b74ce23c0ba361f1be4860a2ae2322a288f77f27956f2cd60682e1e1e595ac"}
Jul 06 19:05:49.979931 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:49.979908    2580 generic.go:356] "Generic (PLEG): container finished" podID="30f84023-2d8b-4e26-85b9-fa4c29a181c0" containerID="bb959e393844b9ac1f3117fc3a88f3ae9b021ebb2b80947b396d9b0764bd547e" exitCode=0
Jul 06 19:05:49.980026 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:49.980002    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8x7q" event={"ID":"30f84023-2d8b-4e26-85b9-fa4c29a181c0","Type":"ContainerDied","Data":"bb959e393844b9ac1f3117fc3a88f3ae9b021ebb2b80947b396d9b0764bd547e"}
Jul 06 19:05:49.993581 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:49.993529    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s5rb8" podStartSLOduration=3.338665375 podStartE2EDuration="22.993508892s" totalImagesPullingTime="19.654843517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:49.99347665 +0000 UTC m=+23.603603995" watchObservedRunningTime="2026-07-06 19:05:49.993508892 +0000 UTC m=+23.603636235"
Jul 06 19:05:50.007818 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:50.007773    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j8549" podStartSLOduration=3.349363336 podStartE2EDuration="23.007758493s" totalImagesPullingTime="19.658395157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:50.007335706 +0000 UTC m=+23.617463049" watchObservedRunningTime="2026-07-06 19:05:50.007758493 +0000 UTC m=+23.617885837"
Jul 06 19:05:50.293984 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:50.293959    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 19:05:50.842098 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:50.841999    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:05:50.293977989Z","UUID":"4b905d98-71a6-492b-a883-79bbe33542a1","Handler":null,"Name":"","Endpoint":""}
Jul 06 19:05:50.843650 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:50.843626    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 19:05:50.843824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:50.843671    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 19:05:50.844417 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:50.844343    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:50.844417 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:50.844360    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:50.844584 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:50.844468    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:50.844584 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:50.844495    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:50.844666 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:50.844614    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:50.844751 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:50.844673    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:50.984126 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:50.984080    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4tz48" event={"ID":"1cd32162-3d42-4547-91cf-f7e66346e72b","Type":"ContainerStarted","Data":"3813519cd2adbf6ebb17f1199fa56c8845ba4cf208529ede9277ad6da74503cc"}
Jul 06 19:05:50.986362 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:50.986320    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl" event={"ID":"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c","Type":"ContainerStarted","Data":"1d83eebaadd5ea5fab4688a9acf30c624219fd19e90ea750a286e98d7b271115"}
Jul 06 19:05:50.999152 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:50.999102    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4tz48" podStartSLOduration=4.440271289 podStartE2EDuration="23.999081366s" totalImagesPullingTime="19.558810077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:50.998443736 +0000 UTC m=+24.608571082" watchObservedRunningTime="2026-07-06 19:05:50.999081366 +0000 UTC m=+24.609208714"
Jul 06 19:05:51.990938 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:51.990722    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl" event={"ID":"ef99408b-5cc5-41cc-bfa9-56d2cab6b27c","Type":"ContainerStarted","Data":"329874cde39dcac56469f054c5729e08f50a3a05454c4e4fcff91fe492fcf290"}
Jul 06 19:05:51.994321 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:51.994291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk" event={"ID":"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4","Type":"ContainerStarted","Data":"453e6af33388953947650aea664d9863f55961b812c3da82f0059d5961014d90"}
Jul 06 19:05:52.844813 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:52.844784    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:52.845046 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:52.844785    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:52.845046 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:52.844892    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:52.845046 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:52.844785    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:52.845046 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:52.844991    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:52.845198 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:52.845043    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:53.473780 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:53.473702    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rxxnr"
Jul 06 19:05:53.474362 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:53.474338    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rxxnr"
Jul 06 19:05:53.491213 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:53.491126    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cp8bl" podStartSLOduration=4.835215634 podStartE2EDuration="26.491102923s" totalImagesPullingTime="21.655887289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:52.007556977 +0000 UTC m=+25.617684339" watchObservedRunningTime="2026-07-06 19:05:53.491102923 +0000 UTC m=+27.101230267"
Jul 06 19:05:53.998855 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:53.998822    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rxxnr"
Jul 06 19:05:53.999437 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:53.999417    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rxxnr"
Jul 06 19:05:54.844547 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:54.844523    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:54.845097 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:54.844535    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:54.845097 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:54.844647    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:54.845097 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:54.844723    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:54.845097 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:54.844702    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:54.845097 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:54.844789    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:55.005935 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:55.005855    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk" event={"ID":"f89b0431-4e23-43e4-88db-3ffeeb5a2ae4","Type":"ContainerStarted","Data":"61ac2d7f6fa2dd118f70d054ceea2763c1c3ce00150f986b86c6205f52f52ec6"}
Jul 06 19:05:55.035407 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:55.035346    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk" podStartSLOduration=8.416412753 podStartE2EDuration="28.03532802s" totalImagesPullingTime="19.618915267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:05:55.034459614 +0000 UTC m=+28.644586976" watchObservedRunningTime="2026-07-06 19:05:55.03532802 +0000 UTC m=+28.645455364"
Jul 06 19:05:56.011812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:56.010593    2580 generic.go:356] "Generic (PLEG): container finished" podID="30f84023-2d8b-4e26-85b9-fa4c29a181c0" containerID="e1ff599ec40b6ef6d3a0f38993d7f6d38c40cb9c82f2ff6b24b88680516f9893" exitCode=0
Jul 06 19:05:56.011812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:56.010785    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:05:56.011812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:56.011696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8x7q" event={"ID":"30f84023-2d8b-4e26-85b9-fa4c29a181c0","Type":"ContainerDied","Data":"e1ff599ec40b6ef6d3a0f38993d7f6d38c40cb9c82f2ff6b24b88680516f9893"}
Jul 06 19:05:56.011812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:56.011763    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:56.011812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:56.011817    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:56.035622 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:56.035589    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:56.036885 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:56.036861    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:56.742498 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:56.742463    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6zm9c"]
Jul 06 19:05:56.742653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:56.742617    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:56.742774 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:56.742734    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:56.745853 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:56.745825    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6p7zh"]
Jul 06 19:05:56.745959 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:56.745947    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:56.746066 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:56.746047    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:56.746414 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:56.746391    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pth4c"]
Jul 06 19:05:56.746511 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:56.746504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:56.746613 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:56.746597    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:57.013486 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:57.013460    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:05:57.845083 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:57.845037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:57.845278 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:57.845037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:57.845278 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:57.845163    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:57.845278 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:57.845248    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:05:58.017479 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:58.017291    2580 generic.go:356] "Generic (PLEG): container finished" podID="30f84023-2d8b-4e26-85b9-fa4c29a181c0" containerID="a871a3f2dee1ce5752288b35ebce1d643120fb16fc7293776982b9e604f24ae8" exitCode=0
Jul 06 19:05:58.017479 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:58.017375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8x7q" event={"ID":"30f84023-2d8b-4e26-85b9-fa4c29a181c0","Type":"ContainerDied","Data":"a871a3f2dee1ce5752288b35ebce1d643120fb16fc7293776982b9e604f24ae8"}
Jul 06 19:05:58.018008 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:58.017652    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:05:58.070909 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:58.070874    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:05:58.844963 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:58.844930    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:05:58.845109 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:58.845065    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:05:59.022522 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:59.022436    2580 generic.go:356] "Generic (PLEG): container finished" podID="30f84023-2d8b-4e26-85b9-fa4c29a181c0" containerID="0eea399a68ab52dbe29de3cbcf8a379a7748f48b7ce9ceee716c0d5bb188182b" exitCode=0
Jul 06 19:05:59.023014 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:59.022525    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8x7q" event={"ID":"30f84023-2d8b-4e26-85b9-fa4c29a181c0","Type":"ContainerDied","Data":"0eea399a68ab52dbe29de3cbcf8a379a7748f48b7ce9ceee716c0d5bb188182b"}
Jul 06 19:05:59.041128 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:59.041090    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk" podUID="f89b0431-4e23-43e4-88db-3ffeeb5a2ae4" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 06 19:05:59.844909 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:59.844875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:05:59.845078 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:05:59.844893    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:05:59.845078 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:59.845012    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pth4c" podUID="b09aa790-cc9a-4341-bedc-7c18351e27d5"
Jul 06 19:05:59.845078 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:05:59.845035    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6p7zh" podUID="5fc9e75a-05d0-4604-8402-6aa5c4969689"
Jul 06 19:06:00.606044 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:00.605969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:06:00.606736 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:00.606051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs\") pod \"network-metrics-daemon-pth4c\" (UID: \"b09aa790-cc9a-4341-bedc-7c18351e27d5\") " pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:06:00.606736 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:00.606127    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:06:00.606736 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:00.606188    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret podName:c3a18cca-96fa-4abb-b1e8-d061a4a0599c nodeName:}" failed. No retries permitted until 2026-07-06 19:06:32.606170382 +0000 UTC m=+66.216297707 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret") pod "global-pull-secret-syncer-6zm9c" (UID: "c3a18cca-96fa-4abb-b1e8-d061a4a0599c") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:06:00.606736 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:00.606131    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:06:00.606736 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:00.606286    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs podName:b09aa790-cc9a-4341-bedc-7c18351e27d5 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:32.606261495 +0000 UTC m=+66.216388831 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs") pod "network-metrics-daemon-pth4c" (UID: "b09aa790-cc9a-4341-bedc-7c18351e27d5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:06:00.707177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:00.707139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnwl\" (UniqueName: \"kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl\") pod \"network-check-target-6p7zh\" (UID: \"5fc9e75a-05d0-4604-8402-6aa5c4969689\") " pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:06:00.707367 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:00.707319    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:06:00.707367 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:00.707346    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:06:00.707367 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:00.707355    2580 projected.go:196] Error preparing data for projected volume kube-api-access-zxnwl for pod openshift-network-diagnostics/network-check-target-6p7zh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:06:00.707519 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:00.707417    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl podName:5fc9e75a-05d0-4604-8402-6aa5c4969689 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:32.707396941 +0000 UTC m=+66.317524284 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxnwl" (UniqueName: "kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl") pod "network-check-target-6p7zh" (UID: "5fc9e75a-05d0-4604-8402-6aa5c4969689") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:06:00.845137 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:00.845107    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:06:00.845317 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:00.845252    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zm9c" podUID="c3a18cca-96fa-4abb-b1e8-d061a4a0599c"
Jul 06 19:06:01.742644 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.742614    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-117.ec2.internal" event="NodeReady"
Jul 06 19:06:01.743103 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.742780    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 19:06:01.774821 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.774787    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75b9c54f4d-xnlq5"]
Jul 06 19:06:01.777021 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.776999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:01.780806 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.780786    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 19:06:01.781892 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.781872    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 19:06:01.782046 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.782029    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 19:06:01.782440 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.782421    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5j9kh\""
Jul 06 19:06:01.797014 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.796995    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k8kdm"]
Jul 06 19:06:01.798811 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.798789    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:01.800727 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.800672    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75b9c54f4d-xnlq5"]
Jul 06 19:06:01.803111 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.803083    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8npzr\""
Jul 06 19:06:01.803269 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.803246    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:06:01.803373 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.803299    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:06:01.805547 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.805521    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 19:06:01.810127 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.810103    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gm5ph"]
Jul 06 19:06:01.811949 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.811932    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gm5ph"
Jul 06 19:06:01.818416 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.818392    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:06:01.818521 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.818500    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ll82v\""
Jul 06 19:06:01.818598 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.818395    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:06:01.819363 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.819345    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:06:01.831738 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.831646    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gm5ph"]
Jul 06 19:06:01.832433 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.832416    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k8kdm"]
Jul 06 19:06:01.845093 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.845071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:06:01.845236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.845081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:06:01.847419 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.847228    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:06:01.847419 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.847245    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:06:01.847419 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.847262    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xsmh6\""
Jul 06 19:06:01.847419 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.847282    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-85brg\""
Jul 06 19:06:01.847419 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.847329    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:06:01.916355 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.916319    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c66f5ab-d626-436c-8dc1-53201c728381-tmp-dir\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:01.916529 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.916387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91599e02-80f3-41c5-a673-7d8f682d349f-trusted-ca\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:01.916529 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.916446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqtvx\" (UniqueName: \"kubernetes.io/projected/2806f7af-59f9-4717-b25a-4bb8d81eccf5-kube-api-access-sqtvx\") pod \"ingress-canary-gm5ph\" (UID: \"2806f7af-59f9-4717-b25a-4bb8d81eccf5\") " pod="openshift-ingress-canary/ingress-canary-gm5ph"
Jul 06 19:06:01.916529 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.916484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91599e02-80f3-41c5-a673-7d8f682d349f-image-registry-private-configuration\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:01.916529 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.916516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91599e02-80f3-41c5-a673-7d8f682d349f-installation-pull-secrets\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:01.916747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.916536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr5th\" (UniqueName: \"kubernetes.io/projected/9c66f5ab-d626-436c-8dc1-53201c728381-kube-api-access-wr5th\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:01.916747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.916583    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:01.916747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.916627    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91599e02-80f3-41c5-a673-7d8f682d349f-registry-certificates\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:01.916747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.916729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:01.917001 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.916761    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2806f7af-59f9-4717-b25a-4bb8d81eccf5-cert\") pod \"ingress-canary-gm5ph\" (UID: \"2806f7af-59f9-4717-b25a-4bb8d81eccf5\") " pod="openshift-ingress-canary/ingress-canary-gm5ph"
Jul 06 19:06:01.917001 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.916800    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91599e02-80f3-41c5-a673-7d8f682d349f-ca-trust-extracted\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:01.917001 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.916824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c66f5ab-d626-436c-8dc1-53201c728381-config-volume\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:01.917001 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.916860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-bound-sa-token\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:01.917001 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:01.916889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4c8t\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-kube-api-access-b4c8t\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.017741 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.017637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91599e02-80f3-41c5-a673-7d8f682d349f-ca-trust-extracted\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.017741 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.017678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c66f5ab-d626-436c-8dc1-53201c728381-config-volume\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:02.017741 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.017734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-bound-sa-token\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.017982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.017758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4c8t\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-kube-api-access-b4c8t\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.017982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.017827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c66f5ab-d626-436c-8dc1-53201c728381-tmp-dir\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:02.017982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.017853    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91599e02-80f3-41c5-a673-7d8f682d349f-trusted-ca\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.017982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.017883    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqtvx\" (UniqueName: \"kubernetes.io/projected/2806f7af-59f9-4717-b25a-4bb8d81eccf5-kube-api-access-sqtvx\") pod \"ingress-canary-gm5ph\" (UID: \"2806f7af-59f9-4717-b25a-4bb8d81eccf5\") " pod="openshift-ingress-canary/ingress-canary-gm5ph"
Jul 06 19:06:02.017982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.017918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91599e02-80f3-41c5-a673-7d8f682d349f-image-registry-private-configuration\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.017982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.017959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91599e02-80f3-41c5-a673-7d8f682d349f-installation-pull-secrets\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.018177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.017983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr5th\" (UniqueName: \"kubernetes.io/projected/9c66f5ab-d626-436c-8dc1-53201c728381-kube-api-access-wr5th\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:02.018177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.018022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.018177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.018045    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91599e02-80f3-41c5-a673-7d8f682d349f-registry-certificates\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.018177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.018075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:02.018177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.018092    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91599e02-80f3-41c5-a673-7d8f682d349f-ca-trust-extracted\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.018177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.018097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2806f7af-59f9-4717-b25a-4bb8d81eccf5-cert\") pod \"ingress-canary-gm5ph\" (UID: \"2806f7af-59f9-4717-b25a-4bb8d81eccf5\") " pod="openshift-ingress-canary/ingress-canary-gm5ph"
Jul 06 19:06:02.018357 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:02.018218    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:02.018357 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:02.018233    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75b9c54f4d-xnlq5: secret "image-registry-tls" not found
Jul 06 19:06:02.018357 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:02.018286    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls podName:91599e02-80f3-41c5-a673-7d8f682d349f nodeName:}" failed. No retries permitted until 2026-07-06 19:06:02.518268083 +0000 UTC m=+36.128395419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls") pod "image-registry-75b9c54f4d-xnlq5" (UID: "91599e02-80f3-41c5-a673-7d8f682d349f") : secret "image-registry-tls" not found
Jul 06 19:06:02.018450 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.018347    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c66f5ab-d626-436c-8dc1-53201c728381-config-volume\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:02.018634 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.018614    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91599e02-80f3-41c5-a673-7d8f682d349f-registry-certificates\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.018917 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:02.018893    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:02.019030 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:02.018940    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls podName:9c66f5ab-d626-436c-8dc1-53201c728381 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:02.518926441 +0000 UTC m=+36.129053767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls") pod "dns-default-k8kdm" (UID: "9c66f5ab-d626-436c-8dc1-53201c728381") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:02.019231 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.019198    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91599e02-80f3-41c5-a673-7d8f682d349f-trusted-ca\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.019355 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.019287    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c66f5ab-d626-436c-8dc1-53201c728381-tmp-dir\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:02.022938 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.022916    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91599e02-80f3-41c5-a673-7d8f682d349f-image-registry-private-configuration\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.022938 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.022935    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91599e02-80f3-41c5-a673-7d8f682d349f-installation-pull-secrets\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.023183 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.023163    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2806f7af-59f9-4717-b25a-4bb8d81eccf5-cert\") pod \"ingress-canary-gm5ph\" (UID: \"2806f7af-59f9-4717-b25a-4bb8d81eccf5\") " pod="openshift-ingress-canary/ingress-canary-gm5ph"
Jul 06 19:06:02.026421 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.026387    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-bound-sa-token\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.027351 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.027326    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqtvx\" (UniqueName: \"kubernetes.io/projected/2806f7af-59f9-4717-b25a-4bb8d81eccf5-kube-api-access-sqtvx\") pod \"ingress-canary-gm5ph\" (UID: \"2806f7af-59f9-4717-b25a-4bb8d81eccf5\") " pod="openshift-ingress-canary/ingress-canary-gm5ph"
Jul 06 19:06:02.028199 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.028151    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4c8t\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-kube-api-access-b4c8t\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.028668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.028645    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr5th\" (UniqueName: \"kubernetes.io/projected/9c66f5ab-d626-436c-8dc1-53201c728381-kube-api-access-wr5th\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:02.122210 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.122086    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gm5ph"
Jul 06 19:06:02.373751 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.373650    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:02.461418 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.461379    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:02.525260 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.525222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:02.525442 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.525369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:02.525442 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:02.525373    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:02.525553 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:02.525462    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls podName:9c66f5ab-d626-436c-8dc1-53201c728381 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:03.525443878 +0000 UTC m=+37.135571219 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls") pod "dns-default-k8kdm" (UID: "9c66f5ab-d626-436c-8dc1-53201c728381") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:02.525553 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:02.525512    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:02.525553 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:02.525527    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75b9c54f4d-xnlq5: secret "image-registry-tls" not found
Jul 06 19:06:02.525670 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:02.525609    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls podName:91599e02-80f3-41c5-a673-7d8f682d349f nodeName:}" failed. No retries permitted until 2026-07-06 19:06:03.525569491 +0000 UTC m=+37.135696822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls") pod "image-registry-75b9c54f4d-xnlq5" (UID: "91599e02-80f3-41c5-a673-7d8f682d349f") : secret "image-registry-tls" not found
Jul 06 19:06:02.562897 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.562847    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:02.844635 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.844597    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:06:02.847257 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:02.847232    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:06:03.109349 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:03.109162    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gm5ph"]
Jul 06 19:06:03.114801 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:03.114772    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2806f7af_59f9_4717_b25a_4bb8d81eccf5.slice/crio-f1c95e07d9f3ab9874abb5982e7182facabd060015c804fc40b273a76d7a670c WatchSource:0}: Error finding container f1c95e07d9f3ab9874abb5982e7182facabd060015c804fc40b273a76d7a670c: Status 404 returned error can't find the container with id f1c95e07d9f3ab9874abb5982e7182facabd060015c804fc40b273a76d7a670c
Jul 06 19:06:03.533718 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:03.533663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:03.533896 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:03.533815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:03.533896 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:03.533852    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:03.533969 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:03.533926    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls podName:9c66f5ab-d626-436c-8dc1-53201c728381 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:05.533904401 +0000 UTC m=+39.144031731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls") pod "dns-default-k8kdm" (UID: "9c66f5ab-d626-436c-8dc1-53201c728381") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:03.533969 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:03.533927    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:03.533969 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:03.533942    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75b9c54f4d-xnlq5: secret "image-registry-tls" not found
Jul 06 19:06:03.534090 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:03.534037    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls podName:91599e02-80f3-41c5-a673-7d8f682d349f nodeName:}" failed. No retries permitted until 2026-07-06 19:06:05.534020672 +0000 UTC m=+39.144147999 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls") pod "image-registry-75b9c54f4d-xnlq5" (UID: "91599e02-80f3-41c5-a673-7d8f682d349f") : secret "image-registry-tls" not found
Jul 06 19:06:04.035832 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:04.035791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gm5ph" event={"ID":"2806f7af-59f9-4717-b25a-4bb8d81eccf5","Type":"ContainerStarted","Data":"f1c95e07d9f3ab9874abb5982e7182facabd060015c804fc40b273a76d7a670c"}
Jul 06 19:06:04.039093 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:04.039057    2580 generic.go:356] "Generic (PLEG): container finished" podID="30f84023-2d8b-4e26-85b9-fa4c29a181c0" containerID="705517f5425ba1bb4a432e426316b9ed6b0be2c8ea97f80f39633825b62e9d86" exitCode=0
Jul 06 19:06:04.039238 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:04.039119    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8x7q" event={"ID":"30f84023-2d8b-4e26-85b9-fa4c29a181c0","Type":"ContainerDied","Data":"705517f5425ba1bb4a432e426316b9ed6b0be2c8ea97f80f39633825b62e9d86"}
Jul 06 19:06:05.045035 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:05.045000    2580 generic.go:356] "Generic (PLEG): container finished" podID="30f84023-2d8b-4e26-85b9-fa4c29a181c0" containerID="bfd6c7c315acfc0b9574b98fd3d21374ea36b64656fe53541f25f7ffc12322d7" exitCode=0
Jul 06 19:06:05.045509 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:05.045065    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8x7q" event={"ID":"30f84023-2d8b-4e26-85b9-fa4c29a181c0","Type":"ContainerDied","Data":"bfd6c7c315acfc0b9574b98fd3d21374ea36b64656fe53541f25f7ffc12322d7"}
Jul 06 19:06:05.550515 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:05.550345    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:05.550741 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:05.550524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:05.550741 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:05.550484    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:05.550741 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:05.550593    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75b9c54f4d-xnlq5: secret "image-registry-tls" not found
Jul 06 19:06:05.550741 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:05.550648    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:05.550741 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:05.550650    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls podName:91599e02-80f3-41c5-a673-7d8f682d349f nodeName:}" failed. No retries permitted until 2026-07-06 19:06:09.55063292 +0000 UTC m=+43.160760244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls") pod "image-registry-75b9c54f4d-xnlq5" (UID: "91599e02-80f3-41c5-a673-7d8f682d349f") : secret "image-registry-tls" not found
Jul 06 19:06:05.550741 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:05.550740    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls podName:9c66f5ab-d626-436c-8dc1-53201c728381 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:09.550728451 +0000 UTC m=+43.160855774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls") pod "dns-default-k8kdm" (UID: "9c66f5ab-d626-436c-8dc1-53201c728381") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:06.051670 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.051631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8x7q" event={"ID":"30f84023-2d8b-4e26-85b9-fa4c29a181c0","Type":"ContainerStarted","Data":"2ec7c3716fa513c5046ae350c3715f83f77ab1c3afa21a1bde3e0687b7d2df5b"}
Jul 06 19:06:06.053170 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.053136    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gm5ph" event={"ID":"2806f7af-59f9-4717-b25a-4bb8d81eccf5","Type":"ContainerStarted","Data":"b2d8fdeaba61526df6cee319fc2e5ea3cf6d3a287ae9fd9d28d63f9578fc8e73"}
Jul 06 19:06:06.074490 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.074448    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z8x7q" podStartSLOduration=8.745947949 podStartE2EDuration="39.074432402s" totalImagesPullingTime="30.328484453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:06.073251811 +0000 UTC m=+39.683379159" watchObservedRunningTime="2026-07-06 19:06:06.074432402 +0000 UTC m=+39.684559744"
Jul 06 19:06:06.087464 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.087411    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gm5ph" podStartSLOduration=2.752375874 podStartE2EDuration="5.08739279s" totalImagesPullingTime="2.335016916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:06.086953366 +0000 UTC m=+39.697080710" watchObservedRunningTime="2026-07-06 19:06:06.08739279 +0000 UTC m=+39.697520134"
Jul 06 19:06:06.175857 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.175816    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:06.237451 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.237409    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:06.333231 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.333158    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jrn5b"]
Jul 06 19:06:06.363664 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.363633    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"]
Jul 06 19:06:06.363808 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.363773    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.365889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.365867    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:06:06.366016 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.365867    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 19:06:06.366131 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.366118    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 19:06:06.366234 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.366215    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:06:06.366298 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.366285    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-c2ngk\""
Jul 06 19:06:06.370668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.370447    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 19:06:06.395399 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.395371    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5cd66fb969-l6b4g"]
Jul 06 19:06:06.395533 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.395475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:06.398081 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.398059    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:06:06.398990 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.398970    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:06:06.399122 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.398977    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-287df\""
Jul 06 19:06:06.399122 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.398977    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 19:06:06.399122 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.399057    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 19:06:06.423408 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.423384    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jrn5b"]
Jul 06 19:06:06.423528 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.423426    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"]
Jul 06 19:06:06.423528 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.423428    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:06.423528 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.423441    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5cd66fb969-l6b4g"]
Jul 06 19:06:06.425762 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.425743    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:06:06.425762 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.425758    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nh57b\""
Jul 06 19:06:06.426228 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.425970    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 19:06:06.426228 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.425977    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 19:06:06.426228 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.426040    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 19:06:06.426228 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.426057    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 19:06:06.426228 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.426104    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:06:06.431908 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.431890    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kvdh2"]
Jul 06 19:06:06.457835 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.457807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db1034da-81bf-4b9b-a83d-cda34d16176b-serving-cert\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.457985 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.457863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1034da-81bf-4b9b-a83d-cda34d16176b-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.457985 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.457921    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db1034da-81bf-4b9b-a83d-cda34d16176b-snapshots\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.457985 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.457961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dlph\" (UniqueName: \"kubernetes.io/projected/db1034da-81bf-4b9b-a83d-cda34d16176b-kube-api-access-5dlph\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.458148 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.458031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1034da-81bf-4b9b-a83d-cda34d16176b-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.458148 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.458058    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db1034da-81bf-4b9b-a83d-cda34d16176b-tmp\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.459056 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.459039    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-62svf"]
Jul 06 19:06:06.459150 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.459137    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kvdh2"
Jul 06 19:06:06.461955 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.461931    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 19:06:06.462050 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.461959    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-z62lp\""
Jul 06 19:06:06.462406 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.462386    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:06:06.484996 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.484973    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn"]
Jul 06 19:06:06.485112 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.485091    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-62svf"
Jul 06 19:06:06.487720 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.487683    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rq99m\""
Jul 06 19:06:06.509299 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.509264    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:06.512316 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.512299    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59f45f7699-mfntn"]
Jul 06 19:06:06.512422 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.512409    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn"
Jul 06 19:06:06.514679 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.514659    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 19:06:06.515009 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.514989    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:06:06.515126 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.515101    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 19:06:06.515232 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.515135    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 19:06:06.515232 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.515207    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hq9tm\""
Jul 06 19:06:06.539137 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.539079    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt"]
Jul 06 19:06:06.539268 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.539212    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.559178 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:06.559320 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:06.559320 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-stats-auth\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:06.559320 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1034da-81bf-4b9b-a83d-cda34d16176b-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.559320 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-default-certificate\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:06.559518 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:06.559518 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db1034da-81bf-4b9b-a83d-cda34d16176b-serving-cert\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.559518 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p4vm\" (UniqueName: \"kubernetes.io/projected/47cefdd7-3087-4e22-b0cd-569e3862dd1b-kube-api-access-6p4vm\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:06.559518 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1034da-81bf-4b9b-a83d-cda34d16176b-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.559518 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wknxm\" (UniqueName: \"kubernetes.io/projected/554b6496-0ca4-4164-89e5-d7b412f3a87f-kube-api-access-wknxm\") pod \"volume-data-source-validator-5d456fdbcd-kvdh2\" (UID: \"554b6496-0ca4-4164-89e5-d7b412f3a87f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kvdh2"
Jul 06 19:06:06.559518 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db1034da-81bf-4b9b-a83d-cda34d16176b-snapshots\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.559518 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dlph\" (UniqueName: \"kubernetes.io/projected/db1034da-81bf-4b9b-a83d-cda34d16176b-kube-api-access-5dlph\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.560340 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559525    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:06.560340 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559550    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfxb4\" (UniqueName: \"kubernetes.io/projected/2dfad744-a2a4-48dc-8667-b506d429dc36-kube-api-access-kfxb4\") pod \"network-check-source-989f8b8dc-62svf\" (UID: \"2dfad744-a2a4-48dc-8667-b506d429dc36\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-62svf"
Jul 06 19:06:06.560340 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db1034da-81bf-4b9b-a83d-cda34d16176b-tmp\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.560340 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.559622    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfsmj\" (UniqueName: \"kubernetes.io/projected/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-kube-api-access-zfsmj\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:06.560340 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.560068    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1034da-81bf-4b9b-a83d-cda34d16176b-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.560340 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.560123    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/db1034da-81bf-4b9b-a83d-cda34d16176b-snapshots\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.560551 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.560390    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db1034da-81bf-4b9b-a83d-cda34d16176b-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.560551 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.560397    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db1034da-81bf-4b9b-a83d-cda34d16176b-tmp\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.563753 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.563733    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db1034da-81bf-4b9b-a83d-cda34d16176b-serving-cert\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.564885 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.564869    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kvdh2"]
Jul 06 19:06:06.564952 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.564903    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-62svf"]
Jul 06 19:06:06.564952 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.564917    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn"]
Jul 06 19:06:06.565050 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.565000    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt"
Jul 06 19:06:06.565050 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.565025    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f45f7699-mfntn"]
Jul 06 19:06:06.565050 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.565049    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt"]
Jul 06 19:06:06.565194 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.565085    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"]
Jul 06 19:06:06.567525 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.567420    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:06:06.567673 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.567545    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-p92bk\""
Jul 06 19:06:06.567800 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.567775    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 19:06:06.567917 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.567900    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 19:06:06.568012 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.567935    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 19:06:06.569892 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.569875    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dlph\" (UniqueName: \"kubernetes.io/projected/db1034da-81bf-4b9b-a83d-cda34d16176b-kube-api-access-5dlph\") pod \"insights-operator-5c847dcfc4-jrn5b\" (UID: \"db1034da-81bf-4b9b-a83d-cda34d16176b\") " pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.588613 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.588556    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:06.602033 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.602013    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tbqgn"]
Jul 06 19:06:06.602096 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.602081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"
Jul 06 19:06:06.605028 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.605012    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 19:06:06.605135 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.605018    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pv4f4\""
Jul 06 19:06:06.605135 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.605098    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:06:06.605243 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.605148    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 19:06:06.624309 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.624288    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"]
Jul 06 19:06:06.624405 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.624321    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tbqgn"]
Jul 06 19:06:06.624405 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.624402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:06.627571 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.627555    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 19:06:06.627670 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.627637    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 19:06:06.627806 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.627772    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-42n25\""
Jul 06 19:06:06.627806 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.627779    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:06:06.628053 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.628039    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 19:06:06.635129 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.635111    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 19:06:06.660930 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.660900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-default-certificate\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:06.660930 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.660932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:06.661139 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.660953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p4vm\" (UniqueName: \"kubernetes.io/projected/47cefdd7-3087-4e22-b0cd-569e3862dd1b-kube-api-access-6p4vm\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:06.661139 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.660974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-bound-sa-token\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.661139 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.660990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6djw9\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-kube-api-access-6djw9\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.661139 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wknxm\" (UniqueName: \"kubernetes.io/projected/554b6496-0ca4-4164-89e5-d7b412f3a87f-kube-api-access-wknxm\") pod \"volume-data-source-validator-5d456fdbcd-kvdh2\" (UID: \"554b6496-0ca4-4164-89e5-d7b412f3a87f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kvdh2"
Jul 06 19:06:06.661139 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661043    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d99612d0-3b8a-45e3-963a-930e887c2d43-installation-pull-secrets\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.661139 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:06.661428 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfxb4\" (UniqueName: \"kubernetes.io/projected/2dfad744-a2a4-48dc-8667-b506d429dc36-kube-api-access-kfxb4\") pod \"network-check-source-989f8b8dc-62svf\" (UID: \"2dfad744-a2a4-48dc-8667-b506d429dc36\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-62svf"
Jul 06 19:06:06.661428 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:06.661191    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:06:06.661428 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edacf919-3e12-4edd-a878-af1b182a8352-config\") pod \"service-ca-operator-5d46d9ffd4-tnsxt\" (UID: \"edacf919-3e12-4edd-a878-af1b182a8352\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt"
Jul 06 19:06:06.661428 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661234    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-certificates\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.661428 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:06.661253    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls podName:c25aa9b5-06e8-4aa0-8cea-d1179e62a508 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:07.161234175 +0000 UTC m=+40.771361497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-sshgz" (UID: "c25aa9b5-06e8-4aa0-8cea-d1179e62a508") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:06:06.661639 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d99612d0-3b8a-45e3-963a-930e887c2d43-ca-trust-extracted\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.661639 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfsmj\" (UniqueName: \"kubernetes.io/projected/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-kube-api-access-zfsmj\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:06.661639 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea6c4d57-09e8-4016-9038-69c4d0bd541d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-trvzn\" (UID: \"ea6c4d57-09e8-4016-9038-69c4d0bd541d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn"
Jul 06 19:06:06.661757 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661734    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:06.661798 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6c4d57-09e8-4016-9038-69c4d0bd541d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-trvzn\" (UID: \"ea6c4d57-09e8-4016-9038-69c4d0bd541d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn"
Jul 06 19:06:06.661877 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661861    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edacf919-3e12-4edd-a878-af1b182a8352-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tnsxt\" (UID: \"edacf919-3e12-4edd-a878-af1b182a8352\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt"
Jul 06 19:06:06.661922 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.661973 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:06.662004 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.661989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:06.662038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.662010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-stats-auth\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:06.662067 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.662045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d99612d0-3b8a-45e3-963a-930e887c2d43-trusted-ca\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.662096 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:06.662066    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle podName:47cefdd7-3087-4e22-b0cd-569e3862dd1b nodeName:}" failed. No retries permitted until 2026-07-06 19:06:07.16205443 +0000 UTC m=+40.772181782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle") pod "router-default-5cd66fb969-l6b4g" (UID: "47cefdd7-3087-4e22-b0cd-569e3862dd1b") : configmap references non-existent config key: service-ca.crt
Jul 06 19:06:06.662096 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.662083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9q8m\" (UniqueName: \"kubernetes.io/projected/edacf919-3e12-4edd-a878-af1b182a8352-kube-api-access-p9q8m\") pod \"service-ca-operator-5d46d9ffd4-tnsxt\" (UID: \"edacf919-3e12-4edd-a878-af1b182a8352\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt"
Jul 06 19:06:06.662169 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:06.662091    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:06:06.662169 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.662114    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d99612d0-3b8a-45e3-963a-930e887c2d43-image-registry-private-configuration\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.662169 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:06.662150    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs podName:47cefdd7-3087-4e22-b0cd-569e3862dd1b nodeName:}" failed. No retries permitted until 2026-07-06 19:06:07.162133975 +0000 UTC m=+40.772261315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs") pod "router-default-5cd66fb969-l6b4g" (UID: "47cefdd7-3087-4e22-b0cd-569e3862dd1b") : secret "router-metrics-certs-default" not found
Jul 06 19:06:06.662271 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.662189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2znk\" (UniqueName: \"kubernetes.io/projected/ea6c4d57-09e8-4016-9038-69c4d0bd541d-kube-api-access-c2znk\") pod \"kube-storage-version-migrator-operator-846bf668f7-trvzn\" (UID: \"ea6c4d57-09e8-4016-9038-69c4d0bd541d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn"
Jul 06 19:06:06.663723 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.663688    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-default-certificate\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:06.664232 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.664213    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-stats-auth\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:06.672027 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.671993    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfsmj\" (UniqueName: \"kubernetes.io/projected/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-kube-api-access-zfsmj\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:06.672518 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.672492    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b"
Jul 06 19:06:06.672961 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.672939    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p4vm\" (UniqueName: \"kubernetes.io/projected/47cefdd7-3087-4e22-b0cd-569e3862dd1b-kube-api-access-6p4vm\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:06.673034 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.672986    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wknxm\" (UniqueName: \"kubernetes.io/projected/554b6496-0ca4-4164-89e5-d7b412f3a87f-kube-api-access-wknxm\") pod \"volume-data-source-validator-5d456fdbcd-kvdh2\" (UID: \"554b6496-0ca4-4164-89e5-d7b412f3a87f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kvdh2"
Jul 06 19:06:06.673161 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.673146    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfxb4\" (UniqueName: \"kubernetes.io/projected/2dfad744-a2a4-48dc-8667-b506d429dc36-kube-api-access-kfxb4\") pod \"network-check-source-989f8b8dc-62svf\" (UID: \"2dfad744-a2a4-48dc-8667-b506d429dc36\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-62svf"
Jul 06 19:06:06.763022 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.762815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edacf919-3e12-4edd-a878-af1b182a8352-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tnsxt\" (UID: \"edacf919-3e12-4edd-a878-af1b182a8352\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt"
Jul 06 19:06:06.763022 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.763216 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763043    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c110e8e-faa6-4880-8239-3119fd4d7815-config\") pod \"console-operator-68b757fb67-tbqgn\" (UID: \"4c110e8e-faa6-4880-8239-3119fd4d7815\") " pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:06.763216 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763102    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d99612d0-3b8a-45e3-963a-930e887c2d43-trusted-ca\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.763216 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763128    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghnkm\" (UniqueName: \"kubernetes.io/projected/2864aa0f-fdac-4779-9033-734d22cad700-kube-api-access-ghnkm\") pod \"cluster-samples-operator-56fcf86bf-bn2rq\" (UID: \"2864aa0f-fdac-4779-9033-734d22cad700\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"
Jul 06 19:06:06.763216 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:06.763146    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:06.763216 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9q8m\" (UniqueName: \"kubernetes.io/projected/edacf919-3e12-4edd-a878-af1b182a8352-kube-api-access-p9q8m\") pod \"service-ca-operator-5d46d9ffd4-tnsxt\" (UID: \"edacf919-3e12-4edd-a878-af1b182a8352\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt"
Jul 06 19:06:06.763216 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:06.763163    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f45f7699-mfntn: secret "image-registry-tls" not found
Jul 06 19:06:06.763581 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:06.763240    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls podName:d99612d0-3b8a-45e3-963a-930e887c2d43 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:07.263218859 +0000 UTC m=+40.873346181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls") pod "image-registry-59f45f7699-mfntn" (UID: "d99612d0-3b8a-45e3-963a-930e887c2d43") : secret "image-registry-tls" not found
Jul 06 19:06:06.763581 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d99612d0-3b8a-45e3-963a-930e887c2d43-image-registry-private-configuration\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.763581 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763362    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bn2rq\" (UID: \"2864aa0f-fdac-4779-9033-734d22cad700\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"
Jul 06 19:06:06.763581 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2znk\" (UniqueName: \"kubernetes.io/projected/ea6c4d57-09e8-4016-9038-69c4d0bd541d-kube-api-access-c2znk\") pod \"kube-storage-version-migrator-operator-846bf668f7-trvzn\" (UID: \"ea6c4d57-09e8-4016-9038-69c4d0bd541d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn"
Jul 06 19:06:06.763581 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c110e8e-faa6-4880-8239-3119fd4d7815-trusted-ca\") pod \"console-operator-68b757fb67-tbqgn\" (UID: \"4c110e8e-faa6-4880-8239-3119fd4d7815\") " pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:06.763581 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnnch\" (UniqueName: \"kubernetes.io/projected/4c110e8e-faa6-4880-8239-3119fd4d7815-kube-api-access-xnnch\") pod \"console-operator-68b757fb67-tbqgn\" (UID: \"4c110e8e-faa6-4880-8239-3119fd4d7815\") " pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:06.763581 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763577    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-bound-sa-token\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.763982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6djw9\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-kube-api-access-6djw9\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.763982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d99612d0-3b8a-45e3-963a-930e887c2d43-installation-pull-secrets\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.763982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edacf919-3e12-4edd-a878-af1b182a8352-config\") pod \"service-ca-operator-5d46d9ffd4-tnsxt\" (UID: \"edacf919-3e12-4edd-a878-af1b182a8352\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt"
Jul 06 19:06:06.763982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c110e8e-faa6-4880-8239-3119fd4d7815-serving-cert\") pod \"console-operator-68b757fb67-tbqgn\" (UID: \"4c110e8e-faa6-4880-8239-3119fd4d7815\") " pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:06.763982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-certificates\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.763982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d99612d0-3b8a-45e3-963a-930e887c2d43-ca-trust-extracted\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.763982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea6c4d57-09e8-4016-9038-69c4d0bd541d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-trvzn\" (UID: \"ea6c4d57-09e8-4016-9038-69c4d0bd541d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn"
Jul 06 19:06:06.764321 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.763894    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6c4d57-09e8-4016-9038-69c4d0bd541d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-trvzn\" (UID: \"ea6c4d57-09e8-4016-9038-69c4d0bd541d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn"
Jul 06 19:06:06.765019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.764396    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edacf919-3e12-4edd-a878-af1b182a8352-config\") pod \"service-ca-operator-5d46d9ffd4-tnsxt\" (UID: \"edacf919-3e12-4edd-a878-af1b182a8352\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt"
Jul 06 19:06:06.765019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.764399    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d99612d0-3b8a-45e3-963a-930e887c2d43-trusted-ca\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.765019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.764874    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d99612d0-3b8a-45e3-963a-930e887c2d43-ca-trust-extracted\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.765019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.764966    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-certificates\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.765019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.764980    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea6c4d57-09e8-4016-9038-69c4d0bd541d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-trvzn\" (UID: \"ea6c4d57-09e8-4016-9038-69c4d0bd541d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn"
Jul 06 19:06:06.766036 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.766010    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/edacf919-3e12-4edd-a878-af1b182a8352-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tnsxt\" (UID: \"edacf919-3e12-4edd-a878-af1b182a8352\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt"
Jul 06 19:06:06.766224 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.766206    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d99612d0-3b8a-45e3-963a-930e887c2d43-installation-pull-secrets\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.766763 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.766743    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d99612d0-3b8a-45e3-963a-930e887c2d43-image-registry-private-configuration\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.766946 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.766915    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6c4d57-09e8-4016-9038-69c4d0bd541d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-trvzn\" (UID: \"ea6c4d57-09e8-4016-9038-69c4d0bd541d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn"
Jul 06 19:06:06.767647 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.767636    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kvdh2"
Jul 06 19:06:06.771450 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.771426    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-bound-sa-token\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.771573 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.771556    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6djw9\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-kube-api-access-6djw9\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:06.772691 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.772650    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2znk\" (UniqueName: \"kubernetes.io/projected/ea6c4d57-09e8-4016-9038-69c4d0bd541d-kube-api-access-c2znk\") pod \"kube-storage-version-migrator-operator-846bf668f7-trvzn\" (UID: \"ea6c4d57-09e8-4016-9038-69c4d0bd541d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn"
Jul 06 19:06:06.772946 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.772926    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9q8m\" (UniqueName: \"kubernetes.io/projected/edacf919-3e12-4edd-a878-af1b182a8352-kube-api-access-p9q8m\") pod \"service-ca-operator-5d46d9ffd4-tnsxt\" (UID: \"edacf919-3e12-4edd-a878-af1b182a8352\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt"
Jul 06 19:06:06.792992 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.792974    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-62svf"
Jul 06 19:06:06.799920 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.799899    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jrn5b"]
Jul 06 19:06:06.803670 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:06.803648    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1034da_81bf_4b9b_a83d_cda34d16176b.slice/crio-780883f62aea25a4417437e0341cbf01255bb71b17d7b8e481cad85c664fd45e WatchSource:0}: Error finding container 780883f62aea25a4417437e0341cbf01255bb71b17d7b8e481cad85c664fd45e: Status 404 returned error can't find the container with id 780883f62aea25a4417437e0341cbf01255bb71b17d7b8e481cad85c664fd45e
Jul 06 19:06:06.820812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.820792    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn"
Jul 06 19:06:06.865578 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.865534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c110e8e-faa6-4880-8239-3119fd4d7815-config\") pod \"console-operator-68b757fb67-tbqgn\" (UID: \"4c110e8e-faa6-4880-8239-3119fd4d7815\") " pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:06.865741 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.865620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghnkm\" (UniqueName: \"kubernetes.io/projected/2864aa0f-fdac-4779-9033-734d22cad700-kube-api-access-ghnkm\") pod \"cluster-samples-operator-56fcf86bf-bn2rq\" (UID: \"2864aa0f-fdac-4779-9033-734d22cad700\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"
Jul 06 19:06:06.865741 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.865656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bn2rq\" (UID: \"2864aa0f-fdac-4779-9033-734d22cad700\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"
Jul 06 19:06:06.865741 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.865729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c110e8e-faa6-4880-8239-3119fd4d7815-trusted-ca\") pod \"console-operator-68b757fb67-tbqgn\" (UID: \"4c110e8e-faa6-4880-8239-3119fd4d7815\") " pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:06.865907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.865754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnnch\" (UniqueName: \"kubernetes.io/projected/4c110e8e-faa6-4880-8239-3119fd4d7815-kube-api-access-xnnch\") pod \"console-operator-68b757fb67-tbqgn\" (UID: \"4c110e8e-faa6-4880-8239-3119fd4d7815\") " pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:06.865907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.865816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c110e8e-faa6-4880-8239-3119fd4d7815-serving-cert\") pod \"console-operator-68b757fb67-tbqgn\" (UID: \"4c110e8e-faa6-4880-8239-3119fd4d7815\") " pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:06.866461 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:06.866121    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:06:06.866461 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:06.866198    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls podName:2864aa0f-fdac-4779-9033-734d22cad700 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:07.366175122 +0000 UTC m=+40.976302462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bn2rq" (UID: "2864aa0f-fdac-4779-9033-734d22cad700") : secret "samples-operator-tls" not found
Jul 06 19:06:06.866905 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.866853    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c110e8e-faa6-4880-8239-3119fd4d7815-config\") pod \"console-operator-68b757fb67-tbqgn\" (UID: \"4c110e8e-faa6-4880-8239-3119fd4d7815\") " pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:06.867017 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.866993    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c110e8e-faa6-4880-8239-3119fd4d7815-trusted-ca\") pod \"console-operator-68b757fb67-tbqgn\" (UID: \"4c110e8e-faa6-4880-8239-3119fd4d7815\") " pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:06.868652 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.868612    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c110e8e-faa6-4880-8239-3119fd4d7815-serving-cert\") pod \"console-operator-68b757fb67-tbqgn\" (UID: \"4c110e8e-faa6-4880-8239-3119fd4d7815\") " pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:06.875737 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.875314    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnnch\" (UniqueName: \"kubernetes.io/projected/4c110e8e-faa6-4880-8239-3119fd4d7815-kube-api-access-xnnch\") pod \"console-operator-68b757fb67-tbqgn\" (UID: \"4c110e8e-faa6-4880-8239-3119fd4d7815\") " pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:06.875737 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.875435    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghnkm\" (UniqueName: \"kubernetes.io/projected/2864aa0f-fdac-4779-9033-734d22cad700-kube-api-access-ghnkm\") pod \"cluster-samples-operator-56fcf86bf-bn2rq\" (UID: \"2864aa0f-fdac-4779-9033-734d22cad700\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"
Jul 06 19:06:06.879321 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.879302    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt"
Jul 06 19:06:06.936958 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.936529    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:06.936958 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.936607    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kvdh2"]
Jul 06 19:06:06.975352 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:06.974618    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-62svf"]
Jul 06 19:06:06.977482 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:06.976856    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dfad744_a2a4_48dc_8667_b506d429dc36.slice/crio-6a3623c97e2425192f7b080e460e5c83b458f17b7c90118be84d59e4faae46fc WatchSource:0}: Error finding container 6a3623c97e2425192f7b080e460e5c83b458f17b7c90118be84d59e4faae46fc: Status 404 returned error can't find the container with id 6a3623c97e2425192f7b080e460e5c83b458f17b7c90118be84d59e4faae46fc
Jul 06 19:06:07.005386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:07.004851    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn"]
Jul 06 19:06:07.008296 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:07.008251    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6c4d57_09e8_4016_9038_69c4d0bd541d.slice/crio-f457f574d393dd28a65d4ee93b43cbc4ec7d11fd4157ba34e51ecad5d068b19d WatchSource:0}: Error finding container f457f574d393dd28a65d4ee93b43cbc4ec7d11fd4157ba34e51ecad5d068b19d: Status 404 returned error can't find the container with id f457f574d393dd28a65d4ee93b43cbc4ec7d11fd4157ba34e51ecad5d068b19d
Jul 06 19:06:07.053896 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:07.053494    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt"]
Jul 06 19:06:07.055578 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:07.055552    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedacf919_3e12_4edd_a878_af1b182a8352.slice/crio-8a0930cc9c4e52346cc9d32b6ad5db0dd10dcd689d76210961d95af58d8d2c99 WatchSource:0}: Error finding container 8a0930cc9c4e52346cc9d32b6ad5db0dd10dcd689d76210961d95af58d8d2c99: Status 404 returned error can't find the container with id 8a0930cc9c4e52346cc9d32b6ad5db0dd10dcd689d76210961d95af58d8d2c99
Jul 06 19:06:07.057002 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:07.056973    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-62svf" event={"ID":"2dfad744-a2a4-48dc-8667-b506d429dc36","Type":"ContainerStarted","Data":"6a3623c97e2425192f7b080e460e5c83b458f17b7c90118be84d59e4faae46fc"}
Jul 06 19:06:07.058225 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:07.058200    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b" event={"ID":"db1034da-81bf-4b9b-a83d-cda34d16176b","Type":"ContainerStarted","Data":"780883f62aea25a4417437e0341cbf01255bb71b17d7b8e481cad85c664fd45e"}
Jul 06 19:06:07.059448 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:07.059428    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kvdh2" event={"ID":"554b6496-0ca4-4164-89e5-d7b412f3a87f","Type":"ContainerStarted","Data":"7ac1f4be92aacb6cfb9735f9ce8960e1d2281c46212aafa536fc22bfa797fc8b"}
Jul 06 19:06:07.060540 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:07.060496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn" event={"ID":"ea6c4d57-09e8-4016-9038-69c4d0bd541d","Type":"ContainerStarted","Data":"f457f574d393dd28a65d4ee93b43cbc4ec7d11fd4157ba34e51ecad5d068b19d"}
Jul 06 19:06:07.092411 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:07.092383    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tbqgn"]
Jul 06 19:06:07.095661 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:07.095613    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c110e8e_faa6_4880_8239_3119fd4d7815.slice/crio-a571329b7eb0f0d0212a58c2f5c1686a3450fe5b69001ed2c4bde9e04488a1ad WatchSource:0}: Error finding container a571329b7eb0f0d0212a58c2f5c1686a3450fe5b69001ed2c4bde9e04488a1ad: Status 404 returned error can't find the container with id a571329b7eb0f0d0212a58c2f5c1686a3450fe5b69001ed2c4bde9e04488a1ad
Jul 06 19:06:07.168442 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:07.168410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:07.168607 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:07.168519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:07.168607 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:07.168597    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:06:07.168794 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:07.168631    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle podName:47cefdd7-3087-4e22-b0cd-569e3862dd1b nodeName:}" failed. No retries permitted until 2026-07-06 19:06:08.16861353 +0000 UTC m=+41.778740872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle") pod "router-default-5cd66fb969-l6b4g" (UID: "47cefdd7-3087-4e22-b0cd-569e3862dd1b") : configmap references non-existent config key: service-ca.crt
Jul 06 19:06:07.168794 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:07.168660    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls podName:c25aa9b5-06e8-4aa0-8cea-d1179e62a508 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:08.168642163 +0000 UTC m=+41.778769493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-sshgz" (UID: "c25aa9b5-06e8-4aa0-8cea-d1179e62a508") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:06:07.168794 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:07.168745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:07.168954 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:07.168854    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:06:07.168954 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:07.168899    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs podName:47cefdd7-3087-4e22-b0cd-569e3862dd1b nodeName:}" failed. No retries permitted until 2026-07-06 19:06:08.168885639 +0000 UTC m=+41.779013006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs") pod "router-default-5cd66fb969-l6b4g" (UID: "47cefdd7-3087-4e22-b0cd-569e3862dd1b") : secret "router-metrics-certs-default" not found
Jul 06 19:06:07.269866 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:07.269825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:07.270005 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:07.269966    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:07.270005 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:07.269980    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f45f7699-mfntn: secret "image-registry-tls" not found
Jul 06 19:06:07.270072 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:07.270028    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls podName:d99612d0-3b8a-45e3-963a-930e887c2d43 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:08.270015702 +0000 UTC m=+41.880143028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls") pod "image-registry-59f45f7699-mfntn" (UID: "d99612d0-3b8a-45e3-963a-930e887c2d43") : secret "image-registry-tls" not found
Jul 06 19:06:07.371123 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:07.371037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bn2rq\" (UID: \"2864aa0f-fdac-4779-9033-734d22cad700\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"
Jul 06 19:06:07.371254 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:07.371172    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:06:07.371254 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:07.371229    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls podName:2864aa0f-fdac-4779-9033-734d22cad700 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:08.371214732 +0000 UTC m=+41.981342054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bn2rq" (UID: "2864aa0f-fdac-4779-9033-734d22cad700") : secret "samples-operator-tls" not found
Jul 06 19:06:08.066126 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:08.066007    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt" event={"ID":"edacf919-3e12-4edd-a878-af1b182a8352","Type":"ContainerStarted","Data":"8a0930cc9c4e52346cc9d32b6ad5db0dd10dcd689d76210961d95af58d8d2c99"}
Jul 06 19:06:08.068495 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:08.067859    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tbqgn" event={"ID":"4c110e8e-faa6-4880-8239-3119fd4d7815","Type":"ContainerStarted","Data":"a571329b7eb0f0d0212a58c2f5c1686a3450fe5b69001ed2c4bde9e04488a1ad"}
Jul 06 19:06:08.180607 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:08.179603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:08.180607 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:08.179658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:08.180607 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:08.179781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:08.180607 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:08.179947    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:06:08.180607 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:08.180008    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls podName:c25aa9b5-06e8-4aa0-8cea-d1179e62a508 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:10.179990524 +0000 UTC m=+43.790117861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-sshgz" (UID: "c25aa9b5-06e8-4aa0-8cea-d1179e62a508") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:06:08.180607 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:08.180414    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle podName:47cefdd7-3087-4e22-b0cd-569e3862dd1b nodeName:}" failed. No retries permitted until 2026-07-06 19:06:10.180398817 +0000 UTC m=+43.790526153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle") pod "router-default-5cd66fb969-l6b4g" (UID: "47cefdd7-3087-4e22-b0cd-569e3862dd1b") : configmap references non-existent config key: service-ca.crt
Jul 06 19:06:08.180607 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:08.180481    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:06:08.180607 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:08.180528    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs podName:47cefdd7-3087-4e22-b0cd-569e3862dd1b nodeName:}" failed. No retries permitted until 2026-07-06 19:06:10.180515363 +0000 UTC m=+43.790642689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs") pod "router-default-5cd66fb969-l6b4g" (UID: "47cefdd7-3087-4e22-b0cd-569e3862dd1b") : secret "router-metrics-certs-default" not found
Jul 06 19:06:08.280736 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:08.280556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:08.281544 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:08.281042    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:08.281544 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:08.281068    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f45f7699-mfntn: secret "image-registry-tls" not found
Jul 06 19:06:08.281544 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:08.281132    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls podName:d99612d0-3b8a-45e3-963a-930e887c2d43 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:10.281112306 +0000 UTC m=+43.891239643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls") pod "image-registry-59f45f7699-mfntn" (UID: "d99612d0-3b8a-45e3-963a-930e887c2d43") : secret "image-registry-tls" not found
Jul 06 19:06:08.322267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:08.322107    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:08.379247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:08.379204    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:08.383306 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:08.383237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bn2rq\" (UID: \"2864aa0f-fdac-4779-9033-734d22cad700\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"
Jul 06 19:06:08.383452 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:08.383403    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:06:08.383515 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:08.383473    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls podName:2864aa0f-fdac-4779-9033-734d22cad700 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:10.383453653 +0000 UTC m=+43.993580990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bn2rq" (UID: "2864aa0f-fdac-4779-9033-734d22cad700") : secret "samples-operator-tls" not found
Jul 06 19:06:09.594673 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:09.594635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:09.595028 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:09.594682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:09.595028 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:09.594815    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:09.595028 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:09.594833    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75b9c54f4d-xnlq5: secret "image-registry-tls" not found
Jul 06 19:06:09.595028 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:09.594875    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:09.595028 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:09.594896    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls podName:91599e02-80f3-41c5-a673-7d8f682d349f nodeName:}" failed. No retries permitted until 2026-07-06 19:06:17.594880668 +0000 UTC m=+51.205007992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls") pod "image-registry-75b9c54f4d-xnlq5" (UID: "91599e02-80f3-41c5-a673-7d8f682d349f") : secret "image-registry-tls" not found
Jul 06 19:06:09.595028 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:09.594926    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls podName:9c66f5ab-d626-436c-8dc1-53201c728381 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:17.594912805 +0000 UTC m=+51.205040127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls") pod "dns-default-k8kdm" (UID: "9c66f5ab-d626-436c-8dc1-53201c728381") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:09.837988 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:09.837948    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:09.998953 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:09.998914    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:10.106063 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:10.106029    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:10.184478 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:10.184359    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:10.200682 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:10.200640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:10.200859 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:10.200810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:10.200859 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:10.200813    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:06:10.200859 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:10.200845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:10.201019 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:10.200919    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls podName:c25aa9b5-06e8-4aa0-8cea-d1179e62a508 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:14.200898839 +0000 UTC m=+47.811026166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-sshgz" (UID: "c25aa9b5-06e8-4aa0-8cea-d1179e62a508") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:06:10.201019 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:10.200942    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle podName:47cefdd7-3087-4e22-b0cd-569e3862dd1b nodeName:}" failed. No retries permitted until 2026-07-06 19:06:14.200932041 +0000 UTC m=+47.811059366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle") pod "router-default-5cd66fb969-l6b4g" (UID: "47cefdd7-3087-4e22-b0cd-569e3862dd1b") : configmap references non-existent config key: service-ca.crt
Jul 06 19:06:10.201019 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:10.200972    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:06:10.201167 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:10.201034    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs podName:47cefdd7-3087-4e22-b0cd-569e3862dd1b nodeName:}" failed. No retries permitted until 2026-07-06 19:06:14.201016028 +0000 UTC m=+47.811143365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs") pod "router-default-5cd66fb969-l6b4g" (UID: "47cefdd7-3087-4e22-b0cd-569e3862dd1b") : secret "router-metrics-certs-default" not found
Jul 06 19:06:10.302140 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:10.302055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:10.302274 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:10.302208    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:10.302274 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:10.302227    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f45f7699-mfntn: secret "image-registry-tls" not found
Jul 06 19:06:10.302348 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:10.302285    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls podName:d99612d0-3b8a-45e3-963a-930e887c2d43 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:14.302268923 +0000 UTC m=+47.912396245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls") pod "image-registry-59f45f7699-mfntn" (UID: "d99612d0-3b8a-45e3-963a-930e887c2d43") : secret "image-registry-tls" not found
Jul 06 19:06:10.403415 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:10.403380    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bn2rq\" (UID: \"2864aa0f-fdac-4779-9033-734d22cad700\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"
Jul 06 19:06:10.403560 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:10.403543    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:06:10.403622 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:10.403612    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls podName:2864aa0f-fdac-4779-9033-734d22cad700 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:14.403595515 +0000 UTC m=+48.013722837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bn2rq" (UID: "2864aa0f-fdac-4779-9033-734d22cad700") : secret "samples-operator-tls" not found
Jul 06 19:06:10.810990 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:10.810951    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:10.913768 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:10.913734    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:11.203758 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:11.203728    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:11.304801 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:11.304739    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:13.090927 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:13.090894    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:13.170817 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:13.170785    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:13.271059 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:13.271029    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:13.370873 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:13.370837    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:13.470977 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:13.470924    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:13.605117 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:13.605038    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:13.705136 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:13.705100    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:14.086028 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.085982    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn" event={"ID":"ea6c4d57-09e8-4016-9038-69c4d0bd541d","Type":"ContainerStarted","Data":"a261ae795cc611f95dbca824b9187c257cf27d8db9c9d2e4b2e7fd64611a684d"}
Jul 06 19:06:14.088210 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.088188    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/0.log"
Jul 06 19:06:14.088347 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.088229    2580 generic.go:356] "Generic (PLEG): container finished" podID="4c110e8e-faa6-4880-8239-3119fd4d7815" containerID="77564c9fd39b7f8179e70c490fa5a70a79bab634aec460d1b435f16859545c10" exitCode=255
Jul 06 19:06:14.088499 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.088476    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tbqgn" event={"ID":"4c110e8e-faa6-4880-8239-3119fd4d7815","Type":"ContainerDied","Data":"77564c9fd39b7f8179e70c490fa5a70a79bab634aec460d1b435f16859545c10"}
Jul 06 19:06:14.088697 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.088566    2580 scope.go:117] "RemoveContainer" containerID="77564c9fd39b7f8179e70c490fa5a70a79bab634aec460d1b435f16859545c10"
Jul 06 19:06:14.090605 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.090581    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-62svf" event={"ID":"2dfad744-a2a4-48dc-8667-b506d429dc36","Type":"ContainerStarted","Data":"1b0ad24bcbd08e044512e67315a115ede74d44f6e5ffef2548628df692513961"}
Jul 06 19:06:14.092279 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.092255    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b" event={"ID":"db1034da-81bf-4b9b-a83d-cda34d16176b","Type":"ContainerStarted","Data":"62ebc98e1c5d0beda32a4de58df5df82afd8ebc0ee2c172c31166f0a3007fcf4"}
Jul 06 19:06:14.094249 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.094228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kvdh2" event={"ID":"554b6496-0ca4-4164-89e5-d7b412f3a87f","Type":"ContainerStarted","Data":"f6890f4bc0e2fd6b10a50fce0eefe69e7c7e2c1e3f14e87749e6467eb550150a"}
Jul 06 19:06:14.095657 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.095639    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt" event={"ID":"edacf919-3e12-4edd-a878-af1b182a8352","Type":"ContainerStarted","Data":"a12cfc2b939bfefa5be532cdfe3752f55a56ed97ce98c34826cbfb1a3ef51c11"}
Jul 06 19:06:14.102634 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.102588    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn" podStartSLOduration=1.966457135 podStartE2EDuration="8.102572315s" totalImagesPullingTime="6.13611518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:14.101477443 +0000 UTC m=+47.711604790" watchObservedRunningTime="2026-07-06 19:06:14.102572315 +0000 UTC m=+47.712699660"
Jul 06 19:06:14.117954 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.115865    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-62svf" podStartSLOduration=1.5764207909999999 podStartE2EDuration="8.115847056s" totalImagesPullingTime="6.539426265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:14.115648482 +0000 UTC m=+47.725775827" watchObservedRunningTime="2026-07-06 19:06:14.115847056 +0000 UTC m=+47.725974401"
Jul 06 19:06:14.135491 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.135426    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt" podStartSLOduration=2.052225626 podStartE2EDuration="8.135405065s" totalImagesPullingTime="6.083179439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:14.134258862 +0000 UTC m=+47.744386232" watchObservedRunningTime="2026-07-06 19:06:14.135405065 +0000 UTC m=+47.745532410"
Jul 06 19:06:14.154936 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.154418    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b" podStartSLOduration=1.820455578 podStartE2EDuration="8.154395269s" totalImagesPullingTime="6.333939691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:14.152048529 +0000 UTC m=+47.762175874" watchObservedRunningTime="2026-07-06 19:06:14.154395269 +0000 UTC m=+47.764522616"
Jul 06 19:06:14.239911 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.239878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:14.240120 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.240099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:14.240201 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.240140    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:14.240920 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:14.240886    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:06:14.241057 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:14.240951    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls podName:c25aa9b5-06e8-4aa0-8cea-d1179e62a508 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:22.24093227 +0000 UTC m=+55.851059611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-sshgz" (UID: "c25aa9b5-06e8-4aa0-8cea-d1179e62a508") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:06:14.241197 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:14.241172    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:06:14.241374 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:14.241354    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle podName:47cefdd7-3087-4e22-b0cd-569e3862dd1b nodeName:}" failed. No retries permitted until 2026-07-06 19:06:22.241336295 +0000 UTC m=+55.851463632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle") pod "router-default-5cd66fb969-l6b4g" (UID: "47cefdd7-3087-4e22-b0cd-569e3862dd1b") : configmap references non-existent config key: service-ca.crt
Jul 06 19:06:14.241462 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:14.241385    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs podName:47cefdd7-3087-4e22-b0cd-569e3862dd1b nodeName:}" failed. No retries permitted until 2026-07-06 19:06:22.241374226 +0000 UTC m=+55.851501552 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs") pod "router-default-5cd66fb969-l6b4g" (UID: "47cefdd7-3087-4e22-b0cd-569e3862dd1b") : secret "router-metrics-certs-default" not found
Jul 06 19:06:14.341533 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.341443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:14.341687 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:14.341608    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:14.341687 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:14.341625    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f45f7699-mfntn: secret "image-registry-tls" not found
Jul 06 19:06:14.341687 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:14.341680    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls podName:d99612d0-3b8a-45e3-963a-930e887c2d43 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:22.341662639 +0000 UTC m=+55.951789967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls") pod "image-registry-59f45f7699-mfntn" (UID: "d99612d0-3b8a-45e3-963a-930e887c2d43") : secret "image-registry-tls" not found
Jul 06 19:06:14.346952 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.346919    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:14.442376 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.442334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bn2rq\" (UID: \"2864aa0f-fdac-4779-9033-734d22cad700\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"
Jul 06 19:06:14.442568 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:14.442530    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:06:14.442701 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:14.442624    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls podName:2864aa0f-fdac-4779-9033-734d22cad700 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:22.442602984 +0000 UTC m=+56.052730310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bn2rq" (UID: "2864aa0f-fdac-4779-9033-734d22cad700") : secret "samples-operator-tls" not found
Jul 06 19:06:14.446724 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:14.446673    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:15.100360 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.100330    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:06:15.100834 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.100773    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/0.log"
Jul 06 19:06:15.100834 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.100804    2580 generic.go:356] "Generic (PLEG): container finished" podID="4c110e8e-faa6-4880-8239-3119fd4d7815" containerID="b85a0fd773eb253bbf58fd55572552e62641e645c2bffb752e4d1b6551c34942" exitCode=255
Jul 06 19:06:15.100947 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.100833    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tbqgn" event={"ID":"4c110e8e-faa6-4880-8239-3119fd4d7815","Type":"ContainerDied","Data":"b85a0fd773eb253bbf58fd55572552e62641e645c2bffb752e4d1b6551c34942"}
Jul 06 19:06:15.100947 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.100891    2580 scope.go:117] "RemoveContainer" containerID="77564c9fd39b7f8179e70c490fa5a70a79bab634aec460d1b435f16859545c10"
Jul 06 19:06:15.101212 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.101189    2580 scope.go:117] "RemoveContainer" containerID="b85a0fd773eb253bbf58fd55572552e62641e645c2bffb752e4d1b6551c34942"
Jul 06 19:06:15.101750 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:15.101392    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tbqgn_openshift-console-operator(4c110e8e-faa6-4880-8239-3119fd4d7815)\"" pod="openshift-console-operator/console-operator-68b757fb67-tbqgn" podUID="4c110e8e-faa6-4880-8239-3119fd4d7815"
Jul 06 19:06:15.123370 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.122986    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-kvdh2" podStartSLOduration=2.992595954 podStartE2EDuration="9.122964458s" totalImagesPullingTime="6.130368504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:14.186546978 +0000 UTC m=+47.796674323" watchObservedRunningTime="2026-07-06 19:06:15.122964458 +0000 UTC m=+48.733091803"
Jul 06 19:06:15.124314 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.124218    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:15.189222 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.189195    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-5j58b"]
Jul 06 19:06:15.218479 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.218442    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-5j58b"]
Jul 06 19:06:15.218701 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.218600    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5j58b"
Jul 06 19:06:15.221349 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.221326    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 06 19:06:15.222131 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.222106    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 06 19:06:15.222261 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.222135    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bkrtm\""
Jul 06 19:06:15.249431 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.249396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtgcj\" (UniqueName: \"kubernetes.io/projected/3f38ba48-302b-4a50-b534-37c21e48c0f8-kube-api-access-qtgcj\") pod \"migrator-d57d58cc9-5j58b\" (UID: \"3f38ba48-302b-4a50-b534-37c21e48c0f8\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5j58b"
Jul 06 19:06:15.269249 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.269212    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:15.272866 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.272837    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z874w"]
Jul 06 19:06:15.291133 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.291105    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z874w"]
Jul 06 19:06:15.291298 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.291202    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.294000 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.293949    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:06:15.294170 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.294151    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:06:15.294311 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.294281    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-29q45\""
Jul 06 19:06:15.349732 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.349673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18c396c0-b0b0-41c2-bffc-7941a2358658-crio-socket\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.349902 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.349739    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2pjt\" (UniqueName: \"kubernetes.io/projected/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-api-access-t2pjt\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.349902 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.349868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtgcj\" (UniqueName: \"kubernetes.io/projected/3f38ba48-302b-4a50-b534-37c21e48c0f8-kube-api-access-qtgcj\") pod \"migrator-d57d58cc9-5j58b\" (UID: \"3f38ba48-302b-4a50-b534-37c21e48c0f8\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5j58b"
Jul 06 19:06:15.349983 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.349911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.350023 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.349989    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.350023 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.350016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18c396c0-b0b0-41c2-bffc-7941a2358658-data-volume\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.358959 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.358883    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtgcj\" (UniqueName: \"kubernetes.io/projected/3f38ba48-302b-4a50-b534-37c21e48c0f8-kube-api-access-qtgcj\") pod \"migrator-d57d58cc9-5j58b\" (UID: \"3f38ba48-302b-4a50-b534-37c21e48c0f8\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5j58b"
Jul 06 19:06:15.361025 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.360997    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:15.450483 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.450445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.450655 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.450530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.450655 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.450552    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18c396c0-b0b0-41c2-bffc-7941a2358658-data-volume\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.450655 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:15.450588    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:06:15.450817 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:15.450658    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls podName:18c396c0-b0b0-41c2-bffc-7941a2358658 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:15.950637774 +0000 UTC m=+49.560765097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z874w" (UID: "18c396c0-b0b0-41c2-bffc-7941a2358658") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:06:15.450817 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.450590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18c396c0-b0b0-41c2-bffc-7941a2358658-crio-socket\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.450817 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.450701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2pjt\" (UniqueName: \"kubernetes.io/projected/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-api-access-t2pjt\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.450817 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:15.450747    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:06:15.450817 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:15.450801    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-rbac-proxy-cm podName:18c396c0-b0b0-41c2-bffc-7941a2358658 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:15.950787286 +0000 UTC m=+49.560914637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z874w" (UID: "18c396c0-b0b0-41c2-bffc-7941a2358658") : configmap "kube-rbac-proxy" not found
Jul 06 19:06:15.450999 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.450890    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18c396c0-b0b0-41c2-bffc-7941a2358658-crio-socket\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.450999 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.450979    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18c396c0-b0b0-41c2-bffc-7941a2358658-data-volume\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.462529 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.462497    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2pjt\" (UniqueName: \"kubernetes.io/projected/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-api-access-t2pjt\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.530492 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.530453    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5j58b"
Jul 06 19:06:15.669456 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.669426    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-5j58b"]
Jul 06 19:06:15.672692 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:15.672662    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f38ba48_302b_4a50_b534_37c21e48c0f8.slice/crio-f89c18afa22070ff4b93ef5be9f25d5e96e6c0cf59f45be4b70ceeb331865097 WatchSource:0}: Error finding container f89c18afa22070ff4b93ef5be9f25d5e96e6c0cf59f45be4b70ceeb331865097: Status 404 returned error can't find the container with id f89c18afa22070ff4b93ef5be9f25d5e96e6c0cf59f45be4b70ceeb331865097
Jul 06 19:06:15.796452 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.796415    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:15.895485 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.895393    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:15.953881 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.953849    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.954046 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:15.953915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:15.954046 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:15.953992    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:06:15.954046 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:15.954020    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:06:15.954192 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:15.954053    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls podName:18c396c0-b0b0-41c2-bffc-7941a2358658 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:16.954038692 +0000 UTC m=+50.564166016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z874w" (UID: "18c396c0-b0b0-41c2-bffc-7941a2358658") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:06:15.954192 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:15.954069    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-rbac-proxy-cm podName:18c396c0-b0b0-41c2-bffc-7941a2358658 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:16.954061949 +0000 UTC m=+50.564189271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z874w" (UID: "18c396c0-b0b0-41c2-bffc-7941a2358658") : configmap "kube-rbac-proxy" not found
Jul 06 19:06:16.105488 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:16.105459    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5j58b" event={"ID":"3f38ba48-302b-4a50-b534-37c21e48c0f8","Type":"ContainerStarted","Data":"f89c18afa22070ff4b93ef5be9f25d5e96e6c0cf59f45be4b70ceeb331865097"}
Jul 06 19:06:16.107036 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:16.107016    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:06:16.107346 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:16.107332    2580 scope.go:117] "RemoveContainer" containerID="b85a0fd773eb253bbf58fd55572552e62641e645c2bffb752e4d1b6551c34942"
Jul 06 19:06:16.107498 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:16.107481    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tbqgn_openshift-console-operator(4c110e8e-faa6-4880-8239-3119fd4d7815)\"" pod="openshift-console-operator/console-operator-68b757fb67-tbqgn" podUID="4c110e8e-faa6-4880-8239-3119fd4d7815"
Jul 06 19:06:16.936866 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:16.936833    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:16.937062 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:16.936889    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:16.961506 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:16.961473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:16.961682 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:16.961563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:16.961682 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:16.961633    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:06:16.961682 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:16.961661    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:06:16.961875 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:16.961799    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls podName:18c396c0-b0b0-41c2-bffc-7941a2358658 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:18.961775641 +0000 UTC m=+52.571902988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z874w" (UID: "18c396c0-b0b0-41c2-bffc-7941a2358658") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:06:16.961875 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:16.961830    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-rbac-proxy-cm podName:18c396c0-b0b0-41c2-bffc-7941a2358658 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:18.961815814 +0000 UTC m=+52.571943155 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z874w" (UID: "18c396c0-b0b0-41c2-bffc-7941a2358658") : configmap "kube-rbac-proxy" not found
Jul 06 19:06:17.110031 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.110002    2580 scope.go:117] "RemoveContainer" containerID="b85a0fd773eb253bbf58fd55572552e62641e645c2bffb752e4d1b6551c34942"
Jul 06 19:06:17.110388 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:17.110158    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tbqgn_openshift-console-operator(4c110e8e-faa6-4880-8239-3119fd4d7815)\"" pod="openshift-console-operator/console-operator-68b757fb67-tbqgn" podUID="4c110e8e-faa6-4880-8239-3119fd4d7815"
Jul 06 19:06:17.359683 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.359598    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:17.403567 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.403534    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-75jv8"]
Jul 06 19:06:17.422272 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.422231    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-75jv8"]
Jul 06 19:06:17.422444 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.422327    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-75jv8"
Jul 06 19:06:17.424577 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.424549    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 19:06:17.424811 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.424671    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 19:06:17.424811 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.424680    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 19:06:17.425392 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.425374    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-n88dx\""
Jul 06 19:06:17.425599 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.425586    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 19:06:17.439587 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.439560    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:17.465519 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.465487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnt24\" (UniqueName: \"kubernetes.io/projected/3bea81d5-5085-43b1-bbf9-24144df46c4c-kube-api-access-jnt24\") pod \"service-ca-758f599c5-75jv8\" (UID: \"3bea81d5-5085-43b1-bbf9-24144df46c4c\") " pod="openshift-service-ca/service-ca-758f599c5-75jv8"
Jul 06 19:06:17.465646 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.465548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3bea81d5-5085-43b1-bbf9-24144df46c4c-signing-cabundle\") pod \"service-ca-758f599c5-75jv8\" (UID: \"3bea81d5-5085-43b1-bbf9-24144df46c4c\") " pod="openshift-service-ca/service-ca-758f599c5-75jv8"
Jul 06 19:06:17.465693 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.465671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3bea81d5-5085-43b1-bbf9-24144df46c4c-signing-key\") pod \"service-ca-758f599c5-75jv8\" (UID: \"3bea81d5-5085-43b1-bbf9-24144df46c4c\") " pod="openshift-service-ca/service-ca-758f599c5-75jv8"
Jul 06 19:06:17.483247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.483220    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j8549_f57113cb-3b9f-4d8e-b70e-8d04ba9bf414/dns-node-resolver/0.log"
Jul 06 19:06:17.566173 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.566144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3bea81d5-5085-43b1-bbf9-24144df46c4c-signing-key\") pod \"service-ca-758f599c5-75jv8\" (UID: \"3bea81d5-5085-43b1-bbf9-24144df46c4c\") " pod="openshift-service-ca/service-ca-758f599c5-75jv8"
Jul 06 19:06:17.566271 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.566232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnt24\" (UniqueName: \"kubernetes.io/projected/3bea81d5-5085-43b1-bbf9-24144df46c4c-kube-api-access-jnt24\") pod \"service-ca-758f599c5-75jv8\" (UID: \"3bea81d5-5085-43b1-bbf9-24144df46c4c\") " pod="openshift-service-ca/service-ca-758f599c5-75jv8"
Jul 06 19:06:17.566347 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.566286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3bea81d5-5085-43b1-bbf9-24144df46c4c-signing-cabundle\") pod \"service-ca-758f599c5-75jv8\" (UID: \"3bea81d5-5085-43b1-bbf9-24144df46c4c\") " pod="openshift-service-ca/service-ca-758f599c5-75jv8"
Jul 06 19:06:17.567032 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.567000    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3bea81d5-5085-43b1-bbf9-24144df46c4c-signing-cabundle\") pod \"service-ca-758f599c5-75jv8\" (UID: \"3bea81d5-5085-43b1-bbf9-24144df46c4c\") " pod="openshift-service-ca/service-ca-758f599c5-75jv8"
Jul 06 19:06:17.568868 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.568854    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3bea81d5-5085-43b1-bbf9-24144df46c4c-signing-key\") pod \"service-ca-758f599c5-75jv8\" (UID: \"3bea81d5-5085-43b1-bbf9-24144df46c4c\") " pod="openshift-service-ca/service-ca-758f599c5-75jv8"
Jul 06 19:06:17.574022 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.573991    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnt24\" (UniqueName: \"kubernetes.io/projected/3bea81d5-5085-43b1-bbf9-24144df46c4c-kube-api-access-jnt24\") pod \"service-ca-758f599c5-75jv8\" (UID: \"3bea81d5-5085-43b1-bbf9-24144df46c4c\") " pod="openshift-service-ca/service-ca-758f599c5-75jv8"
Jul 06 19:06:17.666977 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.666953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:17.667072 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.666994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:17.667118 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:17.667096    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:06:17.667173 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:17.667161    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls podName:9c66f5ab-d626-436c-8dc1-53201c728381 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:33.667144281 +0000 UTC m=+67.277271607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls") pod "dns-default-k8kdm" (UID: "9c66f5ab-d626-436c-8dc1-53201c728381") : secret "dns-default-metrics-tls" not found
Jul 06 19:06:17.667225 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:17.667206    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:17.667269 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:17.667227    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75b9c54f4d-xnlq5: secret "image-registry-tls" not found
Jul 06 19:06:17.667299 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:17.667285    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls podName:91599e02-80f3-41c5-a673-7d8f682d349f nodeName:}" failed. No retries permitted until 2026-07-06 19:06:33.667272655 +0000 UTC m=+67.277399981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls") pod "image-registry-75b9c54f4d-xnlq5" (UID: "91599e02-80f3-41c5-a673-7d8f682d349f") : secret "image-registry-tls" not found
Jul 06 19:06:17.674948 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.674916    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:17.731908 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.731869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-75jv8"
Jul 06 19:06:17.777577 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.777544    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:17.870054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:17.869978    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-75jv8"]
Jul 06 19:06:17.873451 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:17.873429    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bea81d5_5085_43b1_bbf9_24144df46c4c.slice/crio-cfc28e91427a94b8026d3d1f37e33f47c6ccf7471c6419c7304b08045435f25a WatchSource:0}: Error finding container cfc28e91427a94b8026d3d1f37e33f47c6ccf7471c6419c7304b08045435f25a: Status 404 returned error can't find the container with id cfc28e91427a94b8026d3d1f37e33f47c6ccf7471c6419c7304b08045435f25a
Jul 06 19:06:18.115460 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:18.115424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5j58b" event={"ID":"3f38ba48-302b-4a50-b534-37c21e48c0f8","Type":"ContainerStarted","Data":"ac5e9ec1c980bb05c79fd1641f5cddb31f3b978778c5305c852c333d62090d8f"}
Jul 06 19:06:18.115955 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:18.115481    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5j58b" event={"ID":"3f38ba48-302b-4a50-b534-37c21e48c0f8","Type":"ContainerStarted","Data":"4e0f7e086dee4aab95d7b629ba84fa87b4cc20081c4e595ce2cb7025ec5f4915"}
Jul 06 19:06:18.116971 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:18.116945    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-75jv8" event={"ID":"3bea81d5-5085-43b1-bbf9-24144df46c4c","Type":"ContainerStarted","Data":"e844d7ed83ac221c99a784c1f0880921c8aa52d29508a62b1803216cea51a03d"}
Jul 06 19:06:18.117102 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:18.116984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-75jv8" event={"ID":"3bea81d5-5085-43b1-bbf9-24144df46c4c","Type":"ContainerStarted","Data":"cfc28e91427a94b8026d3d1f37e33f47c6ccf7471c6419c7304b08045435f25a"}
Jul 06 19:06:18.132160 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:18.132057    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-5j58b" podStartSLOduration=1.292334902 podStartE2EDuration="3.132040426s" totalImagesPullingTime="1.839705524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:18.131912836 +0000 UTC m=+51.742040181" watchObservedRunningTime="2026-07-06 19:06:18.132040426 +0000 UTC m=+51.742167773"
Jul 06 19:06:18.150183 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:18.150135    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-75jv8" podStartSLOduration=1.1501209239999999 podStartE2EDuration="1.150120924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:18.148938112 +0000 UTC m=+51.759065469" watchObservedRunningTime="2026-07-06 19:06:18.150120924 +0000 UTC m=+51.760248282"
Jul 06 19:06:18.218742 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:18.218684    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:18.282870 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:18.282843    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s5rb8_1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5/node-ca/0.log"
Jul 06 19:06:18.883852 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:18.883818    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gm5ph_2806f7af-59f9-4717-b25a-4bb8d81eccf5/serve-healthcheck-canary/0.log"
Jul 06 19:06:18.977119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:18.977081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:18.977312 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:18.977185    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:18.977312 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:18.977237    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:06:18.977312 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:18.977309    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls podName:18c396c0-b0b0-41c2-bffc-7941a2358658 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:22.977291131 +0000 UTC m=+56.587418453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z874w" (UID: "18c396c0-b0b0-41c2-bffc-7941a2358658") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:06:18.977851 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:18.977828    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18c396c0-b0b0-41c2-bffc-7941a2358658-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:19.083897 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:19.083863    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-5j58b_3f38ba48-302b-4a50-b534-37c21e48c0f8/migrator/0.log"
Jul 06 19:06:19.094844 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:19.094812    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:19.204769 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:19.204734    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:19.284277 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:19.284250    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-5j58b_3f38ba48-302b-4a50-b534-37c21e48c0f8/graceful-termination/0.log"
Jul 06 19:06:19.485333 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:19.485228    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-trvzn_ea6c4d57-09e8-4016-9038-69c4d0bd541d/kube-storage-version-migrator-operator/0.log"
Jul 06 19:06:19.501514 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:19.501482    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:19.602424 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:19.602367    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:19.702411 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:19.702378    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:19.991087 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:19.991046    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:20.192122 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:20.192086    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:20.921561 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:20.921519    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:21.023106 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:21.023071    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:21.584593 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:21.584560    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:21.786846 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:21.786812    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:21.979943 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:21.979913    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:22.181104 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:22.181069    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:22.308773 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:22.308674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:22.308773 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:22.308744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:22.308965 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:22.308844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:22.308965 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:22.308900    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:06:22.308965 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:22.308909    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle podName:47cefdd7-3087-4e22-b0cd-569e3862dd1b nodeName:}" failed. No retries permitted until 2026-07-06 19:06:38.308889933 +0000 UTC m=+71.919017270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle") pod "router-default-5cd66fb969-l6b4g" (UID: "47cefdd7-3087-4e22-b0cd-569e3862dd1b") : configmap references non-existent config key: service-ca.crt
Jul 06 19:06:22.309103 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:22.308968    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:06:22.309103 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:22.308977    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs podName:47cefdd7-3087-4e22-b0cd-569e3862dd1b nodeName:}" failed. No retries permitted until 2026-07-06 19:06:38.308959269 +0000 UTC m=+71.919086596 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs") pod "router-default-5cd66fb969-l6b4g" (UID: "47cefdd7-3087-4e22-b0cd-569e3862dd1b") : secret "router-metrics-certs-default" not found
Jul 06 19:06:22.309103 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:22.309024    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls podName:c25aa9b5-06e8-4aa0-8cea-d1179e62a508 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:38.309014754 +0000 UTC m=+71.919142079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-sshgz" (UID: "c25aa9b5-06e8-4aa0-8cea-d1179e62a508") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:06:22.410238 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:22.410198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:22.410416 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:22.410355    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:06:22.410416 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:22.410373    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f45f7699-mfntn: secret "image-registry-tls" not found
Jul 06 19:06:22.410494 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:22.410430    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls podName:d99612d0-3b8a-45e3-963a-930e887c2d43 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:38.410413867 +0000 UTC m=+72.020541195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls") pod "image-registry-59f45f7699-mfntn" (UID: "d99612d0-3b8a-45e3-963a-930e887c2d43") : secret "image-registry-tls" not found
Jul 06 19:06:22.510936 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:22.510893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bn2rq\" (UID: \"2864aa0f-fdac-4779-9033-734d22cad700\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"
Jul 06 19:06:22.513461 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:22.513427    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2864aa0f-fdac-4779-9033-734d22cad700-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bn2rq\" (UID: \"2864aa0f-fdac-4779-9033-734d22cad700\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"
Jul 06 19:06:22.778213 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:22.778168    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:22.810494 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:22.810456    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"
Jul 06 19:06:22.932152 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:22.932122    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq"]
Jul 06 19:06:23.008387 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:23.008333    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:23.014472 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:23.014452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:23.014578 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:23.014566    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:06:23.014635 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:06:23.014627    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls podName:18c396c0-b0b0-41c2-bffc-7941a2358658 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:31.014604787 +0000 UTC m=+64.624732110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z874w" (UID: "18c396c0-b0b0-41c2-bffc-7941a2358658") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:06:23.140429 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:23.140315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq" event={"ID":"2864aa0f-fdac-4779-9033-734d22cad700","Type":"ContainerStarted","Data":"4ae97626bf25f45004e7d699843216786a7db803f74d98e3ba50728294b8e089"}
Jul 06 19:06:23.390598 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:23.390178    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:23.587971 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:23.587927    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:23.779804 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:23.779767    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:23.835300 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:23.835263    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:23.988575 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:23.988542    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:24.186536 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:24.186501    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:24.263940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:24.263908    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:25.149290 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:25.149255    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq" event={"ID":"2864aa0f-fdac-4779-9033-734d22cad700","Type":"ContainerStarted","Data":"2f98bc0ed87597c1fd863fe04335e39fad9bc47c447a4925436122537917ea41"}
Jul 06 19:06:25.149458 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:25.149302    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq" event={"ID":"2864aa0f-fdac-4779-9033-734d22cad700","Type":"ContainerStarted","Data":"291aa7f0fcd7a7ae29c001fc2755dca2085739f9f2aa7b76649ff377645ce0a4"}
Jul 06 19:06:25.169098 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:25.169039    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bn2rq" podStartSLOduration=17.151110615 podStartE2EDuration="19.169022718s" totalImagesPullingTime="2.017912103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:25.167366338 +0000 UTC m=+58.777493679" watchObservedRunningTime="2026-07-06 19:06:25.169022718 +0000 UTC m=+58.779150065"
Jul 06 19:06:25.189428 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:25.189392    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:25.367652 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:25.367554    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:25.466937 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:25.466893    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:25.785408 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:25.785364    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:25.983410 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:25.983363    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:26.582302 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:26.582252    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:26.806633 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:26.806596    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:27.385435 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:27.385396    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:27.580056 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:27.580022    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:27.978427 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:27.978386    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:28.590455 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:28.590425    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:28.995605 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:28.995567    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:29.032558 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:29.032522    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t87sk"
Jul 06 19:06:29.212180 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:29.212142    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:29.585505 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:29.585471    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:29.784002 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:29.783967    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:30.845539 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:30.845497    2580 scope.go:117] "RemoveContainer" containerID="b85a0fd773eb253bbf58fd55572552e62641e645c2bffb752e4d1b6551c34942"
Jul 06 19:06:31.088217 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:31.088179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:31.090606 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:31.090579    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18c396c0-b0b0-41c2-bffc-7941a2358658-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z874w\" (UID: \"18c396c0-b0b0-41c2-bffc-7941a2358658\") " pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:31.172502 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:31.172473    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:06:31.172688 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:31.172565    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tbqgn" event={"ID":"4c110e8e-faa6-4880-8239-3119fd4d7815","Type":"ContainerStarted","Data":"e4b7a5e074d8d043afafeaa013721fb101e04a94be410b4ef43deb553c542eed"}
Jul 06 19:06:31.172865 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:31.172845    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:31.189290 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:31.189229    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-tbqgn" podStartSLOduration=19.145999975 podStartE2EDuration="25.189207902s" totalImagesPullingTime="6.043207927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:31.188846814 +0000 UTC m=+64.798974160" watchObservedRunningTime="2026-07-06 19:06:31.189207902 +0000 UTC m=+64.799335244"
Jul 06 19:06:31.205373 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:31.205341    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-29q45\""
Jul 06 19:06:31.213537 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:31.213501    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z874w"
Jul 06 19:06:31.340924 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:31.340891    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z874w"]
Jul 06 19:06:31.343860 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:31.343833    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c396c0_b0b0_41c2_bffc_7941a2358658.slice/crio-ab22926b8daa6a54408b0c400314ee93b71941dbd8112eceb46d1fe394a58363 WatchSource:0}: Error finding container ab22926b8daa6a54408b0c400314ee93b71941dbd8112eceb46d1fe394a58363: Status 404 returned error can't find the container with id ab22926b8daa6a54408b0c400314ee93b71941dbd8112eceb46d1fe394a58363
Jul 06 19:06:31.565434 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:31.565274    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-tbqgn"
Jul 06 19:06:31.751540 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:31.751506    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:31.854134 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:31.853866    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:31.954273 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:31.954230    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:32.055779 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:32.055738    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log" limit=1024
Jul 06 19:06:32.179818 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:32.179779    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z874w" event={"ID":"18c396c0-b0b0-41c2-bffc-7941a2358658","Type":"ContainerStarted","Data":"ab22926b8daa6a54408b0c400314ee93b71941dbd8112eceb46d1fe394a58363"}
Jul 06 19:06:32.705452 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:32.705420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs\") pod \"network-metrics-daemon-pth4c\" (UID: \"b09aa790-cc9a-4341-bedc-7c18351e27d5\") " pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:06:32.705624 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:32.705523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:06:32.708212 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:32.708179    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:06:32.708891 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:32.708871    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:06:32.718304 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:32.718247    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3a18cca-96fa-4abb-b1e8-d061a4a0599c-original-pull-secret\") pod \"global-pull-secret-syncer-6zm9c\" (UID: \"c3a18cca-96fa-4abb-b1e8-d061a4a0599c\") " pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:06:32.718411 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:32.718390    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b09aa790-cc9a-4341-bedc-7c18351e27d5-metrics-certs\") pod \"network-metrics-daemon-pth4c\" (UID: \"b09aa790-cc9a-4341-bedc-7c18351e27d5\") " pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:06:32.764574 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:32.764543    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-85brg\""
Jul 06 19:06:32.773396 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:32.773355    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pth4c"
Jul 06 19:06:32.806868 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:32.806834    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnwl\" (UniqueName: \"kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl\") pod \"network-check-target-6p7zh\" (UID: \"5fc9e75a-05d0-4604-8402-6aa5c4969689\") " pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:06:32.809560 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:32.809536    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxnwl\" (UniqueName: \"kubernetes.io/projected/5fc9e75a-05d0-4604-8402-6aa5c4969689-kube-api-access-zxnwl\") pod \"network-check-target-6p7zh\" (UID: \"5fc9e75a-05d0-4604-8402-6aa5c4969689\") " pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:06:32.856280 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:32.856250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zm9c"
Jul 06 19:06:32.913143 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:32.913099    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pth4c"]
Jul 06 19:06:33.059307 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:33.059224    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xsmh6\""
Jul 06 19:06:33.067240 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:33.067206    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:06:33.713407 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:33.713366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:33.713600 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:33.713429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:33.715863 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:33.715837    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c66f5ab-d626-436c-8dc1-53201c728381-metrics-tls\") pod \"dns-default-k8kdm\" (UID: \"9c66f5ab-d626-436c-8dc1-53201c728381\") " pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:33.716063 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:33.716042    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls\") pod \"image-registry-75b9c54f4d-xnlq5\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") " pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:33.890005 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:33.889974    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5j9kh\""
Jul 06 19:06:33.898634 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:33.898582    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:33.912149 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:33.912123    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8npzr\""
Jul 06 19:06:33.920777 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:33.920749    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:34.309062 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:34.308981    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb09aa790_cc9a_4341_bedc_7c18351e27d5.slice/crio-d3ba759986a69d780ce8cf21bfea587f2661dc7d42a5fda25cf43478972ad379 WatchSource:0}: Error finding container d3ba759986a69d780ce8cf21bfea587f2661dc7d42a5fda25cf43478972ad379: Status 404 returned error can't find the container with id d3ba759986a69d780ce8cf21bfea587f2661dc7d42a5fda25cf43478972ad379
Jul 06 19:06:35.191904 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:35.191859    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pth4c" event={"ID":"b09aa790-cc9a-4341-bedc-7c18351e27d5","Type":"ContainerStarted","Data":"d3ba759986a69d780ce8cf21bfea587f2661dc7d42a5fda25cf43478972ad379"}
Jul 06 19:06:35.602321 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:35.602280    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6p7zh"]
Jul 06 19:06:35.605207 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:35.605163    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc9e75a_05d0_4604_8402_6aa5c4969689.slice/crio-095834add81653e43ac780b5891e6a93a9d2a1fbf788712b756d2991593198c3 WatchSource:0}: Error finding container 095834add81653e43ac780b5891e6a93a9d2a1fbf788712b756d2991593198c3: Status 404 returned error can't find the container with id 095834add81653e43ac780b5891e6a93a9d2a1fbf788712b756d2991593198c3
Jul 06 19:06:35.826502 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:35.826426    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6zm9c"]
Jul 06 19:06:35.829017 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:35.828994    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k8kdm"]
Jul 06 19:06:35.832149 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:35.832084    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75b9c54f4d-xnlq5"]
Jul 06 19:06:36.099231 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:36.099194    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c66f5ab_d626_436c_8dc1_53201c728381.slice/crio-f13848addad543fcd6c02f5474e891fa4aeee079288505134d9143dc9a72fd4e WatchSource:0}: Error finding container f13848addad543fcd6c02f5474e891fa4aeee079288505134d9143dc9a72fd4e: Status 404 returned error can't find the container with id f13848addad543fcd6c02f5474e891fa4aeee079288505134d9143dc9a72fd4e
Jul 06 19:06:36.099839 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:36.099815    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a18cca_96fa_4abb_b1e8_d061a4a0599c.slice/crio-be74f1b6ebcfddee951c0a4fa38154ef95ee1b329f5eab82f24c461ea9906a81 WatchSource:0}: Error finding container be74f1b6ebcfddee951c0a4fa38154ef95ee1b329f5eab82f24c461ea9906a81: Status 404 returned error can't find the container with id be74f1b6ebcfddee951c0a4fa38154ef95ee1b329f5eab82f24c461ea9906a81
Jul 06 19:06:36.100788 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:36.100760    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91599e02_80f3_41c5_a673_7d8f682d349f.slice/crio-df2192eebad2afdb315f5dee4948695fbb4de9b3b32d5c5f43f03cdc99767b53 WatchSource:0}: Error finding container df2192eebad2afdb315f5dee4948695fbb4de9b3b32d5c5f43f03cdc99767b53: Status 404 returned error can't find the container with id df2192eebad2afdb315f5dee4948695fbb4de9b3b32d5c5f43f03cdc99767b53
Jul 06 19:06:36.196668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:36.196639    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k8kdm" event={"ID":"9c66f5ab-d626-436c-8dc1-53201c728381","Type":"ContainerStarted","Data":"f13848addad543fcd6c02f5474e891fa4aeee079288505134d9143dc9a72fd4e"}
Jul 06 19:06:36.197925 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:36.197902    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6zm9c" event={"ID":"c3a18cca-96fa-4abb-b1e8-d061a4a0599c","Type":"ContainerStarted","Data":"be74f1b6ebcfddee951c0a4fa38154ef95ee1b329f5eab82f24c461ea9906a81"}
Jul 06 19:06:36.199080 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:36.199047    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5" event={"ID":"91599e02-80f3-41c5-a673-7d8f682d349f","Type":"ContainerStarted","Data":"df2192eebad2afdb315f5dee4948695fbb4de9b3b32d5c5f43f03cdc99767b53"}
Jul 06 19:06:36.200693 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:36.200659    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6p7zh" event={"ID":"5fc9e75a-05d0-4604-8402-6aa5c4969689","Type":"ContainerStarted","Data":"095834add81653e43ac780b5891e6a93a9d2a1fbf788712b756d2991593198c3"}
Jul 06 19:06:37.210059 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:37.210021    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5" event={"ID":"91599e02-80f3-41c5-a673-7d8f682d349f","Type":"ContainerStarted","Data":"5c9468474676db433863435e70070a061f6377dc164d74b7e6377d1dee36d0ec"}
Jul 06 19:06:37.210465 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:37.210134    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:06:37.212005 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:37.211979    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6p7zh" event={"ID":"5fc9e75a-05d0-4604-8402-6aa5c4969689","Type":"ContainerStarted","Data":"667af5738792f6e35f4c1dd059687311372babaf2fca451f2c3aac2ecf8f3175"}
Jul 06 19:06:37.212262 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:37.212238    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:06:37.215154 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:37.215091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z874w" event={"ID":"18c396c0-b0b0-41c2-bffc-7941a2358658","Type":"ContainerStarted","Data":"003d4f76466ebf097519b2bc778bb3fb60e98bb85d5a072801e9b048a1ba7212"}
Jul 06 19:06:37.215154 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:37.215148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z874w" event={"ID":"18c396c0-b0b0-41c2-bffc-7941a2358658","Type":"ContainerStarted","Data":"aab4fb162b93c315b10cbd559eb48fe37f1983ea2b4feccc7a45db95309a49ea"}
Jul 06 19:06:37.217226 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:37.217202    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pth4c" event={"ID":"b09aa790-cc9a-4341-bedc-7c18351e27d5","Type":"ContainerStarted","Data":"b518a79c0934fdd26def281364f0955ba6f858bbcefd69a191197eea225cdfc3"}
Jul 06 19:06:37.217316 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:37.217247    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pth4c" event={"ID":"b09aa790-cc9a-4341-bedc-7c18351e27d5","Type":"ContainerStarted","Data":"562b420e188dd62418f38da140fbd09fbcf1c1363ae1986e3c83bcd4796e73da"}
Jul 06 19:06:37.230301 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:37.230094    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5" podStartSLOduration=69.230076758 podStartE2EDuration="1m9.230076758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:37.228812731 +0000 UTC m=+70.838940096" watchObservedRunningTime="2026-07-06 19:06:37.230076758 +0000 UTC m=+70.840204105"
Jul 06 19:06:37.245060 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:37.245003    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6p7zh" podStartSLOduration=70.24498714 podStartE2EDuration="1m10.24498714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:37.244318052 +0000 UTC m=+70.854445418" watchObservedRunningTime="2026-07-06 19:06:37.24498714 +0000 UTC m=+70.855114461"
Jul 06 19:06:37.261045 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:37.260988    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pth4c" podStartSLOduration=68.332711556 podStartE2EDuration="1m10.26096527s" totalImagesPullingTime="1.928253714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:37.259485255 +0000 UTC m=+70.869612600" watchObservedRunningTime="2026-07-06 19:06:37.26096527 +0000 UTC m=+70.871092617"
Jul 06 19:06:38.224413 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.224277    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k8kdm" event={"ID":"9c66f5ab-d626-436c-8dc1-53201c728381","Type":"ContainerStarted","Data":"0da6ed59011f95b921c4a960445b70a24094a2c02e3e3c6f8d9ee5aedb476f02"}
Jul 06 19:06:38.356495 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.356407    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:38.356652 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.356559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:38.357436 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.356756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:38.357561 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.357445    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47cefdd7-3087-4e22-b0cd-569e3862dd1b-service-ca-bundle\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:38.359522 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.359479    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47cefdd7-3087-4e22-b0cd-569e3862dd1b-metrics-certs\") pod \"router-default-5cd66fb969-l6b4g\" (UID: \"47cefdd7-3087-4e22-b0cd-569e3862dd1b\") " pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:38.360231 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.360201    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c25aa9b5-06e8-4aa0-8cea-d1179e62a508-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-sshgz\" (UID: \"c25aa9b5-06e8-4aa0-8cea-d1179e62a508\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:38.457616 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.457573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:38.460643 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.460612    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls\") pod \"image-registry-59f45f7699-mfntn\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") " pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:38.506166 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.506078    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-287df\""
Jul 06 19:06:38.514157 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.514112    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"
Jul 06 19:06:38.534995 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.534897    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nh57b\""
Jul 06 19:06:38.543733 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.543581    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:38.648008 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.647933    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:38.680646 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.680614    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz"]
Jul 06 19:06:38.711521 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:38.711480    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5cd66fb969-l6b4g"]
Jul 06 19:06:39.223634 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.223499    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-8427r"]
Jul 06 19:06:39.228637 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.228546    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8427r"
Jul 06 19:06:39.231629 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.231329    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"]
Jul 06 19:06:39.232609 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.232197    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-n7twm\""
Jul 06 19:06:39.232609 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.232438    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 19:06:39.232609 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.232527    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 19:06:39.235091 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.235067    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:39.235227 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.235111    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k8kdm" event={"ID":"9c66f5ab-d626-436c-8dc1-53201c728381","Type":"ContainerStarted","Data":"ba1782e08390ac795591f42e9da5ab7b9fda6f60acff2fff708bf97dcebec0ac"}
Jul 06 19:06:39.235227 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.235145    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d74d4465b-dt8st"]
Jul 06 19:06:39.235337 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.235258    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"
Jul 06 19:06:39.237570 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.237316    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d74d4465b-dt8st"
Jul 06 19:06:39.238449 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.238189    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"]
Jul 06 19:06:39.240100 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.239790    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 19:06:39.240100 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.239799    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 19:06:39.240100 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.239852    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-w25rc\""
Jul 06 19:06:39.240100 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.239887    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 19:06:39.240100 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.239949    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 19:06:39.240638 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.240615    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.246610 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.245099    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 19:06:39.246610 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.245148    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-8427r"]
Jul 06 19:06:39.246610 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.245564    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 19:06:39.246610 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.245576    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 19:06:39.246610 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.245702    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 19:06:39.248786 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.248733    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59f45f7699-mfntn"]
Jul 06 19:06:39.250100 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.249670    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 19:06:39.264129 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.263041    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"]
Jul 06 19:06:39.265576 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.265479    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d74d4465b-dt8st"]
Jul 06 19:06:39.286776 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.286686    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"]
Jul 06 19:06:39.319862 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.319795    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k8kdm" podStartSLOduration=36.367689418 podStartE2EDuration="38.319772475s" totalImagesPullingTime="1.952083057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:39.318528867 +0000 UTC m=+72.928656212" watchObservedRunningTime="2026-07-06 19:06:39.319772475 +0000 UTC m=+72.929899822"
Jul 06 19:06:39.350446 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.350387    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-m6jrf"]
Jul 06 19:06:39.353332 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.353309    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-m6jrf"
Jul 06 19:06:39.355671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.355494    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xfg9w\""
Jul 06 19:06:39.355671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.355651    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 19:06:39.355978 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.355954    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 19:06:39.365047 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.365015    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c75144a8-8fc8-4393-b9d6-842c04c01ad2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.365211 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.365056    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9260b630-cb51-4248-9587-423affb0e394-tmp\") pod \"klusterlet-addon-workmgr-65f4c94695-7w8kr\" (UID: \"9260b630-cb51-4248-9587-423affb0e394\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"
Jul 06 19:06:39.365211 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.365119    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb993643-d2e9-49d2-9df5-4f5b4c4041ef-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d74d4465b-dt8st\" (UID: \"cb993643-d2e9-49d2-9df5-4f5b4c4041ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d74d4465b-dt8st"
Jul 06 19:06:39.365211 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.365189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvj8b\" (UniqueName: \"kubernetes.io/projected/cb993643-d2e9-49d2-9df5-4f5b4c4041ef-kube-api-access-kvj8b\") pod \"managed-serviceaccount-addon-agent-7d74d4465b-dt8st\" (UID: \"cb993643-d2e9-49d2-9df5-4f5b4c4041ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d74d4465b-dt8st"
Jul 06 19:06:39.365211 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.365205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c75144a8-8fc8-4393-b9d6-842c04c01ad2-hub\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.365435 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.365235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c75144a8-8fc8-4393-b9d6-842c04c01ad2-ca\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.365435 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.365293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnv88\" (UniqueName: \"kubernetes.io/projected/9260b630-cb51-4248-9587-423affb0e394-kube-api-access-xnv88\") pod \"klusterlet-addon-workmgr-65f4c94695-7w8kr\" (UID: \"9260b630-cb51-4248-9587-423affb0e394\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"
Jul 06 19:06:39.365435 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.365349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9260b630-cb51-4248-9587-423affb0e394-klusterlet-config\") pod \"klusterlet-addon-workmgr-65f4c94695-7w8kr\" (UID: \"9260b630-cb51-4248-9587-423affb0e394\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"
Jul 06 19:06:39.365435 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.365383    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c75144a8-8fc8-4393-b9d6-842c04c01ad2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.365635 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.365439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c75144a8-8fc8-4393-b9d6-842c04c01ad2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.365635 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.365463    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t588n\" (UniqueName: \"kubernetes.io/projected/c75144a8-8fc8-4393-b9d6-842c04c01ad2-kube-api-access-t588n\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.365635 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.365489    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/710d5b79-850d-4434-bbec-c627665523c3-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-8427r\" (UID: \"710d5b79-850d-4434-bbec-c627665523c3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8427r"
Jul 06 19:06:39.365635 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.365507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/710d5b79-850d-4434-bbec-c627665523c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8427r\" (UID: \"710d5b79-850d-4434-bbec-c627665523c3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8427r"
Jul 06 19:06:39.375266 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.374946    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-m6jrf"]
Jul 06 19:06:39.466474 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.466438    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9260b630-cb51-4248-9587-423affb0e394-klusterlet-config\") pod \"klusterlet-addon-workmgr-65f4c94695-7w8kr\" (UID: \"9260b630-cb51-4248-9587-423affb0e394\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"
Jul 06 19:06:39.466674 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.466484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c75144a8-8fc8-4393-b9d6-842c04c01ad2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.466674 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.466514    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c75144a8-8fc8-4393-b9d6-842c04c01ad2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.466674 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.466540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t588n\" (UniqueName: \"kubernetes.io/projected/c75144a8-8fc8-4393-b9d6-842c04c01ad2-kube-api-access-t588n\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.466674 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.466569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/710d5b79-850d-4434-bbec-c627665523c3-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-8427r\" (UID: \"710d5b79-850d-4434-bbec-c627665523c3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8427r"
Jul 06 19:06:39.466674 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.466594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/710d5b79-850d-4434-bbec-c627665523c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8427r\" (UID: \"710d5b79-850d-4434-bbec-c627665523c3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8427r"
Jul 06 19:06:39.466674 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.466635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c75144a8-8fc8-4393-b9d6-842c04c01ad2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.466674 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.466668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9260b630-cb51-4248-9587-423affb0e394-tmp\") pod \"klusterlet-addon-workmgr-65f4c94695-7w8kr\" (UID: \"9260b630-cb51-4248-9587-423affb0e394\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"
Jul 06 19:06:39.467083 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.466700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb993643-d2e9-49d2-9df5-4f5b4c4041ef-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d74d4465b-dt8st\" (UID: \"cb993643-d2e9-49d2-9df5-4f5b4c4041ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d74d4465b-dt8st"
Jul 06 19:06:39.467083 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.466777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvj8b\" (UniqueName: \"kubernetes.io/projected/cb993643-d2e9-49d2-9df5-4f5b4c4041ef-kube-api-access-kvj8b\") pod \"managed-serviceaccount-addon-agent-7d74d4465b-dt8st\" (UID: \"cb993643-d2e9-49d2-9df5-4f5b4c4041ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d74d4465b-dt8st"
Jul 06 19:06:39.467083 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.466804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c75144a8-8fc8-4393-b9d6-842c04c01ad2-hub\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.467083 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.466836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c75144a8-8fc8-4393-b9d6-842c04c01ad2-ca\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.467083 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.466873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnv88\" (UniqueName: \"kubernetes.io/projected/9260b630-cb51-4248-9587-423affb0e394-kube-api-access-xnv88\") pod \"klusterlet-addon-workmgr-65f4c94695-7w8kr\" (UID: \"9260b630-cb51-4248-9587-423affb0e394\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"
Jul 06 19:06:39.467083 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.466913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn7ks\" (UniqueName: \"kubernetes.io/projected/84d4bf4a-037c-4efe-857a-90978d7d4d27-kube-api-access-sn7ks\") pod \"downloads-685bfb5f64-m6jrf\" (UID: \"84d4bf4a-037c-4efe-857a-90978d7d4d27\") " pod="openshift-console/downloads-685bfb5f64-m6jrf"
Jul 06 19:06:39.467365 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.467305    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c75144a8-8fc8-4393-b9d6-842c04c01ad2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.467927 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.467861    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9260b630-cb51-4248-9587-423affb0e394-tmp\") pod \"klusterlet-addon-workmgr-65f4c94695-7w8kr\" (UID: \"9260b630-cb51-4248-9587-423affb0e394\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"
Jul 06 19:06:39.468311 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.468280    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/710d5b79-850d-4434-bbec-c627665523c3-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-8427r\" (UID: \"710d5b79-850d-4434-bbec-c627665523c3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8427r"
Jul 06 19:06:39.470000 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.469936    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c75144a8-8fc8-4393-b9d6-842c04c01ad2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.470457 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.470294    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/710d5b79-850d-4434-bbec-c627665523c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8427r\" (UID: \"710d5b79-850d-4434-bbec-c627665523c3\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8427r"
Jul 06 19:06:39.470457 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.470429    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb993643-d2e9-49d2-9df5-4f5b4c4041ef-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d74d4465b-dt8st\" (UID: \"cb993643-d2e9-49d2-9df5-4f5b4c4041ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d74d4465b-dt8st"
Jul 06 19:06:39.470721 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.470674    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9260b630-cb51-4248-9587-423affb0e394-klusterlet-config\") pod \"klusterlet-addon-workmgr-65f4c94695-7w8kr\" (UID: \"9260b630-cb51-4248-9587-423affb0e394\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"
Jul 06 19:06:39.470964 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.470939    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c75144a8-8fc8-4393-b9d6-842c04c01ad2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.471044 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.471027    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c75144a8-8fc8-4393-b9d6-842c04c01ad2-hub\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.471649 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.471625    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c75144a8-8fc8-4393-b9d6-842c04c01ad2-ca\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.479433 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.479360    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvj8b\" (UniqueName: \"kubernetes.io/projected/cb993643-d2e9-49d2-9df5-4f5b4c4041ef-kube-api-access-kvj8b\") pod \"managed-serviceaccount-addon-agent-7d74d4465b-dt8st\" (UID: \"cb993643-d2e9-49d2-9df5-4f5b4c4041ef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d74d4465b-dt8st"
Jul 06 19:06:39.480093 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.480073    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t588n\" (UniqueName: \"kubernetes.io/projected/c75144a8-8fc8-4393-b9d6-842c04c01ad2-kube-api-access-t588n\") pod \"cluster-proxy-proxy-agent-786f56b57f-qxdfv\" (UID: \"c75144a8-8fc8-4393-b9d6-842c04c01ad2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.480324 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.480303    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnv88\" (UniqueName: \"kubernetes.io/projected/9260b630-cb51-4248-9587-423affb0e394-kube-api-access-xnv88\") pod \"klusterlet-addon-workmgr-65f4c94695-7w8kr\" (UID: \"9260b630-cb51-4248-9587-423affb0e394\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"
Jul 06 19:06:39.545760 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.545721    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8427r"
Jul 06 19:06:39.556303 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.556261    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"
Jul 06 19:06:39.568247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.568214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn7ks\" (UniqueName: \"kubernetes.io/projected/84d4bf4a-037c-4efe-857a-90978d7d4d27-kube-api-access-sn7ks\") pod \"downloads-685bfb5f64-m6jrf\" (UID: \"84d4bf4a-037c-4efe-857a-90978d7d4d27\") " pod="openshift-console/downloads-685bfb5f64-m6jrf"
Jul 06 19:06:39.576908 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.576881    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d74d4465b-dt8st"
Jul 06 19:06:39.582933 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.582911    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn7ks\" (UniqueName: \"kubernetes.io/projected/84d4bf4a-037c-4efe-857a-90978d7d4d27-kube-api-access-sn7ks\") pod \"downloads-685bfb5f64-m6jrf\" (UID: \"84d4bf4a-037c-4efe-857a-90978d7d4d27\") " pod="openshift-console/downloads-685bfb5f64-m6jrf"
Jul 06 19:06:39.585609 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.585589    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"
Jul 06 19:06:39.679297 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:39.679261    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-m6jrf"
Jul 06 19:06:39.867883 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:39.867811    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc25aa9b5_06e8_4aa0_8cea_d1179e62a508.slice/crio-9540ed09463f8f0f060c448062cc418a0cc74c50a4419b08223de8920fc772b3 WatchSource:0}: Error finding container 9540ed09463f8f0f060c448062cc418a0cc74c50a4419b08223de8920fc772b3: Status 404 returned error can't find the container with id 9540ed09463f8f0f060c448062cc418a0cc74c50a4419b08223de8920fc772b3
Jul 06 19:06:39.868625 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:39.868595    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47cefdd7_3087_4e22_b0cd_569e3862dd1b.slice/crio-76c510b4c44e45bb07cee4875e01e82814575ac887d110baabf7faf208a20fda WatchSource:0}: Error finding container 76c510b4c44e45bb07cee4875e01e82814575ac887d110baabf7faf208a20fda: Status 404 returned error can't find the container with id 76c510b4c44e45bb07cee4875e01e82814575ac887d110baabf7faf208a20fda
Jul 06 19:06:40.240006 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:40.239933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz" event={"ID":"c25aa9b5-06e8-4aa0-8cea-d1179e62a508","Type":"ContainerStarted","Data":"9540ed09463f8f0f060c448062cc418a0cc74c50a4419b08223de8920fc772b3"}
Jul 06 19:06:40.241404 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:40.241359    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5cd66fb969-l6b4g" event={"ID":"47cefdd7-3087-4e22-b0cd-569e3862dd1b","Type":"ContainerStarted","Data":"76c510b4c44e45bb07cee4875e01e82814575ac887d110baabf7faf208a20fda"}
Jul 06 19:06:41.578773 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:41.576676    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59f45f7699-mfntn"]
Jul 06 19:06:41.584550 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:41.581367    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d74d4465b-dt8st"]
Jul 06 19:06:41.586001 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:41.585907    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd99612d0_3b8a_45e3_963a_930e887c2d43.slice/crio-3130d8e80868c22b3a54fba083577c1dfee78ffffac0741d897f71646697c0fa WatchSource:0}: Error finding container 3130d8e80868c22b3a54fba083577c1dfee78ffffac0741d897f71646697c0fa: Status 404 returned error can't find the container with id 3130d8e80868c22b3a54fba083577c1dfee78ffffac0741d897f71646697c0fa
Jul 06 19:06:41.587242 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:41.587215    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb993643_d2e9_49d2_9df5_4f5b4c4041ef.slice/crio-f62b3e9281c3cc93b56311aff4fa8efdb2301d9420d1e734e643d417c3224800 WatchSource:0}: Error finding container f62b3e9281c3cc93b56311aff4fa8efdb2301d9420d1e734e643d417c3224800: Status 404 returned error can't find the container with id f62b3e9281c3cc93b56311aff4fa8efdb2301d9420d1e734e643d417c3224800
Jul 06 19:06:41.622455 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:41.622422    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-m6jrf"]
Jul 06 19:06:41.634978 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:41.634941    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d4bf4a_037c_4efe_857a_90978d7d4d27.slice/crio-3438c4fe1639ffb1774f65e83a7481477679055f64c04e3804259d25039df23c WatchSource:0}: Error finding container 3438c4fe1639ffb1774f65e83a7481477679055f64c04e3804259d25039df23c: Status 404 returned error can't find the container with id 3438c4fe1639ffb1774f65e83a7481477679055f64c04e3804259d25039df23c
Jul 06 19:06:41.842026 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:41.841953    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-8427r"]
Jul 06 19:06:41.844502 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:41.844464    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"]
Jul 06 19:06:41.845310 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:41.845276    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod710d5b79_850d_4434_bbec_c627665523c3.slice/crio-67dd66a8ff25b42578386614d652760fe4ecae9bd45e748c150738faafd0b4fb WatchSource:0}: Error finding container 67dd66a8ff25b42578386614d652760fe4ecae9bd45e748c150738faafd0b4fb: Status 404 returned error can't find the container with id 67dd66a8ff25b42578386614d652760fe4ecae9bd45e748c150738faafd0b4fb
Jul 06 19:06:41.847866 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:41.847610    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9260b630_cb51_4248_9587_423affb0e394.slice/crio-7d9ad6d6a8d3607adc536547cd7306534315b4c657381cca7b606cc32551efae WatchSource:0}: Error finding container 7d9ad6d6a8d3607adc536547cd7306534315b4c657381cca7b606cc32551efae: Status 404 returned error can't find the container with id 7d9ad6d6a8d3607adc536547cd7306534315b4c657381cca7b606cc32551efae
Jul 06 19:06:41.850867 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:41.850842    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv"]
Jul 06 19:06:41.854626 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:41.854605    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc75144a8_8fc8_4393_b9d6_842c04c01ad2.slice/crio-42cdee1ffed070e4fca3df2151bd7f371fe628a26be14d57c28da576e56ecaf6 WatchSource:0}: Error finding container 42cdee1ffed070e4fca3df2151bd7f371fe628a26be14d57c28da576e56ecaf6: Status 404 returned error can't find the container with id 42cdee1ffed070e4fca3df2151bd7f371fe628a26be14d57c28da576e56ecaf6
Jul 06 19:06:42.259103 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.259056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv" event={"ID":"c75144a8-8fc8-4393-b9d6-842c04c01ad2","Type":"ContainerStarted","Data":"42cdee1ffed070e4fca3df2151bd7f371fe628a26be14d57c28da576e56ecaf6"}
Jul 06 19:06:42.260620 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.260531    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-m6jrf" event={"ID":"84d4bf4a-037c-4efe-857a-90978d7d4d27","Type":"ContainerStarted","Data":"3438c4fe1639ffb1774f65e83a7481477679055f64c04e3804259d25039df23c"}
Jul 06 19:06:42.262121 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.262094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr" event={"ID":"9260b630-cb51-4248-9587-423affb0e394","Type":"ContainerStarted","Data":"7d9ad6d6a8d3607adc536547cd7306534315b4c657381cca7b606cc32551efae"}
Jul 06 19:06:42.263805 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.263779    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5cd66fb969-l6b4g" event={"ID":"47cefdd7-3087-4e22-b0cd-569e3862dd1b","Type":"ContainerStarted","Data":"46c31a501fe9a99b4fd63d83db8ec9c06fb69a3375e424bbb7232d8499fbb22b"}
Jul 06 19:06:42.267479 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.267454    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f45f7699-mfntn" event={"ID":"d99612d0-3b8a-45e3-963a-930e887c2d43","Type":"ContainerStarted","Data":"4b56973f5e4e877821c82413a5d4fc78abdd50218f55d3a4ee37546b22e9d3a9"}
Jul 06 19:06:42.272788 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.272764    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f45f7699-mfntn" event={"ID":"d99612d0-3b8a-45e3-963a-930e887c2d43","Type":"ContainerStarted","Data":"3130d8e80868c22b3a54fba083577c1dfee78ffffac0741d897f71646697c0fa"}
Jul 06 19:06:42.272955 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.272911    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6zm9c" event={"ID":"c3a18cca-96fa-4abb-b1e8-d061a4a0599c","Type":"ContainerStarted","Data":"a9ba60d0490d6052c90c2e791ed6e5af05c0c976f70edbe3e642d0cfd692d1d5"}
Jul 06 19:06:42.273046 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.272982    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:06:42.275161 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.275122    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d74d4465b-dt8st" event={"ID":"cb993643-d2e9-49d2-9df5-4f5b4c4041ef","Type":"ContainerStarted","Data":"f62b3e9281c3cc93b56311aff4fa8efdb2301d9420d1e734e643d417c3224800"}
Jul 06 19:06:42.277047 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.277025    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8427r" event={"ID":"710d5b79-850d-4434-bbec-c627665523c3","Type":"ContainerStarted","Data":"67dd66a8ff25b42578386614d652760fe4ecae9bd45e748c150738faafd0b4fb"}
Jul 06 19:06:42.281266 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.281239    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z874w" event={"ID":"18c396c0-b0b0-41c2-bffc-7941a2358658","Type":"ContainerStarted","Data":"7dc97b81ece7d91b6e81705f83ba6729ee2c3e2ab16416c931ae0ca80e738125"}
Jul 06 19:06:42.286735 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.285038    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5cd66fb969-l6b4g" podStartSLOduration=36.285021329 podStartE2EDuration="36.285021329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:42.284179851 +0000 UTC m=+75.894307196" watchObservedRunningTime="2026-07-06 19:06:42.285021329 +0000 UTC m=+75.895148675"
Jul 06 19:06:42.311200 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.311143    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59f45f7699-mfntn" podStartSLOduration=36.31112687 podStartE2EDuration="36.31112687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:42.309727233 +0000 UTC m=+75.919854569" watchObservedRunningTime="2026-07-06 19:06:42.31112687 +0000 UTC m=+75.921254191"
Jul 06 19:06:42.331703 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.330933    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z874w" podStartSLOduration=17.53984934 podStartE2EDuration="27.330908418s" totalImagesPullingTime="9.791059078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:42.329100409 +0000 UTC m=+75.939227765" watchObservedRunningTime="2026-07-06 19:06:42.330908418 +0000 UTC m=+75.941035762"
Jul 06 19:06:42.350133 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.349347    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6zm9c" podStartSLOduration=70.17001352 podStartE2EDuration="1m15.349323217s" totalImagesPullingTime="5.179309697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:05:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:42.347558905 +0000 UTC m=+75.957686252" watchObservedRunningTime="2026-07-06 19:06:42.349323217 +0000 UTC m=+75.959450556"
Jul 06 19:06:42.474800 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.474752    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f4cb4984c-6w88d"]
Jul 06 19:06:42.493745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.493669    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f4cb4984c-6w88d"]
Jul 06 19:06:42.493936 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.493812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.501308 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.501281    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7qvkn\""
Jul 06 19:06:42.501846 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.501823    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 19:06:42.502049 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.502032    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 19:06:42.502252 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.502234    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 19:06:42.502427 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.502413    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 19:06:42.504041 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.503292    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 19:06:42.544104 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.544069    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:42.547096 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.547073    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:42.604929 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.604889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/764455fc-a5be-46a9-90df-4f2d40cac48f-console-serving-cert\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.605428 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.604999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-service-ca\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.605428 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.605042    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/764455fc-a5be-46a9-90df-4f2d40cac48f-console-oauth-config\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.605428 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.605074    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-oauth-serving-cert\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.605428 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.605180    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxbfq\" (UniqueName: \"kubernetes.io/projected/764455fc-a5be-46a9-90df-4f2d40cac48f-kube-api-access-pxbfq\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.605428 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.605216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-console-config\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.708858 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.706317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxbfq\" (UniqueName: \"kubernetes.io/projected/764455fc-a5be-46a9-90df-4f2d40cac48f-kube-api-access-pxbfq\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.708858 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.706375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-console-config\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.708858 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.706458    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/764455fc-a5be-46a9-90df-4f2d40cac48f-console-serving-cert\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.708858 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.706482    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-service-ca\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.708858 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.706510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/764455fc-a5be-46a9-90df-4f2d40cac48f-console-oauth-config\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.708858 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.706540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-oauth-serving-cert\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.708858 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.707450    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-oauth-serving-cert\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.708858 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.708534    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-console-config\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.708858 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.708765    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-service-ca\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.713766 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.713737    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/764455fc-a5be-46a9-90df-4f2d40cac48f-console-oauth-config\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.715370 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.715330    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/764455fc-a5be-46a9-90df-4f2d40cac48f-console-serving-cert\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.720826 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.720753    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxbfq\" (UniqueName: \"kubernetes.io/projected/764455fc-a5be-46a9-90df-4f2d40cac48f-kube-api-access-pxbfq\") pod \"console-f4cb4984c-6w88d\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") " pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:42.817340 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:42.817029    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:43.297687 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:43.297656    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:43.298952 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:43.298893    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5cd66fb969-l6b4g"
Jul 06 19:06:48.837898 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:48.837703    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f4cb4984c-6w88d"]
Jul 06 19:06:48.841903 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:06:48.841871    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764455fc_a5be_46a9_90df_4f2d40cac48f.slice/crio-2428e50c30f8377437ee4ee178c4a22eed85b4913d180d6316f9dda51fd721c2 WatchSource:0}: Error finding container 2428e50c30f8377437ee4ee178c4a22eed85b4913d180d6316f9dda51fd721c2: Status 404 returned error can't find the container with id 2428e50c30f8377437ee4ee178c4a22eed85b4913d180d6316f9dda51fd721c2
Jul 06 19:06:49.244478 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.244327    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k8kdm"
Jul 06 19:06:49.334373 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.331366    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d74d4465b-dt8st" event={"ID":"cb993643-d2e9-49d2-9df5-4f5b4c4041ef","Type":"ContainerStarted","Data":"a90dc3ce1ef872b9fdfef0774e59315ae78d6b990709a4574ecd1c0c371d2af2"}
Jul 06 19:06:49.341526 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.341435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8427r" event={"ID":"710d5b79-850d-4434-bbec-c627665523c3","Type":"ContainerStarted","Data":"3e1702ce047b878d7d529aa07884d09a1c7db3b6080b55ca73ff1745d70d0ffe"}
Jul 06 19:06:49.344139 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.344110    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz" event={"ID":"c25aa9b5-06e8-4aa0-8cea-d1179e62a508","Type":"ContainerStarted","Data":"b15df18aa428185395bba651c8f25b7e67765f7767cbef5aac1b0769944e780b"}
Jul 06 19:06:49.347247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.347220    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv" event={"ID":"c75144a8-8fc8-4393-b9d6-842c04c01ad2","Type":"ContainerStarted","Data":"8ccbec6812df5fe9c6cea93f69083f583c5096cb537ea23281be8b23e0b19e45"}
Jul 06 19:06:49.347352 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.347261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv" event={"ID":"c75144a8-8fc8-4393-b9d6-842c04c01ad2","Type":"ContainerStarted","Data":"16b66c706ab96b3441d080cecd61c39e18abc4fea597abbf506f0bb420b58cbb"}
Jul 06 19:06:49.347352 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.347278    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv" event={"ID":"c75144a8-8fc8-4393-b9d6-842c04c01ad2","Type":"ContainerStarted","Data":"0de06e7426e6ca7a12223ea362274625bd38dc8484b78ea225b84c554279fcfd"}
Jul 06 19:06:49.351086 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.351053    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4cb4984c-6w88d" event={"ID":"764455fc-a5be-46a9-90df-4f2d40cac48f","Type":"ContainerStarted","Data":"2428e50c30f8377437ee4ee178c4a22eed85b4913d180d6316f9dda51fd721c2"}
Jul 06 19:06:49.353305 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.353275    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr" event={"ID":"9260b630-cb51-4248-9587-423affb0e394","Type":"ContainerStarted","Data":"bea7c193d36c34eedaf34108a7efc20b95722b93d525e6e64f11fb113cebde37"}
Jul 06 19:06:49.353847 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.353804    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"
Jul 06 19:06:49.355547 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.355524    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr"
Jul 06 19:06:49.367168 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.367079    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8427r" podStartSLOduration=3.52546883 podStartE2EDuration="10.367062216s" totalImagesPullingTime="6.841593386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:49.367044163 +0000 UTC m=+82.977171525" watchObservedRunningTime="2026-07-06 19:06:49.367062216 +0000 UTC m=+82.977189558"
Jul 06 19:06:49.368646 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.368613    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d74d4465b-dt8st" podStartSLOduration=3.228251886 podStartE2EDuration="10.368601174s" totalImagesPullingTime="7.140349288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:49.349700985 +0000 UTC m=+82.959828343" watchObservedRunningTime="2026-07-06 19:06:49.368601174 +0000 UTC m=+82.978728518"
Jul 06 19:06:49.388702 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.388237    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-786f56b57f-qxdfv" podStartSLOduration=3.480611676 podStartE2EDuration="10.388218604s" totalImagesPullingTime="6.907606928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:49.386148695 +0000 UTC m=+82.996276050" watchObservedRunningTime="2026-07-06 19:06:49.388218604 +0000 UTC m=+82.998345951"
Jul 06 19:06:49.410018 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.409970    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-sshgz" podStartSLOduration=34.592989698 podStartE2EDuration="43.409950444s" totalImagesPullingTime="8.816960746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:49.408874631 +0000 UTC m=+83.019001979" watchObservedRunningTime="2026-07-06 19:06:49.409950444 +0000 UTC m=+83.020077787"
Jul 06 19:06:49.434649 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:49.434598    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-65f4c94695-7w8kr" podStartSLOduration=3.543448781 podStartE2EDuration="10.434582841s" totalImagesPullingTime="6.89113406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:49.434127152 +0000 UTC m=+83.044254515" watchObservedRunningTime="2026-07-06 19:06:49.434582841 +0000 UTC m=+83.044710186"
Jul 06 19:06:52.369176 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:52.369131    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4cb4984c-6w88d" event={"ID":"764455fc-a5be-46a9-90df-4f2d40cac48f","Type":"ContainerStarted","Data":"d02dbc10e8a25347b62a8fe560a64e15aaf7e912b0bb4a409ce52d11272cdf6a"}
Jul 06 19:06:52.386196 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:52.386138    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f4cb4984c-6w88d" podStartSLOduration=7.610518081 podStartE2EDuration="10.386117668s" totalImagesPullingTime="2.775599587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:06:52.384698868 +0000 UTC m=+85.994826213" watchObservedRunningTime="2026-07-06 19:06:52.386117668 +0000 UTC m=+85.996245014"
Jul 06 19:06:52.818389 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:52.818352    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:52.818548 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:52.818435    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:52.823258 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:52.823232    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:53.378818 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:53.378788    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:06:53.903656 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:53.903622    2580 patch_prober.go:28] interesting pod/image-registry-75b9c54f4d-xnlq5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 19:06:53.903831 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:53.903683    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5" podUID="91599e02-80f3-41c5-a673-7d8f682d349f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:06:58.229141 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:06:58.229114    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:07:02.275414 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.275376    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:07:02.824222 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.820989    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7628t"]
Jul 06 19:07:02.970053 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.970014    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:02.973394 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.972963    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:07:02.973394 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.973279    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:07:02.973986 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.973962    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2xjff\""
Jul 06 19:07:02.974426 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.974113    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:07:02.974426 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.974182    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:07:02.999248 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.999206    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:02.999425 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.999259    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1ad539c3-a537-43fa-a6a0-abb62021ce68-root\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:02.999425 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.999295    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-accelerators-collector-config\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:02.999425 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.999329    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-textfile\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:02.999583 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.999464    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ad539c3-a537-43fa-a6a0-abb62021ce68-sys\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:02.999583 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.999510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-wtmp\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:02.999583 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.999540    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-tls\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:02.999583 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.999570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ad539c3-a537-43fa-a6a0-abb62021ce68-metrics-client-ca\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:02.999796 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:02.999596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thcd6\" (UniqueName: \"kubernetes.io/projected/1ad539c3-a537-43fa-a6a0-abb62021ce68-kube-api-access-thcd6\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.101778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.100790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-wtmp\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.101778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.100851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-tls\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.101778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.100884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ad539c3-a537-43fa-a6a0-abb62021ce68-metrics-client-ca\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.101778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.100916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thcd6\" (UniqueName: \"kubernetes.io/projected/1ad539c3-a537-43fa-a6a0-abb62021ce68-kube-api-access-thcd6\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.101778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.100972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.101778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.101006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1ad539c3-a537-43fa-a6a0-abb62021ce68-root\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.101778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.101050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-accelerators-collector-config\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.101778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.101084    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-textfile\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.101778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.101148    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ad539c3-a537-43fa-a6a0-abb62021ce68-sys\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.101778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.101238    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ad539c3-a537-43fa-a6a0-abb62021ce68-sys\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.101778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.101490    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1ad539c3-a537-43fa-a6a0-abb62021ce68-root\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.101778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.101545    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-wtmp\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.102484 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.102248    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-textfile\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.102484 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.102288    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-accelerators-collector-config\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.102774 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.102728    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ad539c3-a537-43fa-a6a0-abb62021ce68-metrics-client-ca\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.106475 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.106347    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.106899 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.106605    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1ad539c3-a537-43fa-a6a0-abb62021ce68-node-exporter-tls\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.110449 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.110406    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thcd6\" (UniqueName: \"kubernetes.io/projected/1ad539c3-a537-43fa-a6a0-abb62021ce68-kube-api-access-thcd6\") pod \"node-exporter-7628t\" (UID: \"1ad539c3-a537-43fa-a6a0-abb62021ce68\") " pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:03.283737 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:03.283686    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7628t"
Jul 06 19:07:05.308893 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:05.308848    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f4cb4984c-6w88d"]
Jul 06 19:07:06.592744 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:07:06.592683    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad539c3_a537_43fa_a6a0_abb62021ce68.slice/crio-cb04df5edb589cda5f897bb4c8f388343d6114541a8005ce9c970286009366eb WatchSource:0}: Error finding container cb04df5edb589cda5f897bb4c8f388343d6114541a8005ce9c970286009366eb: Status 404 returned error can't find the container with id cb04df5edb589cda5f897bb4c8f388343d6114541a8005ce9c970286009366eb
Jul 06 19:07:07.212370 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.212332    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75b9c54f4d-xnlq5"]
Jul 06 19:07:07.300794 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.300557    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59f45f7699-mfntn" podUID="d99612d0-3b8a-45e3-963a-930e887c2d43" containerName="registry" containerID="cri-o://4b56973f5e4e877821c82413a5d4fc78abdd50218f55d3a4ee37546b22e9d3a9" gracePeriod=30
Jul 06 19:07:07.440350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.439760    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-m6jrf" event={"ID":"84d4bf4a-037c-4efe-857a-90978d7d4d27","Type":"ContainerStarted","Data":"ec0a27f5f6f45ea50e5cacd90df5f10b7af74c10d81804fb06ec8a811fb927dd"}
Jul 06 19:07:07.440350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.440118    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-m6jrf"
Jul 06 19:07:07.443168 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.443134    2580 generic.go:356] "Generic (PLEG): container finished" podID="d99612d0-3b8a-45e3-963a-930e887c2d43" containerID="4b56973f5e4e877821c82413a5d4fc78abdd50218f55d3a4ee37546b22e9d3a9" exitCode=0
Jul 06 19:07:07.443340 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.443288    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f45f7699-mfntn" event={"ID":"d99612d0-3b8a-45e3-963a-930e887c2d43","Type":"ContainerDied","Data":"4b56973f5e4e877821c82413a5d4fc78abdd50218f55d3a4ee37546b22e9d3a9"}
Jul 06 19:07:07.444995 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.444966    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7628t" event={"ID":"1ad539c3-a537-43fa-a6a0-abb62021ce68","Type":"ContainerStarted","Data":"cb04df5edb589cda5f897bb4c8f388343d6114541a8005ce9c970286009366eb"}
Jul 06 19:07:07.451885 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.451821    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-m6jrf"
Jul 06 19:07:07.458050 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.457943    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-m6jrf" podStartSLOduration=3.191851262 podStartE2EDuration="28.457921498s" totalImagesPullingTime="25.266070236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:07.455517285 +0000 UTC m=+101.065644652" watchObservedRunningTime="2026-07-06 19:07:07.457921498 +0000 UTC m=+101.068048843"
Jul 06 19:07:07.636797 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.636758    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:07:07.748561 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.747640    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d99612d0-3b8a-45e3-963a-930e887c2d43-ca-trust-extracted\") pod \"d99612d0-3b8a-45e3-963a-930e887c2d43\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") "
Jul 06 19:07:07.748561 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.747687    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d99612d0-3b8a-45e3-963a-930e887c2d43-trusted-ca\") pod \"d99612d0-3b8a-45e3-963a-930e887c2d43\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") "
Jul 06 19:07:07.748561 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.747783    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-certificates\") pod \"d99612d0-3b8a-45e3-963a-930e887c2d43\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") "
Jul 06 19:07:07.748561 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.747838    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d99612d0-3b8a-45e3-963a-930e887c2d43-installation-pull-secrets\") pod \"d99612d0-3b8a-45e3-963a-930e887c2d43\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") "
Jul 06 19:07:07.748561 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.747877    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d99612d0-3b8a-45e3-963a-930e887c2d43-image-registry-private-configuration\") pod \"d99612d0-3b8a-45e3-963a-930e887c2d43\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") "
Jul 06 19:07:07.748561 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.747903    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6djw9\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-kube-api-access-6djw9\") pod \"d99612d0-3b8a-45e3-963a-930e887c2d43\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") "
Jul 06 19:07:07.748561 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.747963    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-bound-sa-token\") pod \"d99612d0-3b8a-45e3-963a-930e887c2d43\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") "
Jul 06 19:07:07.748561 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.747993    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls\") pod \"d99612d0-3b8a-45e3-963a-930e887c2d43\" (UID: \"d99612d0-3b8a-45e3-963a-930e887c2d43\") "
Jul 06 19:07:07.749137 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.748569    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d99612d0-3b8a-45e3-963a-930e887c2d43-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d99612d0-3b8a-45e3-963a-930e887c2d43" (UID: "d99612d0-3b8a-45e3-963a-930e887c2d43"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:07:07.749137 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.748896    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d99612d0-3b8a-45e3-963a-930e887c2d43" (UID: "d99612d0-3b8a-45e3-963a-930e887c2d43"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:07:07.751876 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.751823    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d99612d0-3b8a-45e3-963a-930e887c2d43-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d99612d0-3b8a-45e3-963a-930e887c2d43" (UID: "d99612d0-3b8a-45e3-963a-930e887c2d43"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:07:07.752772 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.752692    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d99612d0-3b8a-45e3-963a-930e887c2d43" (UID: "d99612d0-3b8a-45e3-963a-930e887c2d43"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:07:07.754754 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.754702    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-kube-api-access-6djw9" (OuterVolumeSpecName: "kube-api-access-6djw9") pod "d99612d0-3b8a-45e3-963a-930e887c2d43" (UID: "d99612d0-3b8a-45e3-963a-930e887c2d43"). InnerVolumeSpecName "kube-api-access-6djw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:07:07.754882 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.754832    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d99612d0-3b8a-45e3-963a-930e887c2d43-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d99612d0-3b8a-45e3-963a-930e887c2d43" (UID: "d99612d0-3b8a-45e3-963a-930e887c2d43"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:07:07.758277 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.758017    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d99612d0-3b8a-45e3-963a-930e887c2d43" (UID: "d99612d0-3b8a-45e3-963a-930e887c2d43"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:07:07.763147 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.763032    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99612d0-3b8a-45e3-963a-930e887c2d43-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d99612d0-3b8a-45e3-963a-930e887c2d43" (UID: "d99612d0-3b8a-45e3-963a-930e887c2d43"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:07:07.849728 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.849616    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-certificates\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:07.849970 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.849946    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d99612d0-3b8a-45e3-963a-930e887c2d43-installation-pull-secrets\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:07.850076 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.849978    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d99612d0-3b8a-45e3-963a-930e887c2d43-image-registry-private-configuration\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:07.850076 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.849999    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6djw9\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-kube-api-access-6djw9\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:07.850076 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.850014    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-bound-sa-token\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:07.850076 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.850028    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d99612d0-3b8a-45e3-963a-930e887c2d43-registry-tls\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:07.850076 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.850041    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d99612d0-3b8a-45e3-963a-930e887c2d43-ca-trust-extracted\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:07.850076 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:07.850055    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d99612d0-3b8a-45e3-963a-930e887c2d43-trusted-ca\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:08.227875 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:08.227233    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6p7zh"
Jul 06 19:07:08.452661 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:08.452635    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f45f7699-mfntn"
Jul 06 19:07:08.456911 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:08.455759    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f45f7699-mfntn" event={"ID":"d99612d0-3b8a-45e3-963a-930e887c2d43","Type":"ContainerDied","Data":"3130d8e80868c22b3a54fba083577c1dfee78ffffac0741d897f71646697c0fa"}
Jul 06 19:07:08.465187 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:08.455828    2580 scope.go:117] "RemoveContainer" containerID="4b56973f5e4e877821c82413a5d4fc78abdd50218f55d3a4ee37546b22e9d3a9"
Jul 06 19:07:08.513486 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:08.513449    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59f45f7699-mfntn"]
Jul 06 19:07:08.524187 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:08.524160    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59f45f7699-mfntn"]
Jul 06 19:07:08.851363 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:08.851279    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d99612d0-3b8a-45e3-963a-930e887c2d43" path="/var/lib/kubelet/pods/d99612d0-3b8a-45e3-963a-930e887c2d43/volumes"
Jul 06 19:07:09.091341 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.091306    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68cd8f5b4-hzsdv"]
Jul 06 19:07:09.091824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.091799    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99612d0-3b8a-45e3-963a-930e887c2d43" containerName="registry"
Jul 06 19:07:09.091824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.091820    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99612d0-3b8a-45e3-963a-930e887c2d43" containerName="registry"
Jul 06 19:07:09.091989 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.091902    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d99612d0-3b8a-45e3-963a-930e887c2d43" containerName="registry"
Jul 06 19:07:09.114086 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.114009    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68cd8f5b4-hzsdv"]
Jul 06 19:07:09.114249 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.114128    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.126856 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.126834    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 19:07:09.181866 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.181823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfw5k\" (UniqueName: \"kubernetes.io/projected/534d469f-5894-42f5-aab8-c66068875d47-kube-api-access-gfw5k\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.182047 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.181922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-service-ca\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.182047 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.181951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-oauth-serving-cert\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.182047 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.181976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-console-config\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.182185 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.182080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-trusted-ca-bundle\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.182185 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.182118    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/534d469f-5894-42f5-aab8-c66068875d47-console-oauth-config\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.182185 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.182143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/534d469f-5894-42f5-aab8-c66068875d47-console-serving-cert\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.283566 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.283504    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-service-ca\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.283566 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.283552    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-oauth-serving-cert\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.283855 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.283690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-console-config\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.283855 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.283782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-trusted-ca-bundle\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.283971 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.283816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/534d469f-5894-42f5-aab8-c66068875d47-console-oauth-config\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.284023 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.283983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/534d469f-5894-42f5-aab8-c66068875d47-console-serving-cert\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.284458 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.284427    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-service-ca\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.284458 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.284452    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-console-config\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.284621 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.284547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfw5k\" (UniqueName: \"kubernetes.io/projected/534d469f-5894-42f5-aab8-c66068875d47-kube-api-access-gfw5k\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.284621 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.284611    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-trusted-ca-bundle\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.285084 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.285064    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-oauth-serving-cert\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.287119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.287093    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/534d469f-5894-42f5-aab8-c66068875d47-console-serving-cert\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.287119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.287111    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/534d469f-5894-42f5-aab8-c66068875d47-console-oauth-config\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.293589 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.293563    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfw5k\" (UniqueName: \"kubernetes.io/projected/534d469f-5894-42f5-aab8-c66068875d47-kube-api-access-gfw5k\") pod \"console-68cd8f5b4-hzsdv\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") " pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.426732 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.426676    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:09.458988 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.458950    2580 generic.go:356] "Generic (PLEG): container finished" podID="1ad539c3-a537-43fa-a6a0-abb62021ce68" containerID="906e026ef0858073b89577f492922801d35fe3c1d4e67b76242e96b58815a95b" exitCode=0
Jul 06 19:07:09.459181 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.459041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7628t" event={"ID":"1ad539c3-a537-43fa-a6a0-abb62021ce68","Type":"ContainerDied","Data":"906e026ef0858073b89577f492922801d35fe3c1d4e67b76242e96b58815a95b"}
Jul 06 19:07:09.631622 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:09.631595    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68cd8f5b4-hzsdv"]
Jul 06 19:07:09.635482 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:07:09.635454    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod534d469f_5894_42f5_aab8_c66068875d47.slice/crio-4b8aeb3b8d80edacdea891e89e27fdeaa282b09cf9bebd2b546bec145134acef WatchSource:0}: Error finding container 4b8aeb3b8d80edacdea891e89e27fdeaa282b09cf9bebd2b546bec145134acef: Status 404 returned error can't find the container with id 4b8aeb3b8d80edacdea891e89e27fdeaa282b09cf9bebd2b546bec145134acef
Jul 06 19:07:10.468290 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:10.468166    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68cd8f5b4-hzsdv" event={"ID":"534d469f-5894-42f5-aab8-c66068875d47","Type":"ContainerStarted","Data":"3b1a92d701441ac51cbf114c06d0036e32fd83f0a2fb372a95f889bed1e9859f"}
Jul 06 19:07:10.468290 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:10.468230    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68cd8f5b4-hzsdv" event={"ID":"534d469f-5894-42f5-aab8-c66068875d47","Type":"ContainerStarted","Data":"4b8aeb3b8d80edacdea891e89e27fdeaa282b09cf9bebd2b546bec145134acef"}
Jul 06 19:07:10.470731 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:10.470682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7628t" event={"ID":"1ad539c3-a537-43fa-a6a0-abb62021ce68","Type":"ContainerStarted","Data":"00d0fe9fda17953cab5bf9446fedcc7cf5eb08b58d8d151fc8ed0e72c56bbb0e"}
Jul 06 19:07:10.470859 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:10.470760    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7628t" event={"ID":"1ad539c3-a537-43fa-a6a0-abb62021ce68","Type":"ContainerStarted","Data":"e7672fa938a819d34de896e14adcf6a89a43970244afb2abd838b3a294f7ff2e"}
Jul 06 19:07:10.492353 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:10.492302    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68cd8f5b4-hzsdv" podStartSLOduration=1.492281632 podStartE2EDuration="1.492281632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:10.491951354 +0000 UTC m=+104.102078700" watchObservedRunningTime="2026-07-06 19:07:10.492281632 +0000 UTC m=+104.102408975"
Jul 06 19:07:10.515326 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:10.515259    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7628t" podStartSLOduration=6.587017443 podStartE2EDuration="8.515238169s" totalImagesPullingTime="1.815042599s" totalInitContainerRuntime="113.178127ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:10.513914361 +0000 UTC m=+104.124041744" watchObservedRunningTime="2026-07-06 19:07:10.515238169 +0000 UTC m=+104.125365513"
Jul 06 19:07:13.100823 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:13.100787    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68cd8f5b4-hzsdv"]
Jul 06 19:07:19.427296 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:19.427258    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:29.556183 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:29.556093    2580 generic.go:356] "Generic (PLEG): container finished" podID="ea6c4d57-09e8-4016-9038-69c4d0bd541d" containerID="a261ae795cc611f95dbca824b9187c257cf27d8db9c9d2e4b2e7fd64611a684d" exitCode=0
Jul 06 19:07:29.556183 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:29.556169    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn" event={"ID":"ea6c4d57-09e8-4016-9038-69c4d0bd541d","Type":"ContainerDied","Data":"a261ae795cc611f95dbca824b9187c257cf27d8db9c9d2e4b2e7fd64611a684d"}
Jul 06 19:07:29.556804 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:29.556571    2580 scope.go:117] "RemoveContainer" containerID="a261ae795cc611f95dbca824b9187c257cf27d8db9c9d2e4b2e7fd64611a684d"
Jul 06 19:07:29.557901 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:29.557881    2580 generic.go:356] "Generic (PLEG): container finished" podID="edacf919-3e12-4edd-a878-af1b182a8352" containerID="a12cfc2b939bfefa5be532cdfe3752f55a56ed97ce98c34826cbfb1a3ef51c11" exitCode=0
Jul 06 19:07:29.557986 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:29.557940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt" event={"ID":"edacf919-3e12-4edd-a878-af1b182a8352","Type":"ContainerDied","Data":"a12cfc2b939bfefa5be532cdfe3752f55a56ed97ce98c34826cbfb1a3ef51c11"}
Jul 06 19:07:29.558230 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:29.558217    2580 scope.go:117] "RemoveContainer" containerID="a12cfc2b939bfefa5be532cdfe3752f55a56ed97ce98c34826cbfb1a3ef51c11"
Jul 06 19:07:30.337519 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.337475    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f4cb4984c-6w88d" podUID="764455fc-a5be-46a9-90df-4f2d40cac48f" containerName="console" containerID="cri-o://d02dbc10e8a25347b62a8fe560a64e15aaf7e912b0bb4a409ce52d11272cdf6a" gracePeriod=15
Jul 06 19:07:30.565234 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.565171    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-trvzn" event={"ID":"ea6c4d57-09e8-4016-9038-69c4d0bd541d","Type":"ContainerStarted","Data":"5d29ddab753ff3eb08d137ab80f41639f3aeea5262ab106d403155d6fa3a86e5"}
Jul 06 19:07:30.567255 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.567222    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tnsxt" event={"ID":"edacf919-3e12-4edd-a878-af1b182a8352","Type":"ContainerStarted","Data":"0775fea05e7360e2f89dc57d74ed12dbbdad08f329acbcbeb72b0d3e455871ab"}
Jul 06 19:07:30.569183 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.569158    2580 generic.go:356] "Generic (PLEG): container finished" podID="764455fc-a5be-46a9-90df-4f2d40cac48f" containerID="d02dbc10e8a25347b62a8fe560a64e15aaf7e912b0bb4a409ce52d11272cdf6a" exitCode=0
Jul 06 19:07:30.569328 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.569240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4cb4984c-6w88d" event={"ID":"764455fc-a5be-46a9-90df-4f2d40cac48f","Type":"ContainerDied","Data":"d02dbc10e8a25347b62a8fe560a64e15aaf7e912b0bb4a409ce52d11272cdf6a"}
Jul 06 19:07:30.631099 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.631070    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:07:30.783228 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.783195    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-service-ca\") pod \"764455fc-a5be-46a9-90df-4f2d40cac48f\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") "
Jul 06 19:07:30.783228 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.783231    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-console-config\") pod \"764455fc-a5be-46a9-90df-4f2d40cac48f\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") "
Jul 06 19:07:30.783467 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.783265    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/764455fc-a5be-46a9-90df-4f2d40cac48f-console-serving-cert\") pod \"764455fc-a5be-46a9-90df-4f2d40cac48f\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") "
Jul 06 19:07:30.783467 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.783301    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxbfq\" (UniqueName: \"kubernetes.io/projected/764455fc-a5be-46a9-90df-4f2d40cac48f-kube-api-access-pxbfq\") pod \"764455fc-a5be-46a9-90df-4f2d40cac48f\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") "
Jul 06 19:07:30.783467 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.783349    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-oauth-serving-cert\") pod \"764455fc-a5be-46a9-90df-4f2d40cac48f\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") "
Jul 06 19:07:30.783467 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.783387    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/764455fc-a5be-46a9-90df-4f2d40cac48f-console-oauth-config\") pod \"764455fc-a5be-46a9-90df-4f2d40cac48f\" (UID: \"764455fc-a5be-46a9-90df-4f2d40cac48f\") "
Jul 06 19:07:30.783791 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.783763    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-service-ca" (OuterVolumeSpecName: "service-ca") pod "764455fc-a5be-46a9-90df-4f2d40cac48f" (UID: "764455fc-a5be-46a9-90df-4f2d40cac48f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:07:30.783791 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.783779    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-console-config" (OuterVolumeSpecName: "console-config") pod "764455fc-a5be-46a9-90df-4f2d40cac48f" (UID: "764455fc-a5be-46a9-90df-4f2d40cac48f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:07:30.783953 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.783906    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "764455fc-a5be-46a9-90df-4f2d40cac48f" (UID: "764455fc-a5be-46a9-90df-4f2d40cac48f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:07:30.785566 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.785541    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/764455fc-a5be-46a9-90df-4f2d40cac48f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "764455fc-a5be-46a9-90df-4f2d40cac48f" (UID: "764455fc-a5be-46a9-90df-4f2d40cac48f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:07:30.785666 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.785644    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/764455fc-a5be-46a9-90df-4f2d40cac48f-kube-api-access-pxbfq" (OuterVolumeSpecName: "kube-api-access-pxbfq") pod "764455fc-a5be-46a9-90df-4f2d40cac48f" (UID: "764455fc-a5be-46a9-90df-4f2d40cac48f"). InnerVolumeSpecName "kube-api-access-pxbfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:07:30.785739 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.785652    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/764455fc-a5be-46a9-90df-4f2d40cac48f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "764455fc-a5be-46a9-90df-4f2d40cac48f" (UID: "764455fc-a5be-46a9-90df-4f2d40cac48f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:07:30.884785 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.884751    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-service-ca\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:30.884785 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.884779    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-console-config\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:30.884785 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.884789    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/764455fc-a5be-46a9-90df-4f2d40cac48f-console-serving-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:30.884994 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.884799    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxbfq\" (UniqueName: \"kubernetes.io/projected/764455fc-a5be-46a9-90df-4f2d40cac48f-kube-api-access-pxbfq\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:30.884994 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.884809    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/764455fc-a5be-46a9-90df-4f2d40cac48f-oauth-serving-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:30.884994 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:30.884817    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/764455fc-a5be-46a9-90df-4f2d40cac48f-console-oauth-config\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:31.574502 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:31.574459    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4cb4984c-6w88d" event={"ID":"764455fc-a5be-46a9-90df-4f2d40cac48f","Type":"ContainerDied","Data":"2428e50c30f8377437ee4ee178c4a22eed85b4913d180d6316f9dda51fd721c2"}
Jul 06 19:07:31.574502 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:31.574499    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4cb4984c-6w88d"
Jul 06 19:07:31.575008 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:31.574528    2580 scope.go:117] "RemoveContainer" containerID="d02dbc10e8a25347b62a8fe560a64e15aaf7e912b0bb4a409ce52d11272cdf6a"
Jul 06 19:07:31.591112 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:31.591089    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f4cb4984c-6w88d"]
Jul 06 19:07:31.596837 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:31.596813    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f4cb4984c-6w88d"]
Jul 06 19:07:32.242063 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.242021    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5" podUID="91599e02-80f3-41c5-a673-7d8f682d349f" containerName="registry" containerID="cri-o://5c9468474676db433863435e70070a061f6377dc164d74b7e6377d1dee36d0ec" gracePeriod=30
Jul 06 19:07:32.514055 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.513982    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:07:32.580208 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.580170    2580 generic.go:356] "Generic (PLEG): container finished" podID="91599e02-80f3-41c5-a673-7d8f682d349f" containerID="5c9468474676db433863435e70070a061f6377dc164d74b7e6377d1dee36d0ec" exitCode=0
Jul 06 19:07:32.580614 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.580219    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5"
Jul 06 19:07:32.580614 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.580258    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5" event={"ID":"91599e02-80f3-41c5-a673-7d8f682d349f","Type":"ContainerDied","Data":"5c9468474676db433863435e70070a061f6377dc164d74b7e6377d1dee36d0ec"}
Jul 06 19:07:32.580614 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.580314    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75b9c54f4d-xnlq5" event={"ID":"91599e02-80f3-41c5-a673-7d8f682d349f","Type":"ContainerDied","Data":"df2192eebad2afdb315f5dee4948695fbb4de9b3b32d5c5f43f03cdc99767b53"}
Jul 06 19:07:32.580614 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.580336    2580 scope.go:117] "RemoveContainer" containerID="5c9468474676db433863435e70070a061f6377dc164d74b7e6377d1dee36d0ec"
Jul 06 19:07:32.588370 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.588353    2580 scope.go:117] "RemoveContainer" containerID="5c9468474676db433863435e70070a061f6377dc164d74b7e6377d1dee36d0ec"
Jul 06 19:07:32.588610 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:07:32.588591    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c9468474676db433863435e70070a061f6377dc164d74b7e6377d1dee36d0ec\": container with ID starting with 5c9468474676db433863435e70070a061f6377dc164d74b7e6377d1dee36d0ec not found: ID does not exist" containerID="5c9468474676db433863435e70070a061f6377dc164d74b7e6377d1dee36d0ec"
Jul 06 19:07:32.588655 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.588618    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c9468474676db433863435e70070a061f6377dc164d74b7e6377d1dee36d0ec"} err="failed to get container status \"5c9468474676db433863435e70070a061f6377dc164d74b7e6377d1dee36d0ec\": rpc error: code = NotFound desc = could not find container \"5c9468474676db433863435e70070a061f6377dc164d74b7e6377d1dee36d0ec\": container with ID starting with 5c9468474676db433863435e70070a061f6377dc164d74b7e6377d1dee36d0ec not found: ID does not exist"
Jul 06 19:07:32.600053 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.600033    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91599e02-80f3-41c5-a673-7d8f682d349f-registry-certificates\") pod \"91599e02-80f3-41c5-a673-7d8f682d349f\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") "
Jul 06 19:07:32.600140 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.600070    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4c8t\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-kube-api-access-b4c8t\") pod \"91599e02-80f3-41c5-a673-7d8f682d349f\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") "
Jul 06 19:07:32.600140 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.600105    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91599e02-80f3-41c5-a673-7d8f682d349f-ca-trust-extracted\") pod \"91599e02-80f3-41c5-a673-7d8f682d349f\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") "
Jul 06 19:07:32.600226 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.600138    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls\") pod \"91599e02-80f3-41c5-a673-7d8f682d349f\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") "
Jul 06 19:07:32.600226 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.600164    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-bound-sa-token\") pod \"91599e02-80f3-41c5-a673-7d8f682d349f\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") "
Jul 06 19:07:32.600226 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.600192    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91599e02-80f3-41c5-a673-7d8f682d349f-installation-pull-secrets\") pod \"91599e02-80f3-41c5-a673-7d8f682d349f\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") "
Jul 06 19:07:32.600360 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.600238    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91599e02-80f3-41c5-a673-7d8f682d349f-trusted-ca\") pod \"91599e02-80f3-41c5-a673-7d8f682d349f\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") "
Jul 06 19:07:32.600360 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.600278    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91599e02-80f3-41c5-a673-7d8f682d349f-image-registry-private-configuration\") pod \"91599e02-80f3-41c5-a673-7d8f682d349f\" (UID: \"91599e02-80f3-41c5-a673-7d8f682d349f\") "
Jul 06 19:07:32.600481 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.600459    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91599e02-80f3-41c5-a673-7d8f682d349f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "91599e02-80f3-41c5-a673-7d8f682d349f" (UID: "91599e02-80f3-41c5-a673-7d8f682d349f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:07:32.600558 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.600540    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/91599e02-80f3-41c5-a673-7d8f682d349f-registry-certificates\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:32.600911 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.600884    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91599e02-80f3-41c5-a673-7d8f682d349f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "91599e02-80f3-41c5-a673-7d8f682d349f" (UID: "91599e02-80f3-41c5-a673-7d8f682d349f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:07:32.602643 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.602620    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "91599e02-80f3-41c5-a673-7d8f682d349f" (UID: "91599e02-80f3-41c5-a673-7d8f682d349f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:07:32.602795 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.602724    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91599e02-80f3-41c5-a673-7d8f682d349f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "91599e02-80f3-41c5-a673-7d8f682d349f" (UID: "91599e02-80f3-41c5-a673-7d8f682d349f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:07:32.602869 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.602813    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "91599e02-80f3-41c5-a673-7d8f682d349f" (UID: "91599e02-80f3-41c5-a673-7d8f682d349f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:07:32.603025 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.603005    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-kube-api-access-b4c8t" (OuterVolumeSpecName: "kube-api-access-b4c8t") pod "91599e02-80f3-41c5-a673-7d8f682d349f" (UID: "91599e02-80f3-41c5-a673-7d8f682d349f"). InnerVolumeSpecName "kube-api-access-b4c8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:07:32.603088 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.603024    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91599e02-80f3-41c5-a673-7d8f682d349f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "91599e02-80f3-41c5-a673-7d8f682d349f" (UID: "91599e02-80f3-41c5-a673-7d8f682d349f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:07:32.608688 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.608663    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91599e02-80f3-41c5-a673-7d8f682d349f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "91599e02-80f3-41c5-a673-7d8f682d349f" (UID: "91599e02-80f3-41c5-a673-7d8f682d349f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:07:32.701869 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.701829    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/91599e02-80f3-41c5-a673-7d8f682d349f-image-registry-private-configuration\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:32.701869 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.701862    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4c8t\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-kube-api-access-b4c8t\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:32.701869 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.701875    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/91599e02-80f3-41c5-a673-7d8f682d349f-ca-trust-extracted\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:32.702102 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.701887    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-registry-tls\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:32.702102 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.701899    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91599e02-80f3-41c5-a673-7d8f682d349f-bound-sa-token\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:32.702102 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.701910    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/91599e02-80f3-41c5-a673-7d8f682d349f-installation-pull-secrets\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:32.702102 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.701921    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/91599e02-80f3-41c5-a673-7d8f682d349f-trusted-ca\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:32.850031 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.849946    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="764455fc-a5be-46a9-90df-4f2d40cac48f" path="/var/lib/kubelet/pods/764455fc-a5be-46a9-90df-4f2d40cac48f/volumes"
Jul 06 19:07:32.898803 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.898764    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75b9c54f4d-xnlq5"]
Jul 06 19:07:32.903385 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:32.903357    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75b9c54f4d-xnlq5"]
Jul 06 19:07:34.594558 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:34.594517    2580 generic.go:356] "Generic (PLEG): container finished" podID="db1034da-81bf-4b9b-a83d-cda34d16176b" containerID="62ebc98e1c5d0beda32a4de58df5df82afd8ebc0ee2c172c31166f0a3007fcf4" exitCode=0
Jul 06 19:07:34.595020 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:34.594591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b" event={"ID":"db1034da-81bf-4b9b-a83d-cda34d16176b","Type":"ContainerDied","Data":"62ebc98e1c5d0beda32a4de58df5df82afd8ebc0ee2c172c31166f0a3007fcf4"}
Jul 06 19:07:34.595020 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:34.594951    2580 scope.go:117] "RemoveContainer" containerID="62ebc98e1c5d0beda32a4de58df5df82afd8ebc0ee2c172c31166f0a3007fcf4"
Jul 06 19:07:34.850827 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:34.850734    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91599e02-80f3-41c5-a673-7d8f682d349f" path="/var/lib/kubelet/pods/91599e02-80f3-41c5-a673-7d8f682d349f/volumes"
Jul 06 19:07:35.601035 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:35.600987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jrn5b" event={"ID":"db1034da-81bf-4b9b-a83d-cda34d16176b","Type":"ContainerStarted","Data":"54f0e10d2c72a64a6ea6ce751b65275c9de463cf92251ad2f5e02719c6938842"}
Jul 06 19:07:38.128565 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.128525    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-68cd8f5b4-hzsdv" podUID="534d469f-5894-42f5-aab8-c66068875d47" containerName="console" containerID="cri-o://3b1a92d701441ac51cbf114c06d0036e32fd83f0a2fb372a95f889bed1e9859f" gracePeriod=15
Jul 06 19:07:38.419977 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.419943    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:38.451690 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.451659    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfw5k\" (UniqueName: \"kubernetes.io/projected/534d469f-5894-42f5-aab8-c66068875d47-kube-api-access-gfw5k\") pod \"534d469f-5894-42f5-aab8-c66068875d47\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") "
Jul 06 19:07:38.451882 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.451752    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/534d469f-5894-42f5-aab8-c66068875d47-console-oauth-config\") pod \"534d469f-5894-42f5-aab8-c66068875d47\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") "
Jul 06 19:07:38.451882 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.451785    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-service-ca\") pod \"534d469f-5894-42f5-aab8-c66068875d47\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") "
Jul 06 19:07:38.451882 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.451823    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-trusted-ca-bundle\") pod \"534d469f-5894-42f5-aab8-c66068875d47\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") "
Jul 06 19:07:38.451882 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.451853    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-oauth-serving-cert\") pod \"534d469f-5894-42f5-aab8-c66068875d47\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") "
Jul 06 19:07:38.451882 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.451878    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-console-config\") pod \"534d469f-5894-42f5-aab8-c66068875d47\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") "
Jul 06 19:07:38.452159 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.451918    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/534d469f-5894-42f5-aab8-c66068875d47-console-serving-cert\") pod \"534d469f-5894-42f5-aab8-c66068875d47\" (UID: \"534d469f-5894-42f5-aab8-c66068875d47\") "
Jul 06 19:07:38.452434 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.452393    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-console-config" (OuterVolumeSpecName: "console-config") pod "534d469f-5894-42f5-aab8-c66068875d47" (UID: "534d469f-5894-42f5-aab8-c66068875d47"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:07:38.452434 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.452401    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "534d469f-5894-42f5-aab8-c66068875d47" (UID: "534d469f-5894-42f5-aab8-c66068875d47"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:07:38.452918 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.452887    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "534d469f-5894-42f5-aab8-c66068875d47" (UID: "534d469f-5894-42f5-aab8-c66068875d47"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:07:38.453072 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.453052    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-service-ca" (OuterVolumeSpecName: "service-ca") pod "534d469f-5894-42f5-aab8-c66068875d47" (UID: "534d469f-5894-42f5-aab8-c66068875d47"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:07:38.454347 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.454314    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/534d469f-5894-42f5-aab8-c66068875d47-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "534d469f-5894-42f5-aab8-c66068875d47" (UID: "534d469f-5894-42f5-aab8-c66068875d47"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:07:38.454437 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.454401    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/534d469f-5894-42f5-aab8-c66068875d47-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "534d469f-5894-42f5-aab8-c66068875d47" (UID: "534d469f-5894-42f5-aab8-c66068875d47"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:07:38.454437 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.454420    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/534d469f-5894-42f5-aab8-c66068875d47-kube-api-access-gfw5k" (OuterVolumeSpecName: "kube-api-access-gfw5k") pod "534d469f-5894-42f5-aab8-c66068875d47" (UID: "534d469f-5894-42f5-aab8-c66068875d47"). InnerVolumeSpecName "kube-api-access-gfw5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:07:38.557458 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.553185    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/534d469f-5894-42f5-aab8-c66068875d47-console-oauth-config\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:38.557458 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.553241    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-service-ca\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:38.557458 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.553258    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-trusted-ca-bundle\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:38.557458 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.553327    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-oauth-serving-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:38.557458 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.553355    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/534d469f-5894-42f5-aab8-c66068875d47-console-config\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:38.557458 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.553372    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/534d469f-5894-42f5-aab8-c66068875d47-console-serving-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:38.557458 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.553395    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfw5k\" (UniqueName: \"kubernetes.io/projected/534d469f-5894-42f5-aab8-c66068875d47-kube-api-access-gfw5k\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:07:38.614666 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.614630    2580 generic.go:356] "Generic (PLEG): container finished" podID="534d469f-5894-42f5-aab8-c66068875d47" containerID="3b1a92d701441ac51cbf114c06d0036e32fd83f0a2fb372a95f889bed1e9859f" exitCode=0
Jul 06 19:07:38.614844 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.614691    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68cd8f5b4-hzsdv"
Jul 06 19:07:38.614844 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.614739    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68cd8f5b4-hzsdv" event={"ID":"534d469f-5894-42f5-aab8-c66068875d47","Type":"ContainerDied","Data":"3b1a92d701441ac51cbf114c06d0036e32fd83f0a2fb372a95f889bed1e9859f"}
Jul 06 19:07:38.614844 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.614816    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68cd8f5b4-hzsdv" event={"ID":"534d469f-5894-42f5-aab8-c66068875d47","Type":"ContainerDied","Data":"4b8aeb3b8d80edacdea891e89e27fdeaa282b09cf9bebd2b546bec145134acef"}
Jul 06 19:07:38.614844 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.614835    2580 scope.go:117] "RemoveContainer" containerID="3b1a92d701441ac51cbf114c06d0036e32fd83f0a2fb372a95f889bed1e9859f"
Jul 06 19:07:38.623225 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.623210    2580 scope.go:117] "RemoveContainer" containerID="3b1a92d701441ac51cbf114c06d0036e32fd83f0a2fb372a95f889bed1e9859f"
Jul 06 19:07:38.623496 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:07:38.623475    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b1a92d701441ac51cbf114c06d0036e32fd83f0a2fb372a95f889bed1e9859f\": container with ID starting with 3b1a92d701441ac51cbf114c06d0036e32fd83f0a2fb372a95f889bed1e9859f not found: ID does not exist" containerID="3b1a92d701441ac51cbf114c06d0036e32fd83f0a2fb372a95f889bed1e9859f"
Jul 06 19:07:38.623549 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.623504    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b1a92d701441ac51cbf114c06d0036e32fd83f0a2fb372a95f889bed1e9859f"} err="failed to get container status \"3b1a92d701441ac51cbf114c06d0036e32fd83f0a2fb372a95f889bed1e9859f\": rpc error: code = NotFound desc = could not find container \"3b1a92d701441ac51cbf114c06d0036e32fd83f0a2fb372a95f889bed1e9859f\": container with ID starting with 3b1a92d701441ac51cbf114c06d0036e32fd83f0a2fb372a95f889bed1e9859f not found: ID does not exist"
Jul 06 19:07:38.636169 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.636116    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68cd8f5b4-hzsdv"]
Jul 06 19:07:38.640219 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.640201    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68cd8f5b4-hzsdv"]
Jul 06 19:07:38.849993 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:07:38.849955    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="534d469f-5894-42f5-aab8-c66068875d47" path="/var/lib/kubelet/pods/534d469f-5894-42f5-aab8-c66068875d47/volumes"
Jul 06 19:10:17.619907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.619867    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"]
Jul 06 19:10:17.620331 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.620175    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="764455fc-a5be-46a9-90df-4f2d40cac48f" containerName="console"
Jul 06 19:10:17.620331 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.620186    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="764455fc-a5be-46a9-90df-4f2d40cac48f" containerName="console"
Jul 06 19:10:17.620331 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.620196    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="534d469f-5894-42f5-aab8-c66068875d47" containerName="console"
Jul 06 19:10:17.620331 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.620201    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="534d469f-5894-42f5-aab8-c66068875d47" containerName="console"
Jul 06 19:10:17.620331 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.620212    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91599e02-80f3-41c5-a673-7d8f682d349f" containerName="registry"
Jul 06 19:10:17.620331 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.620217    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="91599e02-80f3-41c5-a673-7d8f682d349f" containerName="registry"
Jul 06 19:10:17.620331 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.620270    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="91599e02-80f3-41c5-a673-7d8f682d349f" containerName="registry"
Jul 06 19:10:17.620331 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.620279    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="764455fc-a5be-46a9-90df-4f2d40cac48f" containerName="console"
Jul 06 19:10:17.620331 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.620285    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="534d469f-5894-42f5-aab8-c66068875d47" containerName="console"
Jul 06 19:10:17.622110 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.622087    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.624481 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.624458    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:10:17.624575 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.624458    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 19:10:17.624575 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.624551    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-59vkn\""
Jul 06 19:10:17.625033 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.625018    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:10:17.625529 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.625515    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:10:17.642902 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.642855    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"]
Jul 06 19:10:17.716258 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.716217    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tllwx\" (UniqueName: \"kubernetes.io/projected/8f456dc1-980a-441d-a042-d60e52953bbd-kube-api-access-tllwx\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.716258 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.716259    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f456dc1-980a-441d-a042-d60e52953bbd-tmp\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.716489 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.716281    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8f456dc1-980a-441d-a042-d60e52953bbd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.716489 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.716367    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8f456dc1-980a-441d-a042-d60e52953bbd-manifests\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.716489 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.716407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8f456dc1-980a-441d-a042-d60e52953bbd-webhook-cert\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.817703 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.817668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tllwx\" (UniqueName: \"kubernetes.io/projected/8f456dc1-980a-441d-a042-d60e52953bbd-kube-api-access-tllwx\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.817909 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.817756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f456dc1-980a-441d-a042-d60e52953bbd-tmp\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.817909 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.817789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8f456dc1-980a-441d-a042-d60e52953bbd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.817909 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.817810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8f456dc1-980a-441d-a042-d60e52953bbd-manifests\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.817909 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.817829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8f456dc1-980a-441d-a042-d60e52953bbd-webhook-cert\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.818270 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.818247    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8f456dc1-980a-441d-a042-d60e52953bbd-manifests\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.820077 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.820043    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f456dc1-980a-441d-a042-d60e52953bbd-tmp\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.820270 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.820253    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8f456dc1-980a-441d-a042-d60e52953bbd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.820316 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.820296    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8f456dc1-980a-441d-a042-d60e52953bbd-webhook-cert\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.830896 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.830871    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tllwx\" (UniqueName: \"kubernetes.io/projected/8f456dc1-980a-441d-a042-d60e52953bbd-kube-api-access-tllwx\") pod \"opendatahub-operator-controller-manager-7598fdd968-z8d6m\" (UID: \"8f456dc1-980a-441d-a042-d60e52953bbd\") " pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:17.931955 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:17.931921    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:18.071839 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:18.071808    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"]
Jul 06 19:10:18.075041 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:10:18.075013    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f456dc1_980a_441d_a042_d60e52953bbd.slice/crio-930299dea01cfa24550cc5ab17a49cff0a7ca304b1b5562490c2277e4eea376b WatchSource:0}: Error finding container 930299dea01cfa24550cc5ab17a49cff0a7ca304b1b5562490c2277e4eea376b: Status 404 returned error can't find the container with id 930299dea01cfa24550cc5ab17a49cff0a7ca304b1b5562490c2277e4eea376b
Jul 06 19:10:18.236254 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:18.236168    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m" event={"ID":"8f456dc1-980a-441d-a042-d60e52953bbd","Type":"ContainerStarted","Data":"930299dea01cfa24550cc5ab17a49cff0a7ca304b1b5562490c2277e4eea376b"}
Jul 06 19:10:21.251796 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:21.251761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m" event={"ID":"8f456dc1-980a-441d-a042-d60e52953bbd","Type":"ContainerStarted","Data":"4b81f3379898ef126e86f0d72668877126eed102527e2c9b54cd271e5322d4c2"}
Jul 06 19:10:22.257303 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:22.257273    2580 generic.go:356] "Generic (PLEG): container finished" podID="8f456dc1-980a-441d-a042-d60e52953bbd" containerID="4b81f3379898ef126e86f0d72668877126eed102527e2c9b54cd271e5322d4c2" exitCode=0
Jul 06 19:10:22.257615 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:22.257354    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m" event={"ID":"8f456dc1-980a-441d-a042-d60e52953bbd","Type":"ContainerDied","Data":"4b81f3379898ef126e86f0d72668877126eed102527e2c9b54cd271e5322d4c2"}
Jul 06 19:10:23.264955 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:23.264919    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m" event={"ID":"8f456dc1-980a-441d-a042-d60e52953bbd","Type":"ContainerStarted","Data":"39f142044986cc30ff664e11cfa955f15498a8a39d206d2368d1e4c220c61f7d"}
Jul 06 19:10:23.265339 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:23.265063    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:23.288547 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:23.288495    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m" podStartSLOduration=1.877004299 podStartE2EDuration="6.288476288s" totalImagesPullingTime="3.314472579s" totalInitContainerRuntime="1.09699941s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:23.286906772 +0000 UTC m=+296.897034115" watchObservedRunningTime="2026-07-06 19:10:23.288476288 +0000 UTC m=+296.898603633"
Jul 06 19:10:26.749271 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:26.749211    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:10:26.749905 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:26.749861    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:10:26.762280 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:26.762257    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 19:10:34.271947 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:34.271910    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7598fdd968-z8d6m"
Jul 06 19:10:46.362112 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.362080    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"]
Jul 06 19:10:46.364383 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.364361    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:46.368036 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.367912    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 19:10:46.368036 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.367912    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:10:46.368036 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.367957    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 19:10:46.368036 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.368004    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vt22n\""
Jul 06 19:10:46.368376 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.367961    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 19:10:46.368376 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.367961    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 19:10:46.379848 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.379824    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"]
Jul 06 19:10:46.459779 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.459747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0797986c-3316-4a03-8c9b-fb6806f72d1a-manager-config\") pod \"lws-controller-manager-5d97cd6788-p2qqr\" (UID: \"0797986c-3316-4a03-8c9b-fb6806f72d1a\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:46.459779 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.459782    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0797986c-3316-4a03-8c9b-fb6806f72d1a-metrics-cert\") pod \"lws-controller-manager-5d97cd6788-p2qqr\" (UID: \"0797986c-3316-4a03-8c9b-fb6806f72d1a\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:46.459987 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.459871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0797986c-3316-4a03-8c9b-fb6806f72d1a-cert\") pod \"lws-controller-manager-5d97cd6788-p2qqr\" (UID: \"0797986c-3316-4a03-8c9b-fb6806f72d1a\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:46.459987 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.459889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbb2n\" (UniqueName: \"kubernetes.io/projected/0797986c-3316-4a03-8c9b-fb6806f72d1a-kube-api-access-fbb2n\") pod \"lws-controller-manager-5d97cd6788-p2qqr\" (UID: \"0797986c-3316-4a03-8c9b-fb6806f72d1a\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:46.560768 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.560734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0797986c-3316-4a03-8c9b-fb6806f72d1a-manager-config\") pod \"lws-controller-manager-5d97cd6788-p2qqr\" (UID: \"0797986c-3316-4a03-8c9b-fb6806f72d1a\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:46.560768 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.560770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0797986c-3316-4a03-8c9b-fb6806f72d1a-metrics-cert\") pod \"lws-controller-manager-5d97cd6788-p2qqr\" (UID: \"0797986c-3316-4a03-8c9b-fb6806f72d1a\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:46.561020 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.560825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0797986c-3316-4a03-8c9b-fb6806f72d1a-cert\") pod \"lws-controller-manager-5d97cd6788-p2qqr\" (UID: \"0797986c-3316-4a03-8c9b-fb6806f72d1a\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:46.561020 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.560842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbb2n\" (UniqueName: \"kubernetes.io/projected/0797986c-3316-4a03-8c9b-fb6806f72d1a-kube-api-access-fbb2n\") pod \"lws-controller-manager-5d97cd6788-p2qqr\" (UID: \"0797986c-3316-4a03-8c9b-fb6806f72d1a\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:46.561456 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.561434    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0797986c-3316-4a03-8c9b-fb6806f72d1a-manager-config\") pod \"lws-controller-manager-5d97cd6788-p2qqr\" (UID: \"0797986c-3316-4a03-8c9b-fb6806f72d1a\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:46.563254 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.563224    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0797986c-3316-4a03-8c9b-fb6806f72d1a-metrics-cert\") pod \"lws-controller-manager-5d97cd6788-p2qqr\" (UID: \"0797986c-3316-4a03-8c9b-fb6806f72d1a\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:46.563408 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.563386    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0797986c-3316-4a03-8c9b-fb6806f72d1a-cert\") pod \"lws-controller-manager-5d97cd6788-p2qqr\" (UID: \"0797986c-3316-4a03-8c9b-fb6806f72d1a\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:46.570529 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.570501    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbb2n\" (UniqueName: \"kubernetes.io/projected/0797986c-3316-4a03-8c9b-fb6806f72d1a-kube-api-access-fbb2n\") pod \"lws-controller-manager-5d97cd6788-p2qqr\" (UID: \"0797986c-3316-4a03-8c9b-fb6806f72d1a\") " pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:46.673817 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.673784    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:46.833160 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.833135    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"]
Jul 06 19:10:46.835213 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:10:46.835173    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0797986c_3316_4a03_8c9b_fb6806f72d1a.slice/crio-e953ecbf7ab8207fe74aae62e96853b961fcc9bd8aa4819bd476db463e5d68c1 WatchSource:0}: Error finding container e953ecbf7ab8207fe74aae62e96853b961fcc9bd8aa4819bd476db463e5d68c1: Status 404 returned error can't find the container with id e953ecbf7ab8207fe74aae62e96853b961fcc9bd8aa4819bd476db463e5d68c1
Jul 06 19:10:46.837037 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:46.837020    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:10:47.365002 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:47.364962    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr" event={"ID":"0797986c-3316-4a03-8c9b-fb6806f72d1a","Type":"ContainerStarted","Data":"e953ecbf7ab8207fe74aae62e96853b961fcc9bd8aa4819bd476db463e5d68c1"}
Jul 06 19:10:49.376162 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:49.376118    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr" event={"ID":"0797986c-3316-4a03-8c9b-fb6806f72d1a","Type":"ContainerStarted","Data":"fc37ace481ecf7841b8a3b254a8e9bdc49102aec8c2a85ec29882d7b1390e7c9"}
Jul 06 19:10:49.376606 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:49.376213    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:10:49.407345 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:10:49.407283    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr" podStartSLOduration=1.346859399 podStartE2EDuration="3.407269912s" totalImagesPullingTime="2.060410513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:49.406558988 +0000 UTC m=+323.016686350" watchObservedRunningTime="2026-07-06 19:10:49.407269912 +0000 UTC m=+323.017397256"
Jul 06 19:11:00.382113 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:11:00.382081    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5d97cd6788-p2qqr"
Jul 06 19:12:14.924386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:14.924352    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk22q"]
Jul 06 19:12:14.927558 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:14.927539    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk22q"
Jul 06 19:12:14.931971 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:14.931950    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:12:14.932926 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:14.932903    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 19:12:14.932926 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:14.932920    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-nzjtt\""
Jul 06 19:12:14.933162 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:14.932942    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:12:14.946824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:14.946798    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk22q"]
Jul 06 19:12:14.976392 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:14.976356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnr5l\" (UniqueName: \"kubernetes.io/projected/02297939-99e8-4b70-8d7f-46924827812c-kube-api-access-vnr5l\") pod \"dns-operator-controller-manager-864dd78c4c-mk22q\" (UID: \"02297939-99e8-4b70-8d7f-46924827812c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk22q"
Jul 06 19:12:15.076965 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:15.076926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnr5l\" (UniqueName: \"kubernetes.io/projected/02297939-99e8-4b70-8d7f-46924827812c-kube-api-access-vnr5l\") pod \"dns-operator-controller-manager-864dd78c4c-mk22q\" (UID: \"02297939-99e8-4b70-8d7f-46924827812c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk22q"
Jul 06 19:12:15.088638 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:15.088604    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnr5l\" (UniqueName: \"kubernetes.io/projected/02297939-99e8-4b70-8d7f-46924827812c-kube-api-access-vnr5l\") pod \"dns-operator-controller-manager-864dd78c4c-mk22q\" (UID: \"02297939-99e8-4b70-8d7f-46924827812c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk22q"
Jul 06 19:12:15.237634 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:15.237545    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk22q"
Jul 06 19:12:15.390628 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:15.390595    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk22q"]
Jul 06 19:12:15.393815 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:12:15.393788    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02297939_99e8_4b70_8d7f_46924827812c.slice/crio-32e70ce23bbdeb3630436510bfd9e3fe824c30dd48681aa90744eba7c0e0cc2d WatchSource:0}: Error finding container 32e70ce23bbdeb3630436510bfd9e3fe824c30dd48681aa90744eba7c0e0cc2d: Status 404 returned error can't find the container with id 32e70ce23bbdeb3630436510bfd9e3fe824c30dd48681aa90744eba7c0e0cc2d
Jul 06 19:12:15.737323 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:15.737289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk22q" event={"ID":"02297939-99e8-4b70-8d7f-46924827812c","Type":"ContainerStarted","Data":"32e70ce23bbdeb3630436510bfd9e3fe824c30dd48681aa90744eba7c0e0cc2d"}
Jul 06 19:12:17.294977 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.294946    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dd4f56c7d-mpw2h"]
Jul 06 19:12:17.298159 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.298135    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.309348 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.309281    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 19:12:17.309348 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.309295    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7qvkn\""
Jul 06 19:12:17.309556 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.309294    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 19:12:17.309556 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.309416    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 19:12:17.309664 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.309614    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 19:12:17.309807 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.309781    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 19:12:17.317048 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.317023    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 19:12:17.324318 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.324297    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd4f56c7d-mpw2h"]
Jul 06 19:12:17.399041 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.399003    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/647425a2-d2f1-42bd-859c-b8a4178440f9-console-config\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.399041 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.399042    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t98rk\" (UniqueName: \"kubernetes.io/projected/647425a2-d2f1-42bd-859c-b8a4178440f9-kube-api-access-t98rk\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.399254 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.399070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/647425a2-d2f1-42bd-859c-b8a4178440f9-console-serving-cert\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.399254 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.399120    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/647425a2-d2f1-42bd-859c-b8a4178440f9-service-ca\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.399254 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.399166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/647425a2-d2f1-42bd-859c-b8a4178440f9-console-oauth-config\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.399254 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.399208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/647425a2-d2f1-42bd-859c-b8a4178440f9-trusted-ca-bundle\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.399254 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.399232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/647425a2-d2f1-42bd-859c-b8a4178440f9-oauth-serving-cert\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.500623 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.500528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/647425a2-d2f1-42bd-859c-b8a4178440f9-console-config\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.500623 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.500575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t98rk\" (UniqueName: \"kubernetes.io/projected/647425a2-d2f1-42bd-859c-b8a4178440f9-kube-api-access-t98rk\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.500623 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.500597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/647425a2-d2f1-42bd-859c-b8a4178440f9-console-serving-cert\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.500623 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.500622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/647425a2-d2f1-42bd-859c-b8a4178440f9-service-ca\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.501047 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.500665    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/647425a2-d2f1-42bd-859c-b8a4178440f9-console-oauth-config\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.501047 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.500731    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/647425a2-d2f1-42bd-859c-b8a4178440f9-trusted-ca-bundle\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.501047 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.500763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/647425a2-d2f1-42bd-859c-b8a4178440f9-oauth-serving-cert\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.501476 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.501447    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/647425a2-d2f1-42bd-859c-b8a4178440f9-service-ca\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.501567 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.501473    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/647425a2-d2f1-42bd-859c-b8a4178440f9-console-config\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.501567 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.501513    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/647425a2-d2f1-42bd-859c-b8a4178440f9-oauth-serving-cert\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.501658 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.501634    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/647425a2-d2f1-42bd-859c-b8a4178440f9-trusted-ca-bundle\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.503222 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.503192    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/647425a2-d2f1-42bd-859c-b8a4178440f9-console-serving-cert\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.503325 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.503276    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/647425a2-d2f1-42bd-859c-b8a4178440f9-console-oauth-config\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.515166 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.515140    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t98rk\" (UniqueName: \"kubernetes.io/projected/647425a2-d2f1-42bd-859c-b8a4178440f9-kube-api-access-t98rk\") pod \"console-7dd4f56c7d-mpw2h\" (UID: \"647425a2-d2f1-42bd-859c-b8a4178440f9\") " pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.607097 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.607059    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:17.747625 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.747592    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk22q" event={"ID":"02297939-99e8-4b70-8d7f-46924827812c","Type":"ContainerStarted","Data":"5450f492771675fb8e18a3891644a44a2c945900e13d7f20fd5d406e185cc8f2"}
Jul 06 19:12:17.747831 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.747655    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk22q"
Jul 06 19:12:17.766768 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.766743    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd4f56c7d-mpw2h"]
Jul 06 19:12:17.768724 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:12:17.768689    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647425a2_d2f1_42bd_859c_b8a4178440f9.slice/crio-da07578b799ab7532ea5d88221bf47a9248dccd2dcf9d2a3dee61014210a8294 WatchSource:0}: Error finding container da07578b799ab7532ea5d88221bf47a9248dccd2dcf9d2a3dee61014210a8294: Status 404 returned error can't find the container with id da07578b799ab7532ea5d88221bf47a9248dccd2dcf9d2a3dee61014210a8294
Jul 06 19:12:17.795373 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:17.795316    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk22q" podStartSLOduration=1.99395233 podStartE2EDuration="3.79529941s" totalImagesPullingTime="1.80134708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:12:17.794521475 +0000 UTC m=+411.404648836" watchObservedRunningTime="2026-07-06 19:12:17.79529941 +0000 UTC m=+411.405426743"
Jul 06 19:12:18.756125 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:18.756093    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd4f56c7d-mpw2h" event={"ID":"647425a2-d2f1-42bd-859c-b8a4178440f9","Type":"ContainerStarted","Data":"e408068ee7f0acab794d487248b05ec359fc464e398fd354dddbaffc5994eb0e"}
Jul 06 19:12:18.756528 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:18.756180    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd4f56c7d-mpw2h" event={"ID":"647425a2-d2f1-42bd-859c-b8a4178440f9","Type":"ContainerStarted","Data":"da07578b799ab7532ea5d88221bf47a9248dccd2dcf9d2a3dee61014210a8294"}
Jul 06 19:12:18.775842 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:18.775779    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dd4f56c7d-mpw2h" podStartSLOduration=1.7757647410000001 podStartE2EDuration="1.775764741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:12:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:12:18.774424361 +0000 UTC m=+412.384551708" watchObservedRunningTime="2026-07-06 19:12:18.775764741 +0000 UTC m=+412.385892084"
Jul 06 19:12:27.607394 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:27.607350    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:27.607878 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:27.607409    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:27.612308 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:27.612278    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:27.796863 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:27.796834    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dd4f56c7d-mpw2h"
Jul 06 19:12:28.759306 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:28.759274    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk22q"
Jul 06 19:12:32.752322 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:32.752282    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"]
Jul 06 19:12:32.755797 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:32.755779    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:32.758654 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:32.758632    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vpnh8\""
Jul 06 19:12:32.770548 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:32.770523    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"]
Jul 06 19:12:32.837760 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:32.837696    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab0560c2-22b3-49e6-b46f-5a2e0789b719-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm4nj\" (UID: \"ab0560c2-22b3-49e6-b46f-5a2e0789b719\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:32.837969 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:32.837890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfzgl\" (UniqueName: \"kubernetes.io/projected/ab0560c2-22b3-49e6-b46f-5a2e0789b719-kube-api-access-mfzgl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm4nj\" (UID: \"ab0560c2-22b3-49e6-b46f-5a2e0789b719\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:32.939317 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:32.939272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfzgl\" (UniqueName: \"kubernetes.io/projected/ab0560c2-22b3-49e6-b46f-5a2e0789b719-kube-api-access-mfzgl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm4nj\" (UID: \"ab0560c2-22b3-49e6-b46f-5a2e0789b719\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:32.939501 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:32.939348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab0560c2-22b3-49e6-b46f-5a2e0789b719-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm4nj\" (UID: \"ab0560c2-22b3-49e6-b46f-5a2e0789b719\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:32.939756 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:32.939736    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab0560c2-22b3-49e6-b46f-5a2e0789b719-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm4nj\" (UID: \"ab0560c2-22b3-49e6-b46f-5a2e0789b719\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:32.952184 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:32.952150    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfzgl\" (UniqueName: \"kubernetes.io/projected/ab0560c2-22b3-49e6-b46f-5a2e0789b719-kube-api-access-mfzgl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qm4nj\" (UID: \"ab0560c2-22b3-49e6-b46f-5a2e0789b719\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:33.066744 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:33.066606    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:33.208477 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:33.208427    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"]
Jul 06 19:12:33.210643 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:12:33.210608    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0560c2_22b3_49e6_b46f_5a2e0789b719.slice/crio-6b406292fcb321927cd6c3e2538d33358c63dca4e478395fb3bea7fa9a2264ff WatchSource:0}: Error finding container 6b406292fcb321927cd6c3e2538d33358c63dca4e478395fb3bea7fa9a2264ff: Status 404 returned error can't find the container with id 6b406292fcb321927cd6c3e2538d33358c63dca4e478395fb3bea7fa9a2264ff
Jul 06 19:12:33.373888 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:33.373790    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"]
Jul 06 19:12:33.382089 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:33.382059    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"]
Jul 06 19:12:33.415474 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:33.415442    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"]
Jul 06 19:12:33.419701 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:33.419680    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"
Jul 06 19:12:33.438490 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:33.438457    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"]
Jul 06 19:12:33.545891 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:33.545853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5njdf\" (UniqueName: \"kubernetes.io/projected/11aba7f9-5723-4714-ab6a-842dde598025-kube-api-access-5njdf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v2xmc\" (UID: \"11aba7f9-5723-4714-ab6a-842dde598025\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"
Jul 06 19:12:33.545891 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:33.545895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11aba7f9-5723-4714-ab6a-842dde598025-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v2xmc\" (UID: \"11aba7f9-5723-4714-ab6a-842dde598025\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"
Jul 06 19:12:33.647151 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:33.647047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5njdf\" (UniqueName: \"kubernetes.io/projected/11aba7f9-5723-4714-ab6a-842dde598025-kube-api-access-5njdf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v2xmc\" (UID: \"11aba7f9-5723-4714-ab6a-842dde598025\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"
Jul 06 19:12:33.647151 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:33.647101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11aba7f9-5723-4714-ab6a-842dde598025-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v2xmc\" (UID: \"11aba7f9-5723-4714-ab6a-842dde598025\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"
Jul 06 19:12:33.647449 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:33.647432    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11aba7f9-5723-4714-ab6a-842dde598025-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v2xmc\" (UID: \"11aba7f9-5723-4714-ab6a-842dde598025\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"
Jul 06 19:12:33.657895 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:33.657865    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5njdf\" (UniqueName: \"kubernetes.io/projected/11aba7f9-5723-4714-ab6a-842dde598025-kube-api-access-5njdf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v2xmc\" (UID: \"11aba7f9-5723-4714-ab6a-842dde598025\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"
Jul 06 19:12:33.731967 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:33.731875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"
Jul 06 19:12:34.029778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:34.029737    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"]
Jul 06 19:12:34.049915 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:12:34.049883    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11aba7f9_5723_4714_ab6a_842dde598025.slice/crio-886dd468a452a1cd71d172a94c107a9fc743bf4e281a581072c0114e01d2c4c4 WatchSource:0}: Error finding container 886dd468a452a1cd71d172a94c107a9fc743bf4e281a581072c0114e01d2c4c4: Status 404 returned error can't find the container with id 886dd468a452a1cd71d172a94c107a9fc743bf4e281a581072c0114e01d2c4c4
Jul 06 19:12:34.831571 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:34.831531    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc" event={"ID":"11aba7f9-5723-4714-ab6a-842dde598025","Type":"ContainerStarted","Data":"886dd468a452a1cd71d172a94c107a9fc743bf4e281a581072c0114e01d2c4c4"}
Jul 06 19:12:39.858657 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:39.858614    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj" podUID="ab0560c2-22b3-49e6-b46f-5a2e0789b719" containerName="manager" containerID="cri-o://7ecad6f5198b20896b875b34f57bd797bfa3702de3a00d0f3a62c80ace964538" gracePeriod=2
Jul 06 19:12:39.860348 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:39.860310    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc" event={"ID":"11aba7f9-5723-4714-ab6a-842dde598025","Type":"ContainerStarted","Data":"3e1460b4a1e60393890b62caba5b7f050732eb69c6246aeabe17034f86af4fb5"}
Jul 06 19:12:39.860478 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:39.860405    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"
Jul 06 19:12:39.864170 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:12:39.864144    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qm4nj\" is forbidden: User \"system:node:ip-10-0-133-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-117.ec2.internal' and this object" podUID="ab0560c2-22b3-49e6-b46f-5a2e0789b719" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:39.894384 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:39.894334    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc" podStartSLOduration=1.851488082 podStartE2EDuration="6.8943188s" totalImagesPullingTime="5.042830718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:12:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:12:39.892873407 +0000 UTC m=+433.503000770" watchObservedRunningTime="2026-07-06 19:12:39.8943188 +0000 UTC m=+433.504446144"
Jul 06 19:12:39.895435 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:12:39.895402    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qm4nj\" is forbidden: User \"system:node:ip-10-0-133-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-117.ec2.internal' and this object" podUID="ab0560c2-22b3-49e6-b46f-5a2e0789b719" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:40.104609 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:40.104581    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:40.107219 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:12:40.107196    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qm4nj\" is forbidden: User \"system:node:ip-10-0-133-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-117.ec2.internal' and this object" podUID="ab0560c2-22b3-49e6-b46f-5a2e0789b719" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:40.209702 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:40.209657    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab0560c2-22b3-49e6-b46f-5a2e0789b719-extensions-socket-volume\") pod \"ab0560c2-22b3-49e6-b46f-5a2e0789b719\" (UID: \"ab0560c2-22b3-49e6-b46f-5a2e0789b719\") "
Jul 06 19:12:40.209702 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:40.209731    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfzgl\" (UniqueName: \"kubernetes.io/projected/ab0560c2-22b3-49e6-b46f-5a2e0789b719-kube-api-access-mfzgl\") pod \"ab0560c2-22b3-49e6-b46f-5a2e0789b719\" (UID: \"ab0560c2-22b3-49e6-b46f-5a2e0789b719\") "
Jul 06 19:12:40.210018 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:40.209993    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0560c2-22b3-49e6-b46f-5a2e0789b719-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ab0560c2-22b3-49e6-b46f-5a2e0789b719" (UID: "ab0560c2-22b3-49e6-b46f-5a2e0789b719"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:12:40.211959 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:40.211930    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab0560c2-22b3-49e6-b46f-5a2e0789b719-kube-api-access-mfzgl" (OuterVolumeSpecName: "kube-api-access-mfzgl") pod "ab0560c2-22b3-49e6-b46f-5a2e0789b719" (UID: "ab0560c2-22b3-49e6-b46f-5a2e0789b719"). InnerVolumeSpecName "kube-api-access-mfzgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:12:40.310930 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:40.310880    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab0560c2-22b3-49e6-b46f-5a2e0789b719-extensions-socket-volume\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:12:40.310930 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:40.310924    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfzgl\" (UniqueName: \"kubernetes.io/projected/ab0560c2-22b3-49e6-b46f-5a2e0789b719-kube-api-access-mfzgl\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:12:40.850645 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:40.850608    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab0560c2-22b3-49e6-b46f-5a2e0789b719" path="/var/lib/kubelet/pods/ab0560c2-22b3-49e6-b46f-5a2e0789b719/volumes"
Jul 06 19:12:40.865481 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:40.865453    2580 generic.go:356] "Generic (PLEG): container finished" podID="ab0560c2-22b3-49e6-b46f-5a2e0789b719" containerID="7ecad6f5198b20896b875b34f57bd797bfa3702de3a00d0f3a62c80ace964538" exitCode=2
Jul 06 19:12:40.865999 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:40.865497    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:40.865999 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:40.865552    2580 scope.go:117] "RemoveContainer" containerID="7ecad6f5198b20896b875b34f57bd797bfa3702de3a00d0f3a62c80ace964538"
Jul 06 19:12:40.868109 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:12:40.868074    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qm4nj\" is forbidden: User \"system:node:ip-10-0-133-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-117.ec2.internal' and this object" podUID="ab0560c2-22b3-49e6-b46f-5a2e0789b719" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:40.870248 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:12:40.870214    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-qm4nj\" is forbidden: User \"system:node:ip-10-0-133-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-117.ec2.internal' and this object" podUID="ab0560c2-22b3-49e6-b46f-5a2e0789b719" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qm4nj"
Jul 06 19:12:40.874051 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:40.874034    2580 scope.go:117] "RemoveContainer" containerID="7ecad6f5198b20896b875b34f57bd797bfa3702de3a00d0f3a62c80ace964538"
Jul 06 19:12:40.874298 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:12:40.874278    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ecad6f5198b20896b875b34f57bd797bfa3702de3a00d0f3a62c80ace964538\": container with ID starting with 7ecad6f5198b20896b875b34f57bd797bfa3702de3a00d0f3a62c80ace964538 not found: ID does not exist" containerID="7ecad6f5198b20896b875b34f57bd797bfa3702de3a00d0f3a62c80ace964538"
Jul 06 19:12:40.874356 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:40.874310    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ecad6f5198b20896b875b34f57bd797bfa3702de3a00d0f3a62c80ace964538"} err="failed to get container status \"7ecad6f5198b20896b875b34f57bd797bfa3702de3a00d0f3a62c80ace964538\": rpc error: code = NotFound desc = could not find container \"7ecad6f5198b20896b875b34f57bd797bfa3702de3a00d0f3a62c80ace964538\": container with ID starting with 7ecad6f5198b20896b875b34f57bd797bfa3702de3a00d0f3a62c80ace964538 not found: ID does not exist"
Jul 06 19:12:50.868422 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:12:50.868342    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"
Jul 06 19:13:02.974236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:02.974202    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"]
Jul 06 19:13:02.974750 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:02.974447    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc" podUID="11aba7f9-5723-4714-ab6a-842dde598025" containerName="manager" containerID="cri-o://3e1460b4a1e60393890b62caba5b7f050732eb69c6246aeabe17034f86af4fb5" gracePeriod=10
Jul 06 19:13:03.236511 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.236443    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"
Jul 06 19:13:03.304755 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.304724    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11aba7f9-5723-4714-ab6a-842dde598025-extensions-socket-volume\") pod \"11aba7f9-5723-4714-ab6a-842dde598025\" (UID: \"11aba7f9-5723-4714-ab6a-842dde598025\") "
Jul 06 19:13:03.304922 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.304797    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5njdf\" (UniqueName: \"kubernetes.io/projected/11aba7f9-5723-4714-ab6a-842dde598025-kube-api-access-5njdf\") pod \"11aba7f9-5723-4714-ab6a-842dde598025\" (UID: \"11aba7f9-5723-4714-ab6a-842dde598025\") "
Jul 06 19:13:03.305302 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.305273    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11aba7f9-5723-4714-ab6a-842dde598025-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "11aba7f9-5723-4714-ab6a-842dde598025" (UID: "11aba7f9-5723-4714-ab6a-842dde598025"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:13:03.306871 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.306839    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11aba7f9-5723-4714-ab6a-842dde598025-kube-api-access-5njdf" (OuterVolumeSpecName: "kube-api-access-5njdf") pod "11aba7f9-5723-4714-ab6a-842dde598025" (UID: "11aba7f9-5723-4714-ab6a-842dde598025"). InnerVolumeSpecName "kube-api-access-5njdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:13:03.405966 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.405931    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/11aba7f9-5723-4714-ab6a-842dde598025-extensions-socket-volume\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:13:03.405966 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.405962    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5njdf\" (UniqueName: \"kubernetes.io/projected/11aba7f9-5723-4714-ab6a-842dde598025-kube-api-access-5njdf\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:13:03.975470 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.975432    2580 generic.go:356] "Generic (PLEG): container finished" podID="11aba7f9-5723-4714-ab6a-842dde598025" containerID="3e1460b4a1e60393890b62caba5b7f050732eb69c6246aeabe17034f86af4fb5" exitCode=0
Jul 06 19:13:03.975991 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.975484    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"
Jul 06 19:13:03.975991 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.975500    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc" event={"ID":"11aba7f9-5723-4714-ab6a-842dde598025","Type":"ContainerDied","Data":"3e1460b4a1e60393890b62caba5b7f050732eb69c6246aeabe17034f86af4fb5"}
Jul 06 19:13:03.975991 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.975544    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc" event={"ID":"11aba7f9-5723-4714-ab6a-842dde598025","Type":"ContainerDied","Data":"886dd468a452a1cd71d172a94c107a9fc743bf4e281a581072c0114e01d2c4c4"}
Jul 06 19:13:03.975991 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.975565    2580 scope.go:117] "RemoveContainer" containerID="3e1460b4a1e60393890b62caba5b7f050732eb69c6246aeabe17034f86af4fb5"
Jul 06 19:13:03.984651 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.984633    2580 scope.go:117] "RemoveContainer" containerID="3e1460b4a1e60393890b62caba5b7f050732eb69c6246aeabe17034f86af4fb5"
Jul 06 19:13:03.984944 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:13:03.984922    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e1460b4a1e60393890b62caba5b7f050732eb69c6246aeabe17034f86af4fb5\": container with ID starting with 3e1460b4a1e60393890b62caba5b7f050732eb69c6246aeabe17034f86af4fb5 not found: ID does not exist" containerID="3e1460b4a1e60393890b62caba5b7f050732eb69c6246aeabe17034f86af4fb5"
Jul 06 19:13:03.985034 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.984952    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e1460b4a1e60393890b62caba5b7f050732eb69c6246aeabe17034f86af4fb5"} err="failed to get container status \"3e1460b4a1e60393890b62caba5b7f050732eb69c6246aeabe17034f86af4fb5\": rpc error: code = NotFound desc = could not find container \"3e1460b4a1e60393890b62caba5b7f050732eb69c6246aeabe17034f86af4fb5\": container with ID starting with 3e1460b4a1e60393890b62caba5b7f050732eb69c6246aeabe17034f86af4fb5 not found: ID does not exist"
Jul 06 19:13:03.998685 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:03.998657    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"]
Jul 06 19:13:04.005858 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:04.005831    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v2xmc"]
Jul 06 19:13:04.850853 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:04.850821    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11aba7f9-5723-4714-ab6a-842dde598025" path="/var/lib/kubelet/pods/11aba7f9-5723-4714-ab6a-842dde598025/volumes"
Jul 06 19:13:07.329174 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.329134    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"]
Jul 06 19:13:07.329631 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.329615    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0560c2-22b3-49e6-b46f-5a2e0789b719" containerName="manager"
Jul 06 19:13:07.329670 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.329634    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0560c2-22b3-49e6-b46f-5a2e0789b719" containerName="manager"
Jul 06 19:13:07.329670 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.329656    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11aba7f9-5723-4714-ab6a-842dde598025" containerName="manager"
Jul 06 19:13:07.329670 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.329665    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="11aba7f9-5723-4714-ab6a-842dde598025" containerName="manager"
Jul 06 19:13:07.329778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.329764    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0560c2-22b3-49e6-b46f-5a2e0789b719" containerName="manager"
Jul 06 19:13:07.329778 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.329776    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="11aba7f9-5723-4714-ab6a-842dde598025" containerName="manager"
Jul 06 19:13:07.335817 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.335793    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.338384 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.338363    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 19:13:07.338490 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.338363    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-275kd\""
Jul 06 19:13:07.344316 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.344292    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"]
Jul 06 19:13:07.438310 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.438269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.438310 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.438319    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.438534 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.438364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fs8g\" (UniqueName: \"kubernetes.io/projected/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-kube-api-access-9fs8g\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.438534 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.438445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.438534 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.438507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.438534 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.438523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.438683 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.438544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.438683 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.438575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.438683 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.438593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.539109 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.539073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.539281 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.539115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.539281 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.539153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.539281 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.539196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.539281 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.539245    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fs8g\" (UniqueName: \"kubernetes.io/projected/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-kube-api-access-9fs8g\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.539453 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.539283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.539453 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.539336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.539453 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.539361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.539453 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.539392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.539695 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.539668    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.539795 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.539767    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.539852 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.539797    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.539903 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.539857    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.540243 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.540222    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.541474 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.541449    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.541886 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.541868    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.547542 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.547517    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.547668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.547647    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fs8g\" (UniqueName: \"kubernetes.io/projected/3a6d9f4d-262d-4b38-85a1-96b3dfb8f419-kube-api-access-9fs8g\") pod \"maas-default-gateway-openshift-default-5896d4dd49-bqxcb\" (UID: \"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.646737 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.646610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:07.787146 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.787113    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"]
Jul 06 19:13:07.790249 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:13:07.790223    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6d9f4d_262d_4b38_85a1_96b3dfb8f419.slice/crio-24612cc577aaba84cd6a3ec925e47367dcadb7378b538727558aa2c26e6acc13 WatchSource:0}: Error finding container 24612cc577aaba84cd6a3ec925e47367dcadb7378b538727558aa2c26e6acc13: Status 404 returned error can't find the container with id 24612cc577aaba84cd6a3ec925e47367dcadb7378b538727558aa2c26e6acc13
Jul 06 19:13:07.995223 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:07.995186    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb" event={"ID":"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419","Type":"ContainerStarted","Data":"24612cc577aaba84cd6a3ec925e47367dcadb7378b538727558aa2c26e6acc13"}
Jul 06 19:13:13.424186 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:13.424135    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:13:13.424628 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:13.424234    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:13:13.424628 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:13.424283    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:13:14.026641 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:14.026602    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb" event={"ID":"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419","Type":"ContainerStarted","Data":"4e2eb084be4b734c8e427eb6ce967b5d080f31118ca3c2c9db49d3fa1427896e"}
Jul 06 19:13:14.048553 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:14.048504    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb" podStartSLOduration=1.416864908 podStartE2EDuration="7.048489278s" totalImagesPullingTime="5.63162437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:14.046315078 +0000 UTC m=+467.656442421" watchObservedRunningTime="2026-07-06 19:13:14.048489278 +0000 UTC m=+467.658616666"
Jul 06 19:13:14.647543 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:14.647503    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:14.649074 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:14.649047    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-bqxcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 06 19:13:14.649202 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:14.649104    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb" podUID="3a6d9f4d-262d-4b38-85a1-96b3dfb8f419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 06 19:13:15.651143 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:15.651114    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:16.035098 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:16.035067    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:16.036141 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:16.036121    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:13:19.746715 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:19.746667    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"]
Jul 06 19:13:19.748955 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:19.748937    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"
Jul 06 19:13:19.751200 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:19.751175    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 19:13:19.751469 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:19.751451    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n82z9\""
Jul 06 19:13:19.758580 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:19.758536    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"]
Jul 06 19:13:19.843548 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:19.843513    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"]
Jul 06 19:13:19.847580 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:19.847552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/35d45afa-6c08-4fde-9a27-9817dc1c0c2e-config-file\") pod \"limitador-limitador-64c94fd64f-qp6ws\" (UID: \"35d45afa-6c08-4fde-9a27-9817dc1c0c2e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"
Jul 06 19:13:19.847580 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:19.847581    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pjjh\" (UniqueName: \"kubernetes.io/projected/35d45afa-6c08-4fde-9a27-9817dc1c0c2e-kube-api-access-2pjjh\") pod \"limitador-limitador-64c94fd64f-qp6ws\" (UID: \"35d45afa-6c08-4fde-9a27-9817dc1c0c2e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"
Jul 06 19:13:19.948197 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:19.948163    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/35d45afa-6c08-4fde-9a27-9817dc1c0c2e-config-file\") pod \"limitador-limitador-64c94fd64f-qp6ws\" (UID: \"35d45afa-6c08-4fde-9a27-9817dc1c0c2e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"
Jul 06 19:13:19.948197 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:19.948199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjjh\" (UniqueName: \"kubernetes.io/projected/35d45afa-6c08-4fde-9a27-9817dc1c0c2e-kube-api-access-2pjjh\") pod \"limitador-limitador-64c94fd64f-qp6ws\" (UID: \"35d45afa-6c08-4fde-9a27-9817dc1c0c2e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"
Jul 06 19:13:19.948918 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:19.948898    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/35d45afa-6c08-4fde-9a27-9817dc1c0c2e-config-file\") pod \"limitador-limitador-64c94fd64f-qp6ws\" (UID: \"35d45afa-6c08-4fde-9a27-9817dc1c0c2e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"
Jul 06 19:13:19.956850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:19.956824    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pjjh\" (UniqueName: \"kubernetes.io/projected/35d45afa-6c08-4fde-9a27-9817dc1c0c2e-kube-api-access-2pjjh\") pod \"limitador-limitador-64c94fd64f-qp6ws\" (UID: \"35d45afa-6c08-4fde-9a27-9817dc1c0c2e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"
Jul 06 19:13:20.059837 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:20.059753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"
Jul 06 19:13:20.183297 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:20.183273    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"]
Jul 06 19:13:20.185689 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:13:20.185662    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d45afa_6c08_4fde_9a27_9817dc1c0c2e.slice/crio-2710d790fc970e395cf9e3413a8d04dd092dadf0812dd12362cf109a1cb6d01d WatchSource:0}: Error finding container 2710d790fc970e395cf9e3413a8d04dd092dadf0812dd12362cf109a1cb6d01d: Status 404 returned error can't find the container with id 2710d790fc970e395cf9e3413a8d04dd092dadf0812dd12362cf109a1cb6d01d
Jul 06 19:13:21.060598 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:21.060555    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws" event={"ID":"35d45afa-6c08-4fde-9a27-9817dc1c0c2e","Type":"ContainerStarted","Data":"2710d790fc970e395cf9e3413a8d04dd092dadf0812dd12362cf109a1cb6d01d"}
Jul 06 19:13:23.071035 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:23.070943    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws" event={"ID":"35d45afa-6c08-4fde-9a27-9817dc1c0c2e","Type":"ContainerStarted","Data":"c0f1214eed73da11343c86051f9ec31d8aeb4e9d0dacf564faf5c1a9e3220879"}
Jul 06 19:13:23.071035 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:23.071025    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"
Jul 06 19:13:23.087111 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:23.087014    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws" podStartSLOduration=1.583470502 podStartE2EDuration="4.086997616s" totalImagesPullingTime="2.503527114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:23.086766161 +0000 UTC m=+476.696893521" watchObservedRunningTime="2026-07-06 19:13:23.086997616 +0000 UTC m=+476.697124960"
Jul 06 19:13:34.076656 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:34.076621    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"
Jul 06 19:13:37.175721 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:37.175681    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"]
Jul 06 19:13:37.176183 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:37.175913    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws" podUID="35d45afa-6c08-4fde-9a27-9817dc1c0c2e" containerName="limitador" containerID="cri-o://c0f1214eed73da11343c86051f9ec31d8aeb4e9d0dacf564faf5c1a9e3220879" gracePeriod=30
Jul 06 19:13:38.115359 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.115331    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"
Jul 06 19:13:38.139475 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.139444    2580 generic.go:356] "Generic (PLEG): container finished" podID="35d45afa-6c08-4fde-9a27-9817dc1c0c2e" containerID="c0f1214eed73da11343c86051f9ec31d8aeb4e9d0dacf564faf5c1a9e3220879" exitCode=0
Jul 06 19:13:38.139603 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.139487    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"
Jul 06 19:13:38.139603 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.139525    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws" event={"ID":"35d45afa-6c08-4fde-9a27-9817dc1c0c2e","Type":"ContainerDied","Data":"c0f1214eed73da11343c86051f9ec31d8aeb4e9d0dacf564faf5c1a9e3220879"}
Jul 06 19:13:38.139603 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.139578    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qp6ws" event={"ID":"35d45afa-6c08-4fde-9a27-9817dc1c0c2e","Type":"ContainerDied","Data":"2710d790fc970e395cf9e3413a8d04dd092dadf0812dd12362cf109a1cb6d01d"}
Jul 06 19:13:38.139724 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.139608    2580 scope.go:117] "RemoveContainer" containerID="c0f1214eed73da11343c86051f9ec31d8aeb4e9d0dacf564faf5c1a9e3220879"
Jul 06 19:13:38.147797 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.147771    2580 scope.go:117] "RemoveContainer" containerID="c0f1214eed73da11343c86051f9ec31d8aeb4e9d0dacf564faf5c1a9e3220879"
Jul 06 19:13:38.148067 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:13:38.148037    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0f1214eed73da11343c86051f9ec31d8aeb4e9d0dacf564faf5c1a9e3220879\": container with ID starting with c0f1214eed73da11343c86051f9ec31d8aeb4e9d0dacf564faf5c1a9e3220879 not found: ID does not exist" containerID="c0f1214eed73da11343c86051f9ec31d8aeb4e9d0dacf564faf5c1a9e3220879"
Jul 06 19:13:38.148149 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.148074    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0f1214eed73da11343c86051f9ec31d8aeb4e9d0dacf564faf5c1a9e3220879"} err="failed to get container status \"c0f1214eed73da11343c86051f9ec31d8aeb4e9d0dacf564faf5c1a9e3220879\": rpc error: code = NotFound desc = could not find container \"c0f1214eed73da11343c86051f9ec31d8aeb4e9d0dacf564faf5c1a9e3220879\": container with ID starting with c0f1214eed73da11343c86051f9ec31d8aeb4e9d0dacf564faf5c1a9e3220879 not found: ID does not exist"
Jul 06 19:13:38.214653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.214619    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/35d45afa-6c08-4fde-9a27-9817dc1c0c2e-config-file\") pod \"35d45afa-6c08-4fde-9a27-9817dc1c0c2e\" (UID: \"35d45afa-6c08-4fde-9a27-9817dc1c0c2e\") "
Jul 06 19:13:38.214653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.214657    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pjjh\" (UniqueName: \"kubernetes.io/projected/35d45afa-6c08-4fde-9a27-9817dc1c0c2e-kube-api-access-2pjjh\") pod \"35d45afa-6c08-4fde-9a27-9817dc1c0c2e\" (UID: \"35d45afa-6c08-4fde-9a27-9817dc1c0c2e\") "
Jul 06 19:13:38.215080 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.215045    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35d45afa-6c08-4fde-9a27-9817dc1c0c2e-config-file" (OuterVolumeSpecName: "config-file") pod "35d45afa-6c08-4fde-9a27-9817dc1c0c2e" (UID: "35d45afa-6c08-4fde-9a27-9817dc1c0c2e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:13:38.216686 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.216669    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35d45afa-6c08-4fde-9a27-9817dc1c0c2e-kube-api-access-2pjjh" (OuterVolumeSpecName: "kube-api-access-2pjjh") pod "35d45afa-6c08-4fde-9a27-9817dc1c0c2e" (UID: "35d45afa-6c08-4fde-9a27-9817dc1c0c2e"). InnerVolumeSpecName "kube-api-access-2pjjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:13:38.316344 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.316263    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/35d45afa-6c08-4fde-9a27-9817dc1c0c2e-config-file\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:13:38.316344 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.316292    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pjjh\" (UniqueName: \"kubernetes.io/projected/35d45afa-6c08-4fde-9a27-9817dc1c0c2e-kube-api-access-2pjjh\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:13:38.460995 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.460966    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"]
Jul 06 19:13:38.465118 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.465094    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qp6ws"]
Jul 06 19:13:38.849988 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:38.849958    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35d45afa-6c08-4fde-9a27-9817dc1c0c2e" path="/var/lib/kubelet/pods/35d45afa-6c08-4fde-9a27-9817dc1c0c2e/volumes"
Jul 06 19:13:41.822448 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:41.822405    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv"]
Jul 06 19:13:41.822926 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:41.822909    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35d45afa-6c08-4fde-9a27-9817dc1c0c2e" containerName="limitador"
Jul 06 19:13:41.822983 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:41.822928    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35d45afa-6c08-4fde-9a27-9817dc1c0c2e" containerName="limitador"
Jul 06 19:13:41.823066 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:41.823040    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="35d45afa-6c08-4fde-9a27-9817dc1c0c2e" containerName="limitador"
Jul 06 19:13:41.827513 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:41.827492    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv"
Jul 06 19:13:41.829934 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:41.829911    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 06 19:13:41.830056 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:41.829912    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 06 19:13:41.830607 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:41.830590    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 06 19:13:41.830675 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:41.830597    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-86mnv\""
Jul 06 19:13:41.834075 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:41.834051    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv"]
Jul 06 19:13:41.948056 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:41.948020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6b31aa09-cbd3-4b6d-aa9f-9e4e5444f5df-data\") pod \"postgres-69fb4594cf-jt7bv\" (UID: \"6b31aa09-cbd3-4b6d-aa9f-9e4e5444f5df\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv"
Jul 06 19:13:41.948224 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:41.948087    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6srqq\" (UniqueName: \"kubernetes.io/projected/6b31aa09-cbd3-4b6d-aa9f-9e4e5444f5df-kube-api-access-6srqq\") pod \"postgres-69fb4594cf-jt7bv\" (UID: \"6b31aa09-cbd3-4b6d-aa9f-9e4e5444f5df\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv"
Jul 06 19:13:42.049082 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:42.049045    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6b31aa09-cbd3-4b6d-aa9f-9e4e5444f5df-data\") pod \"postgres-69fb4594cf-jt7bv\" (UID: \"6b31aa09-cbd3-4b6d-aa9f-9e4e5444f5df\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv"
Jul 06 19:13:42.049263 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:42.049110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6srqq\" (UniqueName: \"kubernetes.io/projected/6b31aa09-cbd3-4b6d-aa9f-9e4e5444f5df-kube-api-access-6srqq\") pod \"postgres-69fb4594cf-jt7bv\" (UID: \"6b31aa09-cbd3-4b6d-aa9f-9e4e5444f5df\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv"
Jul 06 19:13:42.049448 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:42.049430    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6b31aa09-cbd3-4b6d-aa9f-9e4e5444f5df-data\") pod \"postgres-69fb4594cf-jt7bv\" (UID: \"6b31aa09-cbd3-4b6d-aa9f-9e4e5444f5df\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv"
Jul 06 19:13:42.058002 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:42.057967    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6srqq\" (UniqueName: \"kubernetes.io/projected/6b31aa09-cbd3-4b6d-aa9f-9e4e5444f5df-kube-api-access-6srqq\") pod \"postgres-69fb4594cf-jt7bv\" (UID: \"6b31aa09-cbd3-4b6d-aa9f-9e4e5444f5df\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv"
Jul 06 19:13:42.139845 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:42.139762    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv"
Jul 06 19:13:42.269676 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:42.269652    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv"]
Jul 06 19:13:42.272133 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:13:42.272110    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b31aa09_cbd3_4b6d_aa9f_9e4e5444f5df.slice/crio-dd408ecd799e9d760ae64572ce7718be64fbfc824ea7a782ee6bab29c8514ba8 WatchSource:0}: Error finding container dd408ecd799e9d760ae64572ce7718be64fbfc824ea7a782ee6bab29c8514ba8: Status 404 returned error can't find the container with id dd408ecd799e9d760ae64572ce7718be64fbfc824ea7a782ee6bab29c8514ba8
Jul 06 19:13:43.166625 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:43.166577    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv" event={"ID":"6b31aa09-cbd3-4b6d-aa9f-9e4e5444f5df","Type":"ContainerStarted","Data":"dd408ecd799e9d760ae64572ce7718be64fbfc824ea7a782ee6bab29c8514ba8"}
Jul 06 19:13:47.189839 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:47.189802    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv" event={"ID":"6b31aa09-cbd3-4b6d-aa9f-9e4e5444f5df","Type":"ContainerStarted","Data":"370c30802b3445cfa56b485f74affda605b00dd0a921c70741702af690b03180"}
Jul 06 19:13:47.190299 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:47.189916    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv"
Jul 06 19:13:47.207619 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:47.207568    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv" podStartSLOduration=1.6801522549999999 podStartE2EDuration="6.207554347s" totalImagesPullingTime="4.527402092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:13:47.20659599 +0000 UTC m=+500.816723347" watchObservedRunningTime="2026-07-06 19:13:47.207554347 +0000 UTC m=+500.817681691"
Jul 06 19:13:53.225396 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:53.225366    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jt7bv"
Jul 06 19:13:59.989264 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:59.989218    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c889f5dc7-4zhlm"]
Jul 06 19:13:59.998118 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:13:59.998094    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c889f5dc7-4zhlm"
Jul 06 19:14:00.000838 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.000816    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 19:14:00.000969 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.000819    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:14:00.000969 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.000935    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c274b\""
Jul 06 19:14:00.006957 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.006933    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c889f5dc7-4zhlm"]
Jul 06 19:14:00.107185 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.107148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/064fcb2f-3224-4fcc-a891-42d9500869d1-webhook-cert\") pod \"maas-controller-7c889f5dc7-4zhlm\" (UID: \"064fcb2f-3224-4fcc-a891-42d9500869d1\") " pod="opendatahub/maas-controller-7c889f5dc7-4zhlm"
Jul 06 19:14:00.107329 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.107224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfjqj\" (UniqueName: \"kubernetes.io/projected/064fcb2f-3224-4fcc-a891-42d9500869d1-kube-api-access-dfjqj\") pod \"maas-controller-7c889f5dc7-4zhlm\" (UID: \"064fcb2f-3224-4fcc-a891-42d9500869d1\") " pod="opendatahub/maas-controller-7c889f5dc7-4zhlm"
Jul 06 19:14:00.166131 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.166094    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86c44fb47b-qthlc"]
Jul 06 19:14:00.169895 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.169876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c44fb47b-qthlc"
Jul 06 19:14:00.179483 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.179459    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86c44fb47b-qthlc"]
Jul 06 19:14:00.207630 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.207596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfjqj\" (UniqueName: \"kubernetes.io/projected/064fcb2f-3224-4fcc-a891-42d9500869d1-kube-api-access-dfjqj\") pod \"maas-controller-7c889f5dc7-4zhlm\" (UID: \"064fcb2f-3224-4fcc-a891-42d9500869d1\") " pod="opendatahub/maas-controller-7c889f5dc7-4zhlm"
Jul 06 19:14:00.207826 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.207650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/064fcb2f-3224-4fcc-a891-42d9500869d1-webhook-cert\") pod \"maas-controller-7c889f5dc7-4zhlm\" (UID: \"064fcb2f-3224-4fcc-a891-42d9500869d1\") " pod="opendatahub/maas-controller-7c889f5dc7-4zhlm"
Jul 06 19:14:00.207826 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.207670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzxfb\" (UniqueName: \"kubernetes.io/projected/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-kube-api-access-jzxfb\") pod \"maas-controller-86c44fb47b-qthlc\" (UID: \"9b1f16fa-679e-4632-bd2c-7ac57b2c1970\") " pod="opendatahub/maas-controller-86c44fb47b-qthlc"
Jul 06 19:14:00.207826 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.207720    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-webhook-cert\") pod \"maas-controller-86c44fb47b-qthlc\" (UID: \"9b1f16fa-679e-4632-bd2c-7ac57b2c1970\") " pod="opendatahub/maas-controller-86c44fb47b-qthlc"
Jul 06 19:14:00.207826 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:14:00.207784    2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 06 19:14:00.208032 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:14:00.207869    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/064fcb2f-3224-4fcc-a891-42d9500869d1-webhook-cert podName:064fcb2f-3224-4fcc-a891-42d9500869d1 nodeName:}" failed. No retries permitted until 2026-07-06 19:14:00.707847031 +0000 UTC m=+514.317974355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/064fcb2f-3224-4fcc-a891-42d9500869d1-webhook-cert") pod "maas-controller-7c889f5dc7-4zhlm" (UID: "064fcb2f-3224-4fcc-a891-42d9500869d1") : secret "maas-controller-webhook-cert" not found
Jul 06 19:14:00.218316 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.218291    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfjqj\" (UniqueName: \"kubernetes.io/projected/064fcb2f-3224-4fcc-a891-42d9500869d1-kube-api-access-dfjqj\") pod \"maas-controller-7c889f5dc7-4zhlm\" (UID: \"064fcb2f-3224-4fcc-a891-42d9500869d1\") " pod="opendatahub/maas-controller-7c889f5dc7-4zhlm"
Jul 06 19:14:00.309057 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.308972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzxfb\" (UniqueName: \"kubernetes.io/projected/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-kube-api-access-jzxfb\") pod \"maas-controller-86c44fb47b-qthlc\" (UID: \"9b1f16fa-679e-4632-bd2c-7ac57b2c1970\") " pod="opendatahub/maas-controller-86c44fb47b-qthlc"
Jul 06 19:14:00.309057 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.309030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-webhook-cert\") pod \"maas-controller-86c44fb47b-qthlc\" (UID: \"9b1f16fa-679e-4632-bd2c-7ac57b2c1970\") " pod="opendatahub/maas-controller-86c44fb47b-qthlc"
Jul 06 19:14:00.309260 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:14:00.309133    2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 06 19:14:00.309260 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:14:00.309195    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-webhook-cert podName:9b1f16fa-679e-4632-bd2c-7ac57b2c1970 nodeName:}" failed. No retries permitted until 2026-07-06 19:14:00.809179552 +0000 UTC m=+514.419306873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-webhook-cert") pod "maas-controller-86c44fb47b-qthlc" (UID: "9b1f16fa-679e-4632-bd2c-7ac57b2c1970") : secret "maas-controller-webhook-cert" not found
Jul 06 19:14:00.318476 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.318378    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzxfb\" (UniqueName: \"kubernetes.io/projected/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-kube-api-access-jzxfb\") pod \"maas-controller-86c44fb47b-qthlc\" (UID: \"9b1f16fa-679e-4632-bd2c-7ac57b2c1970\") " pod="opendatahub/maas-controller-86c44fb47b-qthlc"
Jul 06 19:14:00.711253 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.711213    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/064fcb2f-3224-4fcc-a891-42d9500869d1-webhook-cert\") pod \"maas-controller-7c889f5dc7-4zhlm\" (UID: \"064fcb2f-3224-4fcc-a891-42d9500869d1\") " pod="opendatahub/maas-controller-7c889f5dc7-4zhlm"
Jul 06 19:14:00.713581 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.713555    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/064fcb2f-3224-4fcc-a891-42d9500869d1-webhook-cert\") pod \"maas-controller-7c889f5dc7-4zhlm\" (UID: \"064fcb2f-3224-4fcc-a891-42d9500869d1\") " pod="opendatahub/maas-controller-7c889f5dc7-4zhlm"
Jul 06 19:14:00.812265 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.812223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-webhook-cert\") pod \"maas-controller-86c44fb47b-qthlc\" (UID: \"9b1f16fa-679e-4632-bd2c-7ac57b2c1970\") " pod="opendatahub/maas-controller-86c44fb47b-qthlc"
Jul 06 19:14:00.814574 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.814545    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-webhook-cert\") pod \"maas-controller-86c44fb47b-qthlc\" (UID: \"9b1f16fa-679e-4632-bd2c-7ac57b2c1970\") " pod="opendatahub/maas-controller-86c44fb47b-qthlc"
Jul 06 19:14:00.909537 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:00.909503    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c889f5dc7-4zhlm"
Jul 06 19:14:01.054032 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:01.054002    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c889f5dc7-4zhlm"]
Jul 06 19:14:01.056482 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:14:01.056453    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064fcb2f_3224_4fcc_a891_42d9500869d1.slice/crio-297518e54f54705138129f5ad62c813493a311e306dbfc2231643e401ffb9a82 WatchSource:0}: Error finding container 297518e54f54705138129f5ad62c813493a311e306dbfc2231643e401ffb9a82: Status 404 returned error can't find the container with id 297518e54f54705138129f5ad62c813493a311e306dbfc2231643e401ffb9a82
Jul 06 19:14:01.081007 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:01.080981    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c44fb47b-qthlc"
Jul 06 19:14:01.219445 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:01.219417    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86c44fb47b-qthlc"]
Jul 06 19:14:01.221065 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:14:01.221036    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b1f16fa_679e_4632_bd2c_7ac57b2c1970.slice/crio-b46e9221124e224649ea653ae262665af92b3d06ce1cecc56bbb65b11b3da6cd WatchSource:0}: Error finding container b46e9221124e224649ea653ae262665af92b3d06ce1cecc56bbb65b11b3da6cd: Status 404 returned error can't find the container with id b46e9221124e224649ea653ae262665af92b3d06ce1cecc56bbb65b11b3da6cd
Jul 06 19:14:01.251584 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:01.251513    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c889f5dc7-4zhlm" event={"ID":"064fcb2f-3224-4fcc-a891-42d9500869d1","Type":"ContainerStarted","Data":"297518e54f54705138129f5ad62c813493a311e306dbfc2231643e401ffb9a82"}
Jul 06 19:14:01.252544 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:01.252518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c44fb47b-qthlc" event={"ID":"9b1f16fa-679e-4632-bd2c-7ac57b2c1970","Type":"ContainerStarted","Data":"b46e9221124e224649ea653ae262665af92b3d06ce1cecc56bbb65b11b3da6cd"}
Jul 06 19:14:04.274101 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:04.274064    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c44fb47b-qthlc" event={"ID":"9b1f16fa-679e-4632-bd2c-7ac57b2c1970","Type":"ContainerStarted","Data":"f99d8400b33ecaa05509144ce33accda9a3f73691eae075eee0b1a7ef0828efb"}
Jul 06 19:14:04.274565 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:04.274189    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86c44fb47b-qthlc"
Jul 06 19:14:04.275338 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:04.275315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c889f5dc7-4zhlm" event={"ID":"064fcb2f-3224-4fcc-a891-42d9500869d1","Type":"ContainerStarted","Data":"a7b710c6a96c1594dd367f5fd74aab979c06a8bc83f72eab7dd990ff8f513ff4"}
Jul 06 19:14:04.275462 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:04.275447    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c889f5dc7-4zhlm"
Jul 06 19:14:04.322303 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:04.322252    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86c44fb47b-qthlc" podStartSLOduration=1.80470122 podStartE2EDuration="4.322236048s" totalImagesPullingTime="2.517534828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:04.3188019 +0000 UTC m=+517.928929256" watchObservedRunningTime="2026-07-06 19:14:04.322236048 +0000 UTC m=+517.932363396"
Jul 06 19:14:04.373134 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:04.373086    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c889f5dc7-4zhlm" podStartSLOduration=2.701480271 podStartE2EDuration="5.373069379s" totalImagesPullingTime="2.671589108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:04.372241952 +0000 UTC m=+517.982369296" watchObservedRunningTime="2026-07-06 19:14:04.373069379 +0000 UTC m=+517.983196763"
Jul 06 19:14:15.287859 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:15.287821    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c889f5dc7-4zhlm"
Jul 06 19:14:15.288284 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:15.288262    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86c44fb47b-qthlc"
Jul 06 19:14:15.368433 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:15.368397    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c889f5dc7-4zhlm"]
Jul 06 19:14:15.368636 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:15.368592    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7c889f5dc7-4zhlm" podUID="064fcb2f-3224-4fcc-a891-42d9500869d1" containerName="manager" containerID="cri-o://a7b710c6a96c1594dd367f5fd74aab979c06a8bc83f72eab7dd990ff8f513ff4" gracePeriod=30
Jul 06 19:14:15.613544 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:15.613515    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c889f5dc7-4zhlm"
Jul 06 19:14:15.740248 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:15.740220    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/064fcb2f-3224-4fcc-a891-42d9500869d1-webhook-cert\") pod \"064fcb2f-3224-4fcc-a891-42d9500869d1\" (UID: \"064fcb2f-3224-4fcc-a891-42d9500869d1\") "
Jul 06 19:14:15.740390 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:15.740268    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfjqj\" (UniqueName: \"kubernetes.io/projected/064fcb2f-3224-4fcc-a891-42d9500869d1-kube-api-access-dfjqj\") pod \"064fcb2f-3224-4fcc-a891-42d9500869d1\" (UID: \"064fcb2f-3224-4fcc-a891-42d9500869d1\") "
Jul 06 19:14:15.742489 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:15.742451    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/064fcb2f-3224-4fcc-a891-42d9500869d1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "064fcb2f-3224-4fcc-a891-42d9500869d1" (UID: "064fcb2f-3224-4fcc-a891-42d9500869d1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:14:15.742489 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:15.742451    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/064fcb2f-3224-4fcc-a891-42d9500869d1-kube-api-access-dfjqj" (OuterVolumeSpecName: "kube-api-access-dfjqj") pod "064fcb2f-3224-4fcc-a891-42d9500869d1" (UID: "064fcb2f-3224-4fcc-a891-42d9500869d1"). InnerVolumeSpecName "kube-api-access-dfjqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:14:15.841768 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:15.841738    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/064fcb2f-3224-4fcc-a891-42d9500869d1-webhook-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:14:15.841768 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:15.841762    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfjqj\" (UniqueName: \"kubernetes.io/projected/064fcb2f-3224-4fcc-a891-42d9500869d1-kube-api-access-dfjqj\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:14:16.333341 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:16.333301    2580 generic.go:356] "Generic (PLEG): container finished" podID="064fcb2f-3224-4fcc-a891-42d9500869d1" containerID="a7b710c6a96c1594dd367f5fd74aab979c06a8bc83f72eab7dd990ff8f513ff4" exitCode=0
Jul 06 19:14:16.333341 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:16.333346    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c889f5dc7-4zhlm"
Jul 06 19:14:16.333869 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:16.333387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c889f5dc7-4zhlm" event={"ID":"064fcb2f-3224-4fcc-a891-42d9500869d1","Type":"ContainerDied","Data":"a7b710c6a96c1594dd367f5fd74aab979c06a8bc83f72eab7dd990ff8f513ff4"}
Jul 06 19:14:16.333869 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:16.333452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c889f5dc7-4zhlm" event={"ID":"064fcb2f-3224-4fcc-a891-42d9500869d1","Type":"ContainerDied","Data":"297518e54f54705138129f5ad62c813493a311e306dbfc2231643e401ffb9a82"}
Jul 06 19:14:16.333869 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:16.333487    2580 scope.go:117] "RemoveContainer" containerID="a7b710c6a96c1594dd367f5fd74aab979c06a8bc83f72eab7dd990ff8f513ff4"
Jul 06 19:14:16.342959 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:16.342940    2580 scope.go:117] "RemoveContainer" containerID="a7b710c6a96c1594dd367f5fd74aab979c06a8bc83f72eab7dd990ff8f513ff4"
Jul 06 19:14:16.343219 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:14:16.343199    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7b710c6a96c1594dd367f5fd74aab979c06a8bc83f72eab7dd990ff8f513ff4\": container with ID starting with a7b710c6a96c1594dd367f5fd74aab979c06a8bc83f72eab7dd990ff8f513ff4 not found: ID does not exist" containerID="a7b710c6a96c1594dd367f5fd74aab979c06a8bc83f72eab7dd990ff8f513ff4"
Jul 06 19:14:16.343282 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:16.343227    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7b710c6a96c1594dd367f5fd74aab979c06a8bc83f72eab7dd990ff8f513ff4"} err="failed to get container status \"a7b710c6a96c1594dd367f5fd74aab979c06a8bc83f72eab7dd990ff8f513ff4\": rpc error: code = NotFound desc = could not find container \"a7b710c6a96c1594dd367f5fd74aab979c06a8bc83f72eab7dd990ff8f513ff4\": container with ID starting with a7b710c6a96c1594dd367f5fd74aab979c06a8bc83f72eab7dd990ff8f513ff4 not found: ID does not exist"
Jul 06 19:14:16.354886 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:16.354862    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c889f5dc7-4zhlm"]
Jul 06 19:14:16.358926 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:16.358903    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c889f5dc7-4zhlm"]
Jul 06 19:14:16.851430 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:16.851389    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="064fcb2f-3224-4fcc-a891-42d9500869d1" path="/var/lib/kubelet/pods/064fcb2f-3224-4fcc-a891-42d9500869d1/volumes"
Jul 06 19:14:36.071974 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.071943    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-75db844886-8snfg"]
Jul 06 19:14:36.072397 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.072285    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="064fcb2f-3224-4fcc-a891-42d9500869d1" containerName="manager"
Jul 06 19:14:36.072397 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.072296    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="064fcb2f-3224-4fcc-a891-42d9500869d1" containerName="manager"
Jul 06 19:14:36.072397 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.072353    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="064fcb2f-3224-4fcc-a891-42d9500869d1" containerName="manager"
Jul 06 19:14:36.076488 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.076469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg"
Jul 06 19:14:36.078901 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.078878    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 06 19:14:36.079031 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.078877    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gpd9w\""
Jul 06 19:14:36.088887 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.088865    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75db844886-8snfg"]
Jul 06 19:14:36.219541 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.219505    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ac29b24-18b7-4852-9fc7-0bdf166d23c4-openshift-service-ca\") pod \"maas-api-75db844886-8snfg\" (UID: \"8ac29b24-18b7-4852-9fc7-0bdf166d23c4\") " pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg"
Jul 06 19:14:36.219727 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.219547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ac29b24-18b7-4852-9fc7-0bdf166d23c4-maas-api-tls\") pod \"maas-api-75db844886-8snfg\" (UID: \"8ac29b24-18b7-4852-9fc7-0bdf166d23c4\") " pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg"
Jul 06 19:14:36.219727 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.219667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz2pb\" (UniqueName: \"kubernetes.io/projected/8ac29b24-18b7-4852-9fc7-0bdf166d23c4-kube-api-access-sz2pb\") pod \"maas-api-75db844886-8snfg\" (UID: \"8ac29b24-18b7-4852-9fc7-0bdf166d23c4\") " pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg"
Jul 06 19:14:36.320981 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.320946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ac29b24-18b7-4852-9fc7-0bdf166d23c4-openshift-service-ca\") pod \"maas-api-75db844886-8snfg\" (UID: \"8ac29b24-18b7-4852-9fc7-0bdf166d23c4\") " pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg"
Jul 06 19:14:36.320981 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.320985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ac29b24-18b7-4852-9fc7-0bdf166d23c4-maas-api-tls\") pod \"maas-api-75db844886-8snfg\" (UID: \"8ac29b24-18b7-4852-9fc7-0bdf166d23c4\") " pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg"
Jul 06 19:14:36.321255 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.321024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz2pb\" (UniqueName: \"kubernetes.io/projected/8ac29b24-18b7-4852-9fc7-0bdf166d23c4-kube-api-access-sz2pb\") pod \"maas-api-75db844886-8snfg\" (UID: \"8ac29b24-18b7-4852-9fc7-0bdf166d23c4\") " pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg"
Jul 06 19:14:36.321255 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:14:36.321118    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 06 19:14:36.321255 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:14:36.321198    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac29b24-18b7-4852-9fc7-0bdf166d23c4-maas-api-tls podName:8ac29b24-18b7-4852-9fc7-0bdf166d23c4 nodeName:}" failed. No retries permitted until 2026-07-06 19:14:36.821174812 +0000 UTC m=+550.431302152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8ac29b24-18b7-4852-9fc7-0bdf166d23c4-maas-api-tls") pod "maas-api-75db844886-8snfg" (UID: "8ac29b24-18b7-4852-9fc7-0bdf166d23c4") : secret "maas-api-serving-cert" not found
Jul 06 19:14:36.321650 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.321629    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ac29b24-18b7-4852-9fc7-0bdf166d23c4-openshift-service-ca\") pod \"maas-api-75db844886-8snfg\" (UID: \"8ac29b24-18b7-4852-9fc7-0bdf166d23c4\") " pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg"
Jul 06 19:14:36.329963 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.329913    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz2pb\" (UniqueName: \"kubernetes.io/projected/8ac29b24-18b7-4852-9fc7-0bdf166d23c4-kube-api-access-sz2pb\") pod \"maas-api-75db844886-8snfg\" (UID: \"8ac29b24-18b7-4852-9fc7-0bdf166d23c4\") " pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg"
Jul 06 19:14:36.670871 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.670783    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-4ksqd"]
Jul 06 19:14:36.673078 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.673062    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-4ksqd"
Jul 06 19:14:36.675483 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.675462    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-cfsmh\""
Jul 06 19:14:36.675592 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.675462    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 19:14:36.682528 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.682505    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-4ksqd"]
Jul 06 19:14:36.707785 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.707755    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-b7xzq"]
Jul 06 19:14:36.709899 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.709880    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-b7xzq"
Jul 06 19:14:36.723963 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.723936    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-b7xzq"]
Jul 06 19:14:36.827763 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.827688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ac29b24-18b7-4852-9fc7-0bdf166d23c4-maas-api-tls\") pod \"maas-api-75db844886-8snfg\" (UID: \"8ac29b24-18b7-4852-9fc7-0bdf166d23c4\") " pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg"
Jul 06 19:14:36.827940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.827816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dfc89c4-396a-4718-9897-b2557c39c4a0-plugins-config-volume\") pod \"payload-pre-processing-7964457696-4ksqd\" (UID: \"8dfc89c4-396a-4718-9897-b2557c39c4a0\") " pod="openshift-ingress/payload-pre-processing-7964457696-4ksqd"
Jul 06 19:14:36.827940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.827844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bwdh\" (UniqueName: \"kubernetes.io/projected/68ffa339-302b-44c8-bb21-76eea323787a-kube-api-access-9bwdh\") pod \"payload-processing-58f86c7798-b7xzq\" (UID: \"68ffa339-302b-44c8-bb21-76eea323787a\") " pod="openshift-ingress/payload-processing-58f86c7798-b7xzq"
Jul 06 19:14:36.827940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.827889    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nkks\" (UniqueName: \"kubernetes.io/projected/8dfc89c4-396a-4718-9897-b2557c39c4a0-kube-api-access-5nkks\") pod \"payload-pre-processing-7964457696-4ksqd\" (UID: \"8dfc89c4-396a-4718-9897-b2557c39c4a0\") " pod="openshift-ingress/payload-pre-processing-7964457696-4ksqd"
Jul 06 19:14:36.828074 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.827973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68ffa339-302b-44c8-bb21-76eea323787a-plugins-config-volume\") pod \"payload-processing-58f86c7798-b7xzq\" (UID: \"68ffa339-302b-44c8-bb21-76eea323787a\") " pod="openshift-ingress/payload-processing-58f86c7798-b7xzq"
Jul 06 19:14:36.830565 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.830539    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ac29b24-18b7-4852-9fc7-0bdf166d23c4-maas-api-tls\") pod \"maas-api-75db844886-8snfg\" (UID: \"8ac29b24-18b7-4852-9fc7-0bdf166d23c4\") " pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg"
Jul 06 19:14:36.929247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.929199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nkks\" (UniqueName: \"kubernetes.io/projected/8dfc89c4-396a-4718-9897-b2557c39c4a0-kube-api-access-5nkks\") pod \"payload-pre-processing-7964457696-4ksqd\" (UID: \"8dfc89c4-396a-4718-9897-b2557c39c4a0\") " pod="openshift-ingress/payload-pre-processing-7964457696-4ksqd"
Jul 06 19:14:36.929247 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.929251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68ffa339-302b-44c8-bb21-76eea323787a-plugins-config-volume\") pod \"payload-processing-58f86c7798-b7xzq\" (UID: \"68ffa339-302b-44c8-bb21-76eea323787a\") " pod="openshift-ingress/payload-processing-58f86c7798-b7xzq"
Jul 06 19:14:36.929462 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.929325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dfc89c4-396a-4718-9897-b2557c39c4a0-plugins-config-volume\") pod \"payload-pre-processing-7964457696-4ksqd\" (UID: \"8dfc89c4-396a-4718-9897-b2557c39c4a0\") " pod="openshift-ingress/payload-pre-processing-7964457696-4ksqd"
Jul 06 19:14:36.929462 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.929436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bwdh\" (UniqueName: \"kubernetes.io/projected/68ffa339-302b-44c8-bb21-76eea323787a-kube-api-access-9bwdh\") pod \"payload-processing-58f86c7798-b7xzq\" (UID: \"68ffa339-302b-44c8-bb21-76eea323787a\") " pod="openshift-ingress/payload-processing-58f86c7798-b7xzq"
Jul 06 19:14:36.930029 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.929998    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dfc89c4-396a-4718-9897-b2557c39c4a0-plugins-config-volume\") pod \"payload-pre-processing-7964457696-4ksqd\" (UID: \"8dfc89c4-396a-4718-9897-b2557c39c4a0\") " pod="openshift-ingress/payload-pre-processing-7964457696-4ksqd"
Jul 06 19:14:36.930117 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.930079    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68ffa339-302b-44c8-bb21-76eea323787a-plugins-config-volume\") pod \"payload-processing-58f86c7798-b7xzq\" (UID: \"68ffa339-302b-44c8-bb21-76eea323787a\") " pod="openshift-ingress/payload-processing-58f86c7798-b7xzq"
Jul 06 19:14:36.937490 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.937463    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bwdh\" (UniqueName: \"kubernetes.io/projected/68ffa339-302b-44c8-bb21-76eea323787a-kube-api-access-9bwdh\") pod \"payload-processing-58f86c7798-b7xzq\" (UID: \"68ffa339-302b-44c8-bb21-76eea323787a\") " pod="openshift-ingress/payload-processing-58f86c7798-b7xzq"
Jul 06 19:14:36.937750 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.937699    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nkks\" (UniqueName: \"kubernetes.io/projected/8dfc89c4-396a-4718-9897-b2557c39c4a0-kube-api-access-5nkks\") pod \"payload-pre-processing-7964457696-4ksqd\" (UID: \"8dfc89c4-396a-4718-9897-b2557c39c4a0\") " pod="openshift-ingress/payload-pre-processing-7964457696-4ksqd"
Jul 06 19:14:36.985060 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.985036    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-4ksqd"
Jul 06 19:14:36.989595 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:36.989571    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg"
Jul 06 19:14:37.019957 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:37.019930    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-b7xzq"
Jul 06 19:14:37.188138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:37.181932    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75db844886-8snfg"]
Jul 06 19:14:37.191745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:37.190983    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-4ksqd"]
Jul 06 19:14:37.258124 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:37.258071    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-b7xzq"]
Jul 06 19:14:37.433511 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:37.433404    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-b7xzq" event={"ID":"68ffa339-302b-44c8-bb21-76eea323787a","Type":"ContainerStarted","Data":"b3534b5b1566a04c09ac0befdbbc053114bbe4255ed994213dd2c377823eec49"}
Jul 06 19:14:37.435336 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:37.435304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg" event={"ID":"8ac29b24-18b7-4852-9fc7-0bdf166d23c4","Type":"ContainerStarted","Data":"c878bc4c1849c6bead3582d9d7c57bdf5209320fb88704e9dc561626129d241e"}
Jul 06 19:14:37.437024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:37.436980    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-4ksqd" event={"ID":"8dfc89c4-396a-4718-9897-b2557c39c4a0","Type":"ContainerStarted","Data":"6eb22e9127f731f2b065f17be43983bc1f6e360ca320a6e4d5e78d3590e8bdab"}
Jul 06 19:14:39.464102 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:39.464048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg" event={"ID":"8ac29b24-18b7-4852-9fc7-0bdf166d23c4","Type":"ContainerStarted","Data":"5fe8c5ffd2909a267884d21ee7063265ff88336dabde5a1276c0aaeb00a8e84e"}
Jul 06 19:14:39.464579 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:39.464305    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg"
Jul 06 19:14:39.465947 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:39.465917    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-4ksqd" event={"ID":"8dfc89c4-396a-4718-9897-b2557c39c4a0","Type":"ContainerStarted","Data":"6beb0f845200e4476e3ec2234fc581fd7253085adcd189bb3388a195b7f8db5b"}
Jul 06 19:14:39.466089 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:39.465981    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-4ksqd"
Jul 06 19:14:39.467931 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:39.467865    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-b7xzq" event={"ID":"68ffa339-302b-44c8-bb21-76eea323787a","Type":"ContainerStarted","Data":"4459a170699e50a907c3fc31a434680072b0350b341325cdfd3d8f13b70564c9"}
Jul 06 19:14:39.468077 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:39.468048    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-b7xzq"
Jul 06 19:14:39.483030 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:39.482992    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg" podStartSLOduration=1.5246242730000001 podStartE2EDuration="3.482979481s" totalImagesPullingTime="1.958355208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:39.481199179 +0000 UTC m=+553.091326547" watchObservedRunningTime="2026-07-06 19:14:39.482979481 +0000 UTC m=+553.093106826"
Jul 06 19:14:39.496002 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:39.495955    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-4ksqd" podStartSLOduration=1.534994448 podStartE2EDuration="3.495938263s" totalImagesPullingTime="1.960943815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:39.494915567 +0000 UTC m=+553.105042935" watchObservedRunningTime="2026-07-06 19:14:39.495938263 +0000 UTC m=+553.106065606"
Jul 06 19:14:39.512353 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:39.512309    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-b7xzq" podStartSLOduration=1.6046939070000001 podStartE2EDuration="3.512295037s" totalImagesPullingTime="1.90760113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:39.511136543 +0000 UTC m=+553.121263886" watchObservedRunningTime="2026-07-06 19:14:39.512295037 +0000 UTC m=+553.122422381"
Jul 06 19:14:44.493470 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:44.493437    2580 generic.go:356] "Generic (PLEG): container finished" podID="3a6d9f4d-262d-4b38-85a1-96b3dfb8f419" containerID="4e2eb084be4b734c8e427eb6ce967b5d080f31118ca3c2c9db49d3fa1427896e" exitCode=0
Jul 06 19:14:44.493921 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:44.493510    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb" event={"ID":"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419","Type":"ContainerDied","Data":"4e2eb084be4b734c8e427eb6ce967b5d080f31118ca3c2c9db49d3fa1427896e"}
Jul 06 19:14:44.493921 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:44.493914    2580 scope.go:117] "RemoveContainer" containerID="4e2eb084be4b734c8e427eb6ce967b5d080f31118ca3c2c9db49d3fa1427896e"
Jul 06 19:14:44.494905 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:44.494871    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:14:44.494984 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:44.494943    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:14:44.495021 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:44.494981    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:14:45.477664 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:45.477630    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-75db844886-8snfg"
Jul 06 19:14:45.499972 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:45.499943    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb" event={"ID":"3a6d9f4d-262d-4b38-85a1-96b3dfb8f419","Type":"ContainerStarted","Data":"b50d2974e444be866b54694524b997bcae3c73d82360560262d8aa49af499f37"}
Jul 06 19:14:45.647225 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:45.647187    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:14:45.648503 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:45.648474    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-bqxcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 06 19:14:45.648617 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:45.648527    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb" podUID="3a6d9f4d-262d-4b38-85a1-96b3dfb8f419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 06 19:14:46.038962 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:46.038910    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:14:46.647386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:46.647335    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-bqxcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 06 19:14:46.647918 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:46.647409    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb" podUID="3a6d9f4d-262d-4b38-85a1-96b3dfb8f419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 06 19:14:47.647588 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:47.647546    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-bqxcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 06 19:14:47.648245 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:47.648209    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb" podUID="3a6d9f4d-262d-4b38-85a1-96b3dfb8f419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 06 19:14:48.647245 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:48.647209    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-bqxcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 06 19:14:48.647544 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:48.647513    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb" podUID="3a6d9f4d-262d-4b38-85a1-96b3dfb8f419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 06 19:14:49.648131 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:49.648079    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-bqxcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 06 19:14:49.648636 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:49.648161    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb" podUID="3a6d9f4d-262d-4b38-85a1-96b3dfb8f419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 06 19:14:50.474483 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:50.474450    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-b7xzq"
Jul 06 19:14:50.474784 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:50.474765    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-4ksqd"
Jul 06 19:14:50.650587 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:50.650556    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:14:50.651444 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:14:50.651423    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-bqxcb"
Jul 06 19:15:00.143750 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:00.143701    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg"]
Jul 06 19:15:00.146696 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:00.146678    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg"
Jul 06 19:15:00.154486 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:00.154458    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg"]
Jul 06 19:15:00.258896 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:00.258859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb6jp\" (UniqueName: \"kubernetes.io/projected/bc0244e0-8ab6-4c7b-8dd1-6ce85041202c-kube-api-access-wb6jp\") pod \"maas-api-key-cleanup-29722755-rbhlg\" (UID: \"bc0244e0-8ab6-4c7b-8dd1-6ce85041202c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg"
Jul 06 19:15:00.359815 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:00.359780    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb6jp\" (UniqueName: \"kubernetes.io/projected/bc0244e0-8ab6-4c7b-8dd1-6ce85041202c-kube-api-access-wb6jp\") pod \"maas-api-key-cleanup-29722755-rbhlg\" (UID: \"bc0244e0-8ab6-4c7b-8dd1-6ce85041202c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg"
Jul 06 19:15:00.377185 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:00.377150    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb6jp\" (UniqueName: \"kubernetes.io/projected/bc0244e0-8ab6-4c7b-8dd1-6ce85041202c-kube-api-access-wb6jp\") pod \"maas-api-key-cleanup-29722755-rbhlg\" (UID: \"bc0244e0-8ab6-4c7b-8dd1-6ce85041202c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg"
Jul 06 19:15:00.458239 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:00.458209    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg"
Jul 06 19:15:00.585827 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:00.585805    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg"]
Jul 06 19:15:00.588310 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:15:00.588280    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0244e0_8ab6_4c7b_8dd1_6ce85041202c.slice/crio-3b6d1e6b358c3319bc90dd75330b32374335a39b5df6ac5db21e1c9b0fede73b WatchSource:0}: Error finding container 3b6d1e6b358c3319bc90dd75330b32374335a39b5df6ac5db21e1c9b0fede73b: Status 404 returned error can't find the container with id 3b6d1e6b358c3319bc90dd75330b32374335a39b5df6ac5db21e1c9b0fede73b
Jul 06 19:15:01.575974 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:01.575938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg" event={"ID":"bc0244e0-8ab6-4c7b-8dd1-6ce85041202c","Type":"ContainerStarted","Data":"3b6d1e6b358c3319bc90dd75330b32374335a39b5df6ac5db21e1c9b0fede73b"}
Jul 06 19:15:02.254748 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.254621    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"]
Jul 06 19:15:02.258756 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.258729    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.261381 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.261351    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jxxj4\""
Jul 06 19:15:02.261673 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.261654    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 19:15:02.261923 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.261907    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 19:15:02.262220 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.262192    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 19:15:02.267881 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.267817    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"]
Jul 06 19:15:02.379534 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.379499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f62f4f88-a1f7-425e-9501-25b97b80d0e2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.379534 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.379537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f62f4f88-a1f7-425e-9501-25b97b80d0e2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.379740 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.379561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f62f4f88-a1f7-425e-9501-25b97b80d0e2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.379740 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.379638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f62f4f88-a1f7-425e-9501-25b97b80d0e2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.379740 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.379675    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gp6w\" (UniqueName: \"kubernetes.io/projected/f62f4f88-a1f7-425e-9501-25b97b80d0e2-kube-api-access-9gp6w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.379846 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.379806    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f62f4f88-a1f7-425e-9501-25b97b80d0e2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.480886 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.480846    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f62f4f88-a1f7-425e-9501-25b97b80d0e2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.480886 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.480886    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f62f4f88-a1f7-425e-9501-25b97b80d0e2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.481135 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.480911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f62f4f88-a1f7-425e-9501-25b97b80d0e2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.481135 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.480949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f62f4f88-a1f7-425e-9501-25b97b80d0e2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.481135 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.480984    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gp6w\" (UniqueName: \"kubernetes.io/projected/f62f4f88-a1f7-425e-9501-25b97b80d0e2-kube-api-access-9gp6w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.481135 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.481073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f62f4f88-a1f7-425e-9501-25b97b80d0e2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.481358 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.481298    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f62f4f88-a1f7-425e-9501-25b97b80d0e2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.481570 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.481547    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f62f4f88-a1f7-425e-9501-25b97b80d0e2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.481701 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.481671    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f62f4f88-a1f7-425e-9501-25b97b80d0e2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.483614 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.483593    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f62f4f88-a1f7-425e-9501-25b97b80d0e2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.483923 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.483905    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f62f4f88-a1f7-425e-9501-25b97b80d0e2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.488974 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.488947    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gp6w\" (UniqueName: \"kubernetes.io/projected/f62f4f88-a1f7-425e-9501-25b97b80d0e2-kube-api-access-9gp6w\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx\" (UID: \"f62f4f88-a1f7-425e-9501-25b97b80d0e2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:02.573959 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:02.573868    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:03.196070 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:03.196041    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"]
Jul 06 19:15:03.197786 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:15:03.197754    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf62f4f88_a1f7_425e_9501_25b97b80d0e2.slice/crio-f74f9db7f17a9b07158349657be3893bf37042aa866fae81cbefc497dae26636 WatchSource:0}: Error finding container f74f9db7f17a9b07158349657be3893bf37042aa866fae81cbefc497dae26636: Status 404 returned error can't find the container with id f74f9db7f17a9b07158349657be3893bf37042aa866fae81cbefc497dae26636
Jul 06 19:15:03.589691 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:03.589646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx" event={"ID":"f62f4f88-a1f7-425e-9501-25b97b80d0e2","Type":"ContainerStarted","Data":"f74f9db7f17a9b07158349657be3893bf37042aa866fae81cbefc497dae26636"}
Jul 06 19:15:03.591733 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:03.591606    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg" event={"ID":"bc0244e0-8ab6-4c7b-8dd1-6ce85041202c","Type":"ContainerStarted","Data":"bde77d9c1ff209196fe561e7e8a244bea0635f5a88f47833e900c707fec8eddb"}
Jul 06 19:15:03.609464 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:03.609406    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg" podStartSLOduration=1.0625491870000001 podStartE2EDuration="3.609386013s" totalImagesPullingTime="2.546836826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:03.60659647 +0000 UTC m=+577.216723815" watchObservedRunningTime="2026-07-06 19:15:03.609386013 +0000 UTC m=+577.219513358"
Jul 06 19:15:04.597990 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:04.597900    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx" event={"ID":"f62f4f88-a1f7-425e-9501-25b97b80d0e2","Type":"ContainerStarted","Data":"906a22b5ab361cdf5c2ae9af809adfb6551569c5b16f7d2ea2cc662990dc55ff"}
Jul 06 19:15:04.614351 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:04.614295    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx" podStartSLOduration=1.545424149 podStartE2EDuration="2.614275124s" totalImagesPullingTime="1.068850975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:04.614100268 +0000 UTC m=+578.224227626" watchObservedRunningTime="2026-07-06 19:15:04.614275124 +0000 UTC m=+578.224402472"
Jul 06 19:15:12.574062 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:12.574020    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:12.574461 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:12.574118    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:12.586611 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:12.586584    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:12.645004 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:12.644972    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx"
Jul 06 19:15:26.780205 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:26.780175    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:15:26.780664 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:26.780216    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:15:30.950410 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:30.950369    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"]
Jul 06 19:15:30.953137 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:30.953110    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:30.955547 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:30.955515    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 06 19:15:30.965925 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:30.965896    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"]
Jul 06 19:15:31.040723 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.040671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34f6ca65-6880-435c-9c82-aa91776e1013-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.040723 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.040725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34f6ca65-6880-435c-9c82-aa91776e1013-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.040937 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.040812    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34f6ca65-6880-435c-9c82-aa91776e1013-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.040937 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.040856    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34f6ca65-6880-435c-9c82-aa91776e1013-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.040937 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.040885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwmrh\" (UniqueName: \"kubernetes.io/projected/34f6ca65-6880-435c-9c82-aa91776e1013-kube-api-access-rwmrh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.041038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.040951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34f6ca65-6880-435c-9c82-aa91776e1013-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.142119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.142078    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34f6ca65-6880-435c-9c82-aa91776e1013-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.142119 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.142122    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34f6ca65-6880-435c-9c82-aa91776e1013-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.142323 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.142153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34f6ca65-6880-435c-9c82-aa91776e1013-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.142323 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.142173    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34f6ca65-6880-435c-9c82-aa91776e1013-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.142323 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.142190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwmrh\" (UniqueName: \"kubernetes.io/projected/34f6ca65-6880-435c-9c82-aa91776e1013-kube-api-access-rwmrh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.142323 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.142216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34f6ca65-6880-435c-9c82-aa91776e1013-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.142649 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.142629    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34f6ca65-6880-435c-9c82-aa91776e1013-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.142747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.142673    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34f6ca65-6880-435c-9c82-aa91776e1013-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.142747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.142700    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34f6ca65-6880-435c-9c82-aa91776e1013-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.144444 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.144417    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34f6ca65-6880-435c-9c82-aa91776e1013-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.144687 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.144671    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34f6ca65-6880-435c-9c82-aa91776e1013-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.149976 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.149953    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwmrh\" (UniqueName: \"kubernetes.io/projected/34f6ca65-6880-435c-9c82-aa91776e1013-kube-api-access-rwmrh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8dnds\" (UID: \"34f6ca65-6880-435c-9c82-aa91776e1013\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.266367 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.266270    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:31.403463 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.403437    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"]
Jul 06 19:15:31.406128 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:15:31.406101    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34f6ca65_6880_435c_9c82_aa91776e1013.slice/crio-2cce0366b7e7cde2618160d6746dfb24be4f3e099a6c65321c481972820fdcec WatchSource:0}: Error finding container 2cce0366b7e7cde2618160d6746dfb24be4f3e099a6c65321c481972820fdcec: Status 404 returned error can't find the container with id 2cce0366b7e7cde2618160d6746dfb24be4f3e099a6c65321c481972820fdcec
Jul 06 19:15:31.724029 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.723995    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds" event={"ID":"34f6ca65-6880-435c-9c82-aa91776e1013","Type":"ContainerStarted","Data":"14a28dadf50bda89212d1a26ddfc3f3ce335fb97b26140fba1786d7cfa075d43"}
Jul 06 19:15:31.724170 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.724088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds" event={"ID":"34f6ca65-6880-435c-9c82-aa91776e1013","Type":"ContainerStarted","Data":"2cce0366b7e7cde2618160d6746dfb24be4f3e099a6c65321c481972820fdcec"}
Jul 06 19:15:31.742779 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:31.742725    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds" podStartSLOduration=1.550032394 podStartE2EDuration="1.742692573s" totalImagesPullingTime="192.660179ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:31.741658113 +0000 UTC m=+605.351785474" watchObservedRunningTime="2026-07-06 19:15:31.742692573 +0000 UTC m=+605.352819917"
Jul 06 19:15:36.544171 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.544136    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"]
Jul 06 19:15:36.546696 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.546674    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.549507 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.549483    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 06 19:15:36.557840 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.557817    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"]
Jul 06 19:15:36.591882 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.591847    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa6d0179-bd7a-4f61-983d-cac5136383de-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.592058 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.591899    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa6d0179-bd7a-4f61-983d-cac5136383de-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.592058 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.591917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa6d0179-bd7a-4f61-983d-cac5136383de-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.592058 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.591961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x97m7\" (UniqueName: \"kubernetes.io/projected/aa6d0179-bd7a-4f61-983d-cac5136383de-kube-api-access-x97m7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.592173 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.592069    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa6d0179-bd7a-4f61-983d-cac5136383de-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.592173 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.592151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa6d0179-bd7a-4f61-983d-cac5136383de-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.692866 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.692822    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa6d0179-bd7a-4f61-983d-cac5136383de-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.693057 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.692910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa6d0179-bd7a-4f61-983d-cac5136383de-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.693057 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.692932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa6d0179-bd7a-4f61-983d-cac5136383de-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.693057 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.692970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa6d0179-bd7a-4f61-983d-cac5136383de-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.693057 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.692988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa6d0179-bd7a-4f61-983d-cac5136383de-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.693057 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.693041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x97m7\" (UniqueName: \"kubernetes.io/projected/aa6d0179-bd7a-4f61-983d-cac5136383de-kube-api-access-x97m7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.693368 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.693344    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa6d0179-bd7a-4f61-983d-cac5136383de-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.693436 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.693394    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa6d0179-bd7a-4f61-983d-cac5136383de-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.693530 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.693499    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa6d0179-bd7a-4f61-983d-cac5136383de-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.695292 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.695262    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa6d0179-bd7a-4f61-983d-cac5136383de-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.695654 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.695629    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa6d0179-bd7a-4f61-983d-cac5136383de-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.701164 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.701138    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x97m7\" (UniqueName: \"kubernetes.io/projected/aa6d0179-bd7a-4f61-983d-cac5136383de-kube-api-access-x97m7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls\" (UID: \"aa6d0179-bd7a-4f61-983d-cac5136383de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:36.858580 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:36.858498    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:37.014830 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:37.014806    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"]
Jul 06 19:15:37.016782 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:15:37.016756    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6d0179_bd7a_4f61_983d_cac5136383de.slice/crio-451a0eb8ef813b56b6f269c33c989087e643be394d0154e35ca7ff8447ed6ecd WatchSource:0}: Error finding container 451a0eb8ef813b56b6f269c33c989087e643be394d0154e35ca7ff8447ed6ecd: Status 404 returned error can't find the container with id 451a0eb8ef813b56b6f269c33c989087e643be394d0154e35ca7ff8447ed6ecd
Jul 06 19:15:37.755547 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:37.755503    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls" event={"ID":"aa6d0179-bd7a-4f61-983d-cac5136383de","Type":"ContainerStarted","Data":"56552aa2bacab447e1630b7b24e4b78b36353dc086f903582b3438b0bd768b2e"}
Jul 06 19:15:37.756109 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:37.755568    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls" event={"ID":"aa6d0179-bd7a-4f61-983d-cac5136383de","Type":"ContainerStarted","Data":"451a0eb8ef813b56b6f269c33c989087e643be394d0154e35ca7ff8447ed6ecd"}
Jul 06 19:15:37.775923 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:37.775849    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls" podStartSLOduration=1.53500366 podStartE2EDuration="1.775832384s" totalImagesPullingTime="240.828724ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:37.775507355 +0000 UTC m=+611.385634721" watchObservedRunningTime="2026-07-06 19:15:37.775832384 +0000 UTC m=+611.385959727"
Jul 06 19:15:41.267092 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:41.267048    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:41.267502 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:41.267124    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:41.279770 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:41.279741    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:41.788518 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:41.788485    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8dnds"
Jul 06 19:15:46.858981 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:46.858946    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:46.859389 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:46.859019    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:46.871541 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:46.871515    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:15:47.817767 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:15:47.817738    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls"
Jul 06 19:16:00.011753 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:00.011649    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg"]
Jul 06 19:16:00.012229 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:00.011943    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg" podUID="bc0244e0-8ab6-4c7b-8dd1-6ce85041202c" containerName="cleanup" containerID="cri-o://bde77d9c1ff209196fe561e7e8a244bea0635f5a88f47833e900c707fec8eddb" gracePeriod=30
Jul 06 19:16:30.211257 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:30.211225    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg"
Jul 06 19:16:30.294041 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:30.293948    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb6jp\" (UniqueName: \"kubernetes.io/projected/bc0244e0-8ab6-4c7b-8dd1-6ce85041202c-kube-api-access-wb6jp\") pod \"bc0244e0-8ab6-4c7b-8dd1-6ce85041202c\" (UID: \"bc0244e0-8ab6-4c7b-8dd1-6ce85041202c\") "
Jul 06 19:16:30.296106 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:30.296075    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0244e0-8ab6-4c7b-8dd1-6ce85041202c-kube-api-access-wb6jp" (OuterVolumeSpecName: "kube-api-access-wb6jp") pod "bc0244e0-8ab6-4c7b-8dd1-6ce85041202c" (UID: "bc0244e0-8ab6-4c7b-8dd1-6ce85041202c"). InnerVolumeSpecName "kube-api-access-wb6jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:16:30.395553 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:30.395521    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb6jp\" (UniqueName: \"kubernetes.io/projected/bc0244e0-8ab6-4c7b-8dd1-6ce85041202c-kube-api-access-wb6jp\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:16:31.004258 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:31.004221    2580 generic.go:356] "Generic (PLEG): container finished" podID="bc0244e0-8ab6-4c7b-8dd1-6ce85041202c" containerID="bde77d9c1ff209196fe561e7e8a244bea0635f5a88f47833e900c707fec8eddb" exitCode=137
Jul 06 19:16:31.004459 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:31.004263    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg"
Jul 06 19:16:31.004459 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:31.004281    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg" event={"ID":"bc0244e0-8ab6-4c7b-8dd1-6ce85041202c","Type":"ContainerDied","Data":"bde77d9c1ff209196fe561e7e8a244bea0635f5a88f47833e900c707fec8eddb"}
Jul 06 19:16:31.004459 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:31.004345    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg" event={"ID":"bc0244e0-8ab6-4c7b-8dd1-6ce85041202c","Type":"ContainerDied","Data":"3b6d1e6b358c3319bc90dd75330b32374335a39b5df6ac5db21e1c9b0fede73b"}
Jul 06 19:16:31.004459 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:31.004375    2580 scope.go:117] "RemoveContainer" containerID="bde77d9c1ff209196fe561e7e8a244bea0635f5a88f47833e900c707fec8eddb"
Jul 06 19:16:31.012858 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:31.012839    2580 scope.go:117] "RemoveContainer" containerID="bde77d9c1ff209196fe561e7e8a244bea0635f5a88f47833e900c707fec8eddb"
Jul 06 19:16:31.013143 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:16:31.013123    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bde77d9c1ff209196fe561e7e8a244bea0635f5a88f47833e900c707fec8eddb\": container with ID starting with bde77d9c1ff209196fe561e7e8a244bea0635f5a88f47833e900c707fec8eddb not found: ID does not exist" containerID="bde77d9c1ff209196fe561e7e8a244bea0635f5a88f47833e900c707fec8eddb"
Jul 06 19:16:31.013219 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:31.013152    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bde77d9c1ff209196fe561e7e8a244bea0635f5a88f47833e900c707fec8eddb"} err="failed to get container status \"bde77d9c1ff209196fe561e7e8a244bea0635f5a88f47833e900c707fec8eddb\": rpc error: code = NotFound desc = could not find container \"bde77d9c1ff209196fe561e7e8a244bea0635f5a88f47833e900c707fec8eddb\": container with ID starting with bde77d9c1ff209196fe561e7e8a244bea0635f5a88f47833e900c707fec8eddb not found: ID does not exist"
Jul 06 19:16:31.022663 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:31.022639    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg"]
Jul 06 19:16:31.027696 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:31.027675    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722755-rbhlg"]
Jul 06 19:16:32.850760 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:16:32.850726    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc0244e0-8ab6-4c7b-8dd1-6ce85041202c" path="/var/lib/kubelet/pods/bc0244e0-8ab6-4c7b-8dd1-6ce85041202c/volumes"
Jul 06 19:18:08.979316 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:08.979276    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86c44fb47b-qthlc"]
Jul 06 19:18:08.979818 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:08.979481    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-86c44fb47b-qthlc" podUID="9b1f16fa-679e-4632-bd2c-7ac57b2c1970" containerName="manager" containerID="cri-o://f99d8400b33ecaa05509144ce33accda9a3f73691eae075eee0b1a7ef0828efb" gracePeriod=30
Jul 06 19:18:09.233663 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.233598    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c44fb47b-qthlc"
Jul 06 19:18:09.272413 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.272378    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzxfb\" (UniqueName: \"kubernetes.io/projected/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-kube-api-access-jzxfb\") pod \"9b1f16fa-679e-4632-bd2c-7ac57b2c1970\" (UID: \"9b1f16fa-679e-4632-bd2c-7ac57b2c1970\") "
Jul 06 19:18:09.272595 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.272428    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-webhook-cert\") pod \"9b1f16fa-679e-4632-bd2c-7ac57b2c1970\" (UID: \"9b1f16fa-679e-4632-bd2c-7ac57b2c1970\") "
Jul 06 19:18:09.274637 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.274601    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-kube-api-access-jzxfb" (OuterVolumeSpecName: "kube-api-access-jzxfb") pod "9b1f16fa-679e-4632-bd2c-7ac57b2c1970" (UID: "9b1f16fa-679e-4632-bd2c-7ac57b2c1970"). InnerVolumeSpecName "kube-api-access-jzxfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:18:09.275042 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.275009    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9b1f16fa-679e-4632-bd2c-7ac57b2c1970" (UID: "9b1f16fa-679e-4632-bd2c-7ac57b2c1970"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:18:09.373994 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.373949    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzxfb\" (UniqueName: \"kubernetes.io/projected/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-kube-api-access-jzxfb\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:18:09.373994 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.373989    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9b1f16fa-679e-4632-bd2c-7ac57b2c1970-webhook-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:18:09.469040 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.469008    2580 generic.go:356] "Generic (PLEG): container finished" podID="9b1f16fa-679e-4632-bd2c-7ac57b2c1970" containerID="f99d8400b33ecaa05509144ce33accda9a3f73691eae075eee0b1a7ef0828efb" exitCode=0
Jul 06 19:18:09.469215 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.469046    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c44fb47b-qthlc"
Jul 06 19:18:09.469215 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.469083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c44fb47b-qthlc" event={"ID":"9b1f16fa-679e-4632-bd2c-7ac57b2c1970","Type":"ContainerDied","Data":"f99d8400b33ecaa05509144ce33accda9a3f73691eae075eee0b1a7ef0828efb"}
Jul 06 19:18:09.469215 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.469134    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c44fb47b-qthlc" event={"ID":"9b1f16fa-679e-4632-bd2c-7ac57b2c1970","Type":"ContainerDied","Data":"b46e9221124e224649ea653ae262665af92b3d06ce1cecc56bbb65b11b3da6cd"}
Jul 06 19:18:09.469215 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.469155    2580 scope.go:117] "RemoveContainer" containerID="f99d8400b33ecaa05509144ce33accda9a3f73691eae075eee0b1a7ef0828efb"
Jul 06 19:18:09.481301 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.481282    2580 scope.go:117] "RemoveContainer" containerID="f99d8400b33ecaa05509144ce33accda9a3f73691eae075eee0b1a7ef0828efb"
Jul 06 19:18:09.481619 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:18:09.481600    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f99d8400b33ecaa05509144ce33accda9a3f73691eae075eee0b1a7ef0828efb\": container with ID starting with f99d8400b33ecaa05509144ce33accda9a3f73691eae075eee0b1a7ef0828efb not found: ID does not exist" containerID="f99d8400b33ecaa05509144ce33accda9a3f73691eae075eee0b1a7ef0828efb"
Jul 06 19:18:09.481681 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.481629    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f99d8400b33ecaa05509144ce33accda9a3f73691eae075eee0b1a7ef0828efb"} err="failed to get container status \"f99d8400b33ecaa05509144ce33accda9a3f73691eae075eee0b1a7ef0828efb\": rpc error: code = NotFound desc = could not find container \"f99d8400b33ecaa05509144ce33accda9a3f73691eae075eee0b1a7ef0828efb\": container with ID starting with f99d8400b33ecaa05509144ce33accda9a3f73691eae075eee0b1a7ef0828efb not found: ID does not exist"
Jul 06 19:18:09.491583 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.491513    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86c44fb47b-qthlc"]
Jul 06 19:18:09.495840 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:09.495818    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-86c44fb47b-qthlc"]
Jul 06 19:18:10.252633 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.252602    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86c44fb47b-zhl2z"]
Jul 06 19:18:10.253033 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.253007    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc0244e0-8ab6-4c7b-8dd1-6ce85041202c" containerName="cleanup"
Jul 06 19:18:10.253033 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.253020    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc0244e0-8ab6-4c7b-8dd1-6ce85041202c" containerName="cleanup"
Jul 06 19:18:10.253033 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.253027    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b1f16fa-679e-4632-bd2c-7ac57b2c1970" containerName="manager"
Jul 06 19:18:10.253033 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.253033    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b1f16fa-679e-4632-bd2c-7ac57b2c1970" containerName="manager"
Jul 06 19:18:10.253164 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.253102    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b1f16fa-679e-4632-bd2c-7ac57b2c1970" containerName="manager"
Jul 06 19:18:10.253164 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.253110    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc0244e0-8ab6-4c7b-8dd1-6ce85041202c" containerName="cleanup"
Jul 06 19:18:10.257295 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.257277    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c44fb47b-zhl2z"
Jul 06 19:18:10.259799 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.259776    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:18:10.260315 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.260300    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c274b\""
Jul 06 19:18:10.260408 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.260321    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 19:18:10.269295 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.269269    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86c44fb47b-zhl2z"]
Jul 06 19:18:10.383439 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.383396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48b1484a-dea1-4511-84a1-c42b61c5a387-webhook-cert\") pod \"maas-controller-86c44fb47b-zhl2z\" (UID: \"48b1484a-dea1-4511-84a1-c42b61c5a387\") " pod="opendatahub/maas-controller-86c44fb47b-zhl2z"
Jul 06 19:18:10.383611 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.383451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zwpj\" (UniqueName: \"kubernetes.io/projected/48b1484a-dea1-4511-84a1-c42b61c5a387-kube-api-access-5zwpj\") pod \"maas-controller-86c44fb47b-zhl2z\" (UID: \"48b1484a-dea1-4511-84a1-c42b61c5a387\") " pod="opendatahub/maas-controller-86c44fb47b-zhl2z"
Jul 06 19:18:10.483910 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.483879    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48b1484a-dea1-4511-84a1-c42b61c5a387-webhook-cert\") pod \"maas-controller-86c44fb47b-zhl2z\" (UID: \"48b1484a-dea1-4511-84a1-c42b61c5a387\") " pod="opendatahub/maas-controller-86c44fb47b-zhl2z"
Jul 06 19:18:10.484103 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.483924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zwpj\" (UniqueName: \"kubernetes.io/projected/48b1484a-dea1-4511-84a1-c42b61c5a387-kube-api-access-5zwpj\") pod \"maas-controller-86c44fb47b-zhl2z\" (UID: \"48b1484a-dea1-4511-84a1-c42b61c5a387\") " pod="opendatahub/maas-controller-86c44fb47b-zhl2z"
Jul 06 19:18:10.486357 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.486332    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48b1484a-dea1-4511-84a1-c42b61c5a387-webhook-cert\") pod \"maas-controller-86c44fb47b-zhl2z\" (UID: \"48b1484a-dea1-4511-84a1-c42b61c5a387\") " pod="opendatahub/maas-controller-86c44fb47b-zhl2z"
Jul 06 19:18:10.492120 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.492099    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zwpj\" (UniqueName: \"kubernetes.io/projected/48b1484a-dea1-4511-84a1-c42b61c5a387-kube-api-access-5zwpj\") pod \"maas-controller-86c44fb47b-zhl2z\" (UID: \"48b1484a-dea1-4511-84a1-c42b61c5a387\") " pod="opendatahub/maas-controller-86c44fb47b-zhl2z"
Jul 06 19:18:10.568286 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.568199    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86c44fb47b-zhl2z"
Jul 06 19:18:10.705900 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.705764    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86c44fb47b-zhl2z"]
Jul 06 19:18:10.708252 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:18:10.708225    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b1484a_dea1_4511_84a1_c42b61c5a387.slice/crio-b86e08aff4bc86ae2200e32089f1f367dd3ca6cf4ee7b9c576f8b5478bbebc97 WatchSource:0}: Error finding container b86e08aff4bc86ae2200e32089f1f367dd3ca6cf4ee7b9c576f8b5478bbebc97: Status 404 returned error can't find the container with id b86e08aff4bc86ae2200e32089f1f367dd3ca6cf4ee7b9c576f8b5478bbebc97
Jul 06 19:18:10.709481 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.709464    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:18:10.851381 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:10.851303    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b1f16fa-679e-4632-bd2c-7ac57b2c1970" path="/var/lib/kubelet/pods/9b1f16fa-679e-4632-bd2c-7ac57b2c1970/volumes"
Jul 06 19:18:11.484473 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:11.484379    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c44fb47b-zhl2z" event={"ID":"48b1484a-dea1-4511-84a1-c42b61c5a387","Type":"ContainerStarted","Data":"d884d671436a000f942f3410f27e7db3a13b8b60bdc26e9e32daaa4421496bde"}
Jul 06 19:18:11.484473 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:11.484429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86c44fb47b-zhl2z" event={"ID":"48b1484a-dea1-4511-84a1-c42b61c5a387","Type":"ContainerStarted","Data":"b86e08aff4bc86ae2200e32089f1f367dd3ca6cf4ee7b9c576f8b5478bbebc97"}
Jul 06 19:18:11.484935 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:11.484524    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86c44fb47b-zhl2z"
Jul 06 19:18:11.504641 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:11.504595    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86c44fb47b-zhl2z" podStartSLOduration=1.03510426 podStartE2EDuration="1.504580336s" totalImagesPullingTime="469.476076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:18:11.502906072 +0000 UTC m=+765.113033417" watchObservedRunningTime="2026-07-06 19:18:11.504580336 +0000 UTC m=+765.114707680"
Jul 06 19:18:22.495286 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:18:22.495253    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86c44fb47b-zhl2z"
Jul 06 19:20:26.816056 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:20:26.815972    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:20:26.817684 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:20:26.817662    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:25:26.845274 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:25:26.845231    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:25:26.848726 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:25:26.848683    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:30:00.144222 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:00.144187    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r"]
Jul 06 19:30:00.147589 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:00.147571    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r"
Jul 06 19:30:00.229888 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:00.229849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zk82\" (UniqueName: \"kubernetes.io/projected/05adc521-25b6-4448-96a2-d7deb3dfc1af-kube-api-access-8zk82\") pod \"maas-api-key-cleanup-29722770-kfh9r\" (UID: \"05adc521-25b6-4448-96a2-d7deb3dfc1af\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r"
Jul 06 19:30:00.331149 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:00.331098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zk82\" (UniqueName: \"kubernetes.io/projected/05adc521-25b6-4448-96a2-d7deb3dfc1af-kube-api-access-8zk82\") pod \"maas-api-key-cleanup-29722770-kfh9r\" (UID: \"05adc521-25b6-4448-96a2-d7deb3dfc1af\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r"
Jul 06 19:30:00.340670 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:00.340644    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zk82\" (UniqueName: \"kubernetes.io/projected/05adc521-25b6-4448-96a2-d7deb3dfc1af-kube-api-access-8zk82\") pod \"maas-api-key-cleanup-29722770-kfh9r\" (UID: \"05adc521-25b6-4448-96a2-d7deb3dfc1af\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r"
Jul 06 19:30:00.458101 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:00.458066    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r"
Jul 06 19:30:10.156555 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:30:10.156499    2580 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"05adc521-25b6-4448-96a2-d7deb3dfc1af\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-06T19:30:00Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-06T19:30:00Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-06T19:30:00Z\\\",\\\"message\\\":\\\"containers with unready status: [cleanup]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-06T19:30:00Z\\\",\\\"message\\\":\\\"containers with unready status: [cleanup]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/ubi9/ubi-minimal:9.7\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cleanup\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-8zk82\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.133.117\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.133.117\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-06T19:30:00Z\\\"}}\" for pod \"odh-ai-gateway-infra\"/\"maas-api-key-cleanup-29722770-kfh9r\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-a2c4e423-acf9-4db5-8b82-c4324e0722b0.svc:9743/pod?timeout=10s\": context deadline exceeded" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r"
Jul 06 19:30:10.185536 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:10.185504    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r"]
Jul 06 19:30:10.425390 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:10.425138    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r"]
Jul 06 19:30:10.430958 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:30:10.430930    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05adc521_25b6_4448_96a2_d7deb3dfc1af.slice/crio-a51a090ac1104ffb42fab553f573c651c5de25b447bac8e399e4c96888eb9999 WatchSource:0}: Error finding container a51a090ac1104ffb42fab553f573c651c5de25b447bac8e399e4c96888eb9999: Status 404 returned error can't find the container with id a51a090ac1104ffb42fab553f573c651c5de25b447bac8e399e4c96888eb9999
Jul 06 19:30:10.922097 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:10.922051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r" event={"ID":"05adc521-25b6-4448-96a2-d7deb3dfc1af","Type":"ContainerStarted","Data":"50ceb87a870ca8209339270cdfc5628bc108f6923d835f94969f96365ab99229"}
Jul 06 19:30:10.922264 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:10.922120    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r" event={"ID":"05adc521-25b6-4448-96a2-d7deb3dfc1af","Type":"ContainerStarted","Data":"a51a090ac1104ffb42fab553f573c651c5de25b447bac8e399e4c96888eb9999"}
Jul 06 19:30:10.940853 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:10.940806    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r" podStartSLOduration=10.940793589 podStartE2EDuration="10.940793589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:10.938980003 +0000 UTC m=+1484.549107348" watchObservedRunningTime="2026-07-06 19:30:10.940793589 +0000 UTC m=+1484.550920932"
Jul 06 19:30:18.488655 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.488616    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"]
Jul 06 19:30:18.492355 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.492333    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.496063 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.496040    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-eb7bdc2e-openshift-default-dockercfg-9f8gs\""
Jul 06 19:30:18.498527 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.498497    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istiod-ca-cert\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.498661 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.498543    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-workload-socket\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.498661 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.498582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-token\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.498661 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.498635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-envoy\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.498816 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.498669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-podinfo\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.498816 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.498720    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dblpr\" (UniqueName: \"kubernetes.io/projected/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-kube-api-access-dblpr\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.498816 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.498763    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-credential-socket\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.498816 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.498808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-data\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.498958 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.498839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-workload-certs\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.515832 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.515801    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"]
Jul 06 19:30:18.599417 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.599384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istiod-ca-cert\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.599417 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.599422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-workload-socket\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.599667 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.599444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-token\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.599667 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.599483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-envoy\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.599667 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.599502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-podinfo\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.599667 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.599536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dblpr\" (UniqueName: \"kubernetes.io/projected/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-kube-api-access-dblpr\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.599903 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.599867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-credential-socket\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.599959 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.599891    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-workload-socket\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.599959 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.599909    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-data\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.600069 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.599962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-workload-certs\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.600219 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.600200    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-data\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.600307 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.600225    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istiod-ca-cert\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.600307 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.600266    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-credential-socket\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.600385 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.600333    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-workload-certs\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.601900 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.601882    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-envoy\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.602162 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.602144    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-podinfo\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.610389 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.610363    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-token\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.610980 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.610958    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dblpr\" (UniqueName: \"kubernetes.io/projected/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-kube-api-access-dblpr\") pod \"e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") " pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.803378 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.803287    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:18.945771 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.945660    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"]
Jul 06 19:30:18.948205 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:30:18.948178    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode40d5667_2c2f_48ef_8f7c_a64d6846f0e7.slice/crio-8cb777f8cca6cd03a2f13de905a5608529ad4a865f36cc468012c6d7170fab93 WatchSource:0}: Error finding container 8cb777f8cca6cd03a2f13de905a5608529ad4a865f36cc468012c6d7170fab93: Status 404 returned error can't find the container with id 8cb777f8cca6cd03a2f13de905a5608529ad4a865f36cc468012c6d7170fab93
Jul 06 19:30:18.950176 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.950138    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:18.950244 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.950203    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:18.950244 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.950236    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:18.963379 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:18.963358    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw" event={"ID":"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7","Type":"ContainerStarted","Data":"8cb777f8cca6cd03a2f13de905a5608529ad4a865f36cc468012c6d7170fab93"}
Jul 06 19:30:19.741874 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.741833    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"]
Jul 06 19:30:19.745376 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.745347    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:19.748160 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.748138    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-eb7bdc2e-serving-cert\""
Jul 06 19:30:19.761005 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.760981    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"]
Jul 06 19:30:19.809147 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.809112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfbjk\" (UniqueName: \"kubernetes.io/projected/becd71ab-7361-4766-b2e9-358a9e03475f-kube-api-access-bfbjk\") pod \"maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8\" (UID: \"becd71ab-7361-4766-b2e9-358a9e03475f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:19.809312 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.809156    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becd71ab-7361-4766-b2e9-358a9e03475f-maas-api-tls\") pod \"maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8\" (UID: \"becd71ab-7361-4766-b2e9-358a9e03475f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:19.809312 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.809231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becd71ab-7361-4766-b2e9-358a9e03475f-openshift-service-ca\") pod \"maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8\" (UID: \"becd71ab-7361-4766-b2e9-358a9e03475f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:19.910074 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.910041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfbjk\" (UniqueName: \"kubernetes.io/projected/becd71ab-7361-4766-b2e9-358a9e03475f-kube-api-access-bfbjk\") pod \"maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8\" (UID: \"becd71ab-7361-4766-b2e9-358a9e03475f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:19.910267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.910086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becd71ab-7361-4766-b2e9-358a9e03475f-maas-api-tls\") pod \"maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8\" (UID: \"becd71ab-7361-4766-b2e9-358a9e03475f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:19.910267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.910129    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becd71ab-7361-4766-b2e9-358a9e03475f-openshift-service-ca\") pod \"maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8\" (UID: \"becd71ab-7361-4766-b2e9-358a9e03475f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:19.910908 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.910886    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becd71ab-7361-4766-b2e9-358a9e03475f-openshift-service-ca\") pod \"maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8\" (UID: \"becd71ab-7361-4766-b2e9-358a9e03475f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:19.912685 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.912662    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becd71ab-7361-4766-b2e9-358a9e03475f-maas-api-tls\") pod \"maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8\" (UID: \"becd71ab-7361-4766-b2e9-358a9e03475f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:19.920447 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.920419    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfbjk\" (UniqueName: \"kubernetes.io/projected/becd71ab-7361-4766-b2e9-358a9e03475f-kube-api-access-bfbjk\") pod \"maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8\" (UID: \"becd71ab-7361-4766-b2e9-358a9e03475f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:19.969852 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.969820    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw" event={"ID":"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7","Type":"ContainerStarted","Data":"33435ac219f5c2daf301bf9f891473c3a4da041c6aac93ebe1eca462fe76d436"}
Jul 06 19:30:19.993138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:19.993056    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw" podStartSLOduration=1.9930420629999999 podStartE2EDuration="1.993042063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:19.991309388 +0000 UTC m=+1493.601436744" watchObservedRunningTime="2026-07-06 19:30:19.993042063 +0000 UTC m=+1493.603169407"
Jul 06 19:30:20.058363 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:20.058338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:20.196323 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:20.196295    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"]
Jul 06 19:30:20.199204 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:30:20.199174    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbecd71ab_7361_4766_b2e9_358a9e03475f.slice/crio-71c6bc5f5bedcf5c1e0ff8239b1a53ecb6e5eb672086299d75f6cdf812b7aa0f WatchSource:0}: Error finding container 71c6bc5f5bedcf5c1e0ff8239b1a53ecb6e5eb672086299d75f6cdf812b7aa0f: Status 404 returned error can't find the container with id 71c6bc5f5bedcf5c1e0ff8239b1a53ecb6e5eb672086299d75f6cdf812b7aa0f
Jul 06 19:30:20.200594 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:20.200574    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:30:20.803693 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:20.803672    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:20.808701 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:20.808680    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:20.977217 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:20.977124    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8" event={"ID":"becd71ab-7361-4766-b2e9-358a9e03475f","Type":"ContainerStarted","Data":"18410bed2a2d590df3e1fc210d62cc46bb50eb31724af0e40b1c3f5365302b72"}
Jul 06 19:30:20.977217 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:20.977176    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8" event={"ID":"becd71ab-7361-4766-b2e9-358a9e03475f","Type":"ContainerStarted","Data":"71c6bc5f5bedcf5c1e0ff8239b1a53ecb6e5eb672086299d75f6cdf812b7aa0f"}
Jul 06 19:30:20.977470 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:20.977376    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:20.977470 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:20.977422    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:20.978329 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:20.978311    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:21.012754 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:21.012678    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8" podStartSLOduration=1.4902859099999999 podStartE2EDuration="2.012662545s" totalImagesPullingTime="522.376635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:21.011452778 +0000 UTC m=+1494.621580123" watchObservedRunningTime="2026-07-06 19:30:21.012662545 +0000 UTC m=+1494.622789889"
Jul 06 19:30:24.940637 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:24.940597    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"]
Jul 06 19:30:24.941779 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:24.941748    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw" podUID="e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" containerName="istio-proxy" containerID="cri-o://33435ac219f5c2daf301bf9f891473c3a4da041c6aac93ebe1eca462fe76d436" gracePeriod=30
Jul 06 19:30:25.175488 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:25.175448    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"]
Jul 06 19:30:25.175696 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:25.175670    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8" podUID="becd71ab-7361-4766-b2e9-358a9e03475f" containerName="maas-api" containerID="cri-o://18410bed2a2d590df3e1fc210d62cc46bb50eb31724af0e40b1c3f5365302b72" gracePeriod=30
Jul 06 19:30:25.181311 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:25.181286    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:25.463953 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:25.463886    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:25.564082 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:25.564046    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfbjk\" (UniqueName: \"kubernetes.io/projected/becd71ab-7361-4766-b2e9-358a9e03475f-kube-api-access-bfbjk\") pod \"becd71ab-7361-4766-b2e9-358a9e03475f\" (UID: \"becd71ab-7361-4766-b2e9-358a9e03475f\") "
Jul 06 19:30:25.564082 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:25.564086    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becd71ab-7361-4766-b2e9-358a9e03475f-openshift-service-ca\") pod \"becd71ab-7361-4766-b2e9-358a9e03475f\" (UID: \"becd71ab-7361-4766-b2e9-358a9e03475f\") "
Jul 06 19:30:25.564292 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:25.564132    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becd71ab-7361-4766-b2e9-358a9e03475f-maas-api-tls\") pod \"becd71ab-7361-4766-b2e9-358a9e03475f\" (UID: \"becd71ab-7361-4766-b2e9-358a9e03475f\") "
Jul 06 19:30:25.564425 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:25.564400    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/becd71ab-7361-4766-b2e9-358a9e03475f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "becd71ab-7361-4766-b2e9-358a9e03475f" (UID: "becd71ab-7361-4766-b2e9-358a9e03475f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:30:25.566244 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:25.566209    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/becd71ab-7361-4766-b2e9-358a9e03475f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "becd71ab-7361-4766-b2e9-358a9e03475f" (UID: "becd71ab-7361-4766-b2e9-358a9e03475f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:30:25.566244 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:25.566229    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/becd71ab-7361-4766-b2e9-358a9e03475f-kube-api-access-bfbjk" (OuterVolumeSpecName: "kube-api-access-bfbjk") pod "becd71ab-7361-4766-b2e9-358a9e03475f" (UID: "becd71ab-7361-4766-b2e9-358a9e03475f"). InnerVolumeSpecName "kube-api-access-bfbjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:30:25.665127 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:25.665088    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becd71ab-7361-4766-b2e9-358a9e03475f-maas-api-tls\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:25.665127 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:25.665121    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfbjk\" (UniqueName: \"kubernetes.io/projected/becd71ab-7361-4766-b2e9-358a9e03475f-kube-api-access-bfbjk\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:25.665127 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:25.665133    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becd71ab-7361-4766-b2e9-358a9e03475f-openshift-service-ca\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:26.004813 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:26.004782    2580 generic.go:356] "Generic (PLEG): container finished" podID="becd71ab-7361-4766-b2e9-358a9e03475f" containerID="18410bed2a2d590df3e1fc210d62cc46bb50eb31724af0e40b1c3f5365302b72" exitCode=0
Jul 06 19:30:26.005259 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:26.004819    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8" event={"ID":"becd71ab-7361-4766-b2e9-358a9e03475f","Type":"ContainerDied","Data":"18410bed2a2d590df3e1fc210d62cc46bb50eb31724af0e40b1c3f5365302b72"}
Jul 06 19:30:26.005259 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:26.004827    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"
Jul 06 19:30:26.005259 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:26.004861    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8" event={"ID":"becd71ab-7361-4766-b2e9-358a9e03475f","Type":"ContainerDied","Data":"71c6bc5f5bedcf5c1e0ff8239b1a53ecb6e5eb672086299d75f6cdf812b7aa0f"}
Jul 06 19:30:26.005259 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:26.004884    2580 scope.go:117] "RemoveContainer" containerID="18410bed2a2d590df3e1fc210d62cc46bb50eb31724af0e40b1c3f5365302b72"
Jul 06 19:30:26.014831 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:26.014682    2580 scope.go:117] "RemoveContainer" containerID="18410bed2a2d590df3e1fc210d62cc46bb50eb31724af0e40b1c3f5365302b72"
Jul 06 19:30:26.015044 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:30:26.015014    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18410bed2a2d590df3e1fc210d62cc46bb50eb31724af0e40b1c3f5365302b72\": container with ID starting with 18410bed2a2d590df3e1fc210d62cc46bb50eb31724af0e40b1c3f5365302b72 not found: ID does not exist" containerID="18410bed2a2d590df3e1fc210d62cc46bb50eb31724af0e40b1c3f5365302b72"
Jul 06 19:30:26.015128 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:26.015058    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18410bed2a2d590df3e1fc210d62cc46bb50eb31724af0e40b1c3f5365302b72"} err="failed to get container status \"18410bed2a2d590df3e1fc210d62cc46bb50eb31724af0e40b1c3f5365302b72\": rpc error: code = NotFound desc = could not find container \"18410bed2a2d590df3e1fc210d62cc46bb50eb31724af0e40b1c3f5365302b72\": container with ID starting with 18410bed2a2d590df3e1fc210d62cc46bb50eb31724af0e40b1c3f5365302b72 not found: ID does not exist"
Jul 06 19:30:26.030795 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:26.030760    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"]
Jul 06 19:30:26.037750 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:26.033697    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eb7bdc2e-575df6b7c-xs4g8"]
Jul 06 19:30:26.854274 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:26.854170    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="becd71ab-7361-4766-b2e9-358a9e03475f" path="/var/lib/kubelet/pods/becd71ab-7361-4766-b2e9-358a9e03475f/volumes"
Jul 06 19:30:26.880494 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:26.880470    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:30:26.884964 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:26.884941    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:30:30.201791 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.201764    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:30.311890 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.311799    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-workload-certs\") pod \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") "
Jul 06 19:30:30.311890 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.311842    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-data\") pod \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") "
Jul 06 19:30:30.311890 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.311867    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-envoy\") pod \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") "
Jul 06 19:30:30.312140 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.311905    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dblpr\" (UniqueName: \"kubernetes.io/projected/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-kube-api-access-dblpr\") pod \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") "
Jul 06 19:30:30.312140 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.311947    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-podinfo\") pod \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") "
Jul 06 19:30:30.312140 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.311993    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-token\") pod \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") "
Jul 06 19:30:30.312140 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.312034    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-workload-socket\") pod \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") "
Jul 06 19:30:30.312140 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.312066    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istiod-ca-cert\") pod \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") "
Jul 06 19:30:30.312140 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.312117    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-credential-socket\") pod \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\" (UID: \"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7\") "
Jul 06 19:30:30.312466 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.312141    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" (UID: "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:30.312466 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.312287    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" (UID: "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:30.312570 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.312464    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" (UID: "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:30:30.312570 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.312480    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-workload-certs\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:30.312570 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.312498    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-workload-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:30.312773 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.312740    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" (UID: "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:30.312842 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.312813    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" (UID: "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:30.314377 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.314349    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-kube-api-access-dblpr" (OuterVolumeSpecName: "kube-api-access-dblpr") pod "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" (UID: "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7"). InnerVolumeSpecName "kube-api-access-dblpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:30:30.314479 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.314437    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" (UID: "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:30:30.314614 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.314583    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" (UID: "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:30:30.314614 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.314609    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" (UID: "e40d5667-2c2f-48ef-8f7c-a64d6846f0e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:30.413617 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.413581    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-token\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:30.413617 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.413612    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istiod-ca-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:30.413617 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.413622    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-credential-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:30.413874 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.413632    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-data\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:30.413874 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.413640    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-envoy\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:30.413874 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.413648    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dblpr\" (UniqueName: \"kubernetes.io/projected/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-kube-api-access-dblpr\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:30.413874 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:30.413656    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7-istio-podinfo\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:31.033081 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.033047    2580 generic.go:356] "Generic (PLEG): container finished" podID="e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" containerID="33435ac219f5c2daf301bf9f891473c3a4da041c6aac93ebe1eca462fe76d436" exitCode=0
Jul 06 19:30:31.033258 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.033097    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"
Jul 06 19:30:31.033258 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.033135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw" event={"ID":"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7","Type":"ContainerDied","Data":"33435ac219f5c2daf301bf9f891473c3a4da041c6aac93ebe1eca462fe76d436"}
Jul 06 19:30:31.033258 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.033195    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw" event={"ID":"e40d5667-2c2f-48ef-8f7c-a64d6846f0e7","Type":"ContainerDied","Data":"8cb777f8cca6cd03a2f13de905a5608529ad4a865f36cc468012c6d7170fab93"}
Jul 06 19:30:31.033258 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.033231    2580 scope.go:117] "RemoveContainer" containerID="33435ac219f5c2daf301bf9f891473c3a4da041c6aac93ebe1eca462fe76d436"
Jul 06 19:30:31.042317 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.042298    2580 scope.go:117] "RemoveContainer" containerID="33435ac219f5c2daf301bf9f891473c3a4da041c6aac93ebe1eca462fe76d436"
Jul 06 19:30:31.042605 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:30:31.042570    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33435ac219f5c2daf301bf9f891473c3a4da041c6aac93ebe1eca462fe76d436\": container with ID starting with 33435ac219f5c2daf301bf9f891473c3a4da041c6aac93ebe1eca462fe76d436 not found: ID does not exist" containerID="33435ac219f5c2daf301bf9f891473c3a4da041c6aac93ebe1eca462fe76d436"
Jul 06 19:30:31.042720 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.042600    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33435ac219f5c2daf301bf9f891473c3a4da041c6aac93ebe1eca462fe76d436"} err="failed to get container status \"33435ac219f5c2daf301bf9f891473c3a4da041c6aac93ebe1eca462fe76d436\": rpc error: code = NotFound desc = could not find container \"33435ac219f5c2daf301bf9f891473c3a4da041c6aac93ebe1eca462fe76d436\": container with ID starting with 33435ac219f5c2daf301bf9f891473c3a4da041c6aac93ebe1eca462fe76d436 not found: ID does not exist"
Jul 06 19:30:31.056216 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.056191    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"]
Jul 06 19:30:31.059426 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.059405    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-eb7bdc2e-openshift-default-5b4b7b6999-hhxkw"]
Jul 06 19:30:31.453672 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.453639    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"]
Jul 06 19:30:31.454323 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.454299    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" containerName="istio-proxy"
Jul 06 19:30:31.454385 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.454327    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" containerName="istio-proxy"
Jul 06 19:30:31.454385 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.454353    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="becd71ab-7361-4766-b2e9-358a9e03475f" containerName="maas-api"
Jul 06 19:30:31.454385 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.454362    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="becd71ab-7361-4766-b2e9-358a9e03475f" containerName="maas-api"
Jul 06 19:30:31.454539 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.454465    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="becd71ab-7361-4766-b2e9-358a9e03475f" containerName="maas-api"
Jul 06 19:30:31.454539 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.454483    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" containerName="istio-proxy"
Jul 06 19:30:31.459345 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.459320    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.461633 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.461611    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-116338c4-openshift-default-dockercfg-j9sm5\""
Jul 06 19:30:31.469005 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.468983    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"]
Jul 06 19:30:31.524696 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.524664    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-workload-certs\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.524904 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.524791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-credential-socket\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.524904 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.524821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-podinfo\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.524904 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.524871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-workload-socket\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.524904 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.524897    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-data\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.525124 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.524919    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-token\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.525124 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.524963    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istiod-ca-cert\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.525124 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.525011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-envoy\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.525124 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.525037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5lfg\" (UniqueName: \"kubernetes.io/projected/2d32c285-ed21-4483-b6dd-4df3e5645e9b-kube-api-access-q5lfg\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.626440 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.626407    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-workload-certs\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.626613 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.626462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-credential-socket\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.626613 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.626497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-podinfo\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.626613 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.626529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-workload-socket\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.626613 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.626555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-data\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.626613 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.626578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-token\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.626889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.626619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istiod-ca-cert\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.626889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.626659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-envoy\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.626889 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.626681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5lfg\" (UniqueName: \"kubernetes.io/projected/2d32c285-ed21-4483-b6dd-4df3e5645e9b-kube-api-access-q5lfg\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.627034 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.626890    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-workload-certs\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.627034 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.626952    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-credential-socket\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.627034 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.626986    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-data\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.627034 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.627015    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-workload-socket\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.627425 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.627407    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istiod-ca-cert\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.628948 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.628927    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-envoy\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.629134 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.629116    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-podinfo\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.634860 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.634837    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-token\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.634952 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.634929    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5lfg\" (UniqueName: \"kubernetes.io/projected/2d32c285-ed21-4483-b6dd-4df3e5645e9b-kube-api-access-q5lfg\") pod \"e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") " pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.771147 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.771050    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:31.908359 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.908334    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"]
Jul 06 19:30:31.910191 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:30:31.910162    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d32c285_ed21_4483_b6dd_4df3e5645e9b.slice/crio-0fb95cadb81a305df38b86049fcb83129ff236d8cd9c9f34f5232b34254d7026 WatchSource:0}: Error finding container 0fb95cadb81a305df38b86049fcb83129ff236d8cd9c9f34f5232b34254d7026: Status 404 returned error can't find the container with id 0fb95cadb81a305df38b86049fcb83129ff236d8cd9c9f34f5232b34254d7026
Jul 06 19:30:31.912588 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.912553    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:31.912673 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.912619    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:31.912673 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:31.912649    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:32.040806 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.040693    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4" event={"ID":"2d32c285-ed21-4483-b6dd-4df3e5645e9b","Type":"ContainerStarted","Data":"e887320c605b1b443eceb2278e91e5e93405520c60bee87ea3cd080a182146b0"}
Jul 06 19:30:32.040806 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.040770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4" event={"ID":"2d32c285-ed21-4483-b6dd-4df3e5645e9b","Type":"ContainerStarted","Data":"0fb95cadb81a305df38b86049fcb83129ff236d8cd9c9f34f5232b34254d7026"}
Jul 06 19:30:32.060894 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.060840    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4" podStartSLOduration=1.060824268 podStartE2EDuration="1.060824268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:32.058755147 +0000 UTC m=+1505.668882512" watchObservedRunningTime="2026-07-06 19:30:32.060824268 +0000 UTC m=+1505.670951611"
Jul 06 19:30:32.703781 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.703742    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"]
Jul 06 19:30:32.707412 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.707389    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:32.709940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.709915    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-116338c4-serving-cert\""
Jul 06 19:30:32.720921 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.720889    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"]
Jul 06 19:30:32.771595 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.771557    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:32.776668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.776643    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:32.835654 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.835615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-maas-api-tls\") pod \"maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b\" (UID: \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:32.835866 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.835693    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-openshift-service-ca\") pod \"maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b\" (UID: \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:32.835866 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.835764    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc9tt\" (UniqueName: \"kubernetes.io/projected/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-kube-api-access-mc9tt\") pod \"maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b\" (UID: \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:32.850961 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.850930    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e40d5667-2c2f-48ef-8f7c-a64d6846f0e7" path="/var/lib/kubelet/pods/e40d5667-2c2f-48ef-8f7c-a64d6846f0e7/volumes"
Jul 06 19:30:32.937069 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.937036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-maas-api-tls\") pod \"maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b\" (UID: \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:32.937276 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.937106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-openshift-service-ca\") pod \"maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b\" (UID: \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:32.937276 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.937180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc9tt\" (UniqueName: \"kubernetes.io/projected/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-kube-api-access-mc9tt\") pod \"maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b\" (UID: \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:32.937276 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:30:32.937197    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-serving-cert: secret "maas-api-e2e-ait-116338c4-serving-cert" not found
Jul 06 19:30:32.937475 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:30:32.937280    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-maas-api-tls podName:3d6f98bc-58ba-4c04-9bc5-d91a8347770b nodeName:}" failed. No retries permitted until 2026-07-06 19:30:33.437258946 +0000 UTC m=+1507.047386271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-maas-api-tls") pod "maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b" (UID: "3d6f98bc-58ba-4c04-9bc5-d91a8347770b") : secret "maas-api-e2e-ait-116338c4-serving-cert" not found
Jul 06 19:30:32.937810 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.937793    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-openshift-service-ca\") pod \"maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b\" (UID: \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:32.946468 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:32.946445    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc9tt\" (UniqueName: \"kubernetes.io/projected/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-kube-api-access-mc9tt\") pod \"maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b\" (UID: \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:33.047989 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:33.047896    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:33.048839 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:33.048816    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:33.442112 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:33.442080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-maas-api-tls\") pod \"maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b\" (UID: \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:33.444526 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:33.444505    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-maas-api-tls\") pod \"maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b\" (UID: \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:33.630884 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:33.630851    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:33.773620 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:33.773595    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"]
Jul 06 19:30:33.775778 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:30:33.775744    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6f98bc_58ba_4c04_9bc5_d91a8347770b.slice/crio-ca7eb251392d62adfd44eb62a5760fe3b8538a5a23a89d686c559258ab0f51cc WatchSource:0}: Error finding container ca7eb251392d62adfd44eb62a5760fe3b8538a5a23a89d686c559258ab0f51cc: Status 404 returned error can't find the container with id ca7eb251392d62adfd44eb62a5760fe3b8538a5a23a89d686c559258ab0f51cc
Jul 06 19:30:34.056389 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:34.056297    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b" event={"ID":"3d6f98bc-58ba-4c04-9bc5-d91a8347770b","Type":"ContainerStarted","Data":"ca7eb251392d62adfd44eb62a5760fe3b8538a5a23a89d686c559258ab0f51cc"}
Jul 06 19:30:35.063124 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:35.063086    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b" event={"ID":"3d6f98bc-58ba-4c04-9bc5-d91a8347770b","Type":"ContainerStarted","Data":"4fd0ca22aff21fe5e20205c1f67b04b16103efcf9afb29629b9ac34c241eeb32"}
Jul 06 19:30:35.085102 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:35.085035    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b" podStartSLOduration=2.759152609 podStartE2EDuration="3.085018905s" totalImagesPullingTime="325.866296ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:35.083573455 +0000 UTC m=+1508.693700819" watchObservedRunningTime="2026-07-06 19:30:35.085018905 +0000 UTC m=+1508.695146273"
Jul 06 19:30:36.068886 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:36.068852    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:38.100583 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:38.100545    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"]
Jul 06 19:30:38.101082 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:38.100749    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b" podUID="3d6f98bc-58ba-4c04-9bc5-d91a8347770b" containerName="maas-api" containerID="cri-o://4fd0ca22aff21fe5e20205c1f67b04b16103efcf9afb29629b9ac34c241eeb32" gracePeriod=30
Jul 06 19:30:38.401976 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:38.401952    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:38.493226 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:38.493184    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-maas-api-tls\") pod \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\" (UID: \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\") "
Jul 06 19:30:38.493371 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:38.493247    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc9tt\" (UniqueName: \"kubernetes.io/projected/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-kube-api-access-mc9tt\") pod \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\" (UID: \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\") "
Jul 06 19:30:38.493371 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:38.493313    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-openshift-service-ca\") pod \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\" (UID: \"3d6f98bc-58ba-4c04-9bc5-d91a8347770b\") "
Jul 06 19:30:38.493646 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:38.493618    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3d6f98bc-58ba-4c04-9bc5-d91a8347770b" (UID: "3d6f98bc-58ba-4c04-9bc5-d91a8347770b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:30:38.495373 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:38.495350    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3d6f98bc-58ba-4c04-9bc5-d91a8347770b" (UID: "3d6f98bc-58ba-4c04-9bc5-d91a8347770b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:30:38.495455 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:38.495406    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-kube-api-access-mc9tt" (OuterVolumeSpecName: "kube-api-access-mc9tt") pod "3d6f98bc-58ba-4c04-9bc5-d91a8347770b" (UID: "3d6f98bc-58ba-4c04-9bc5-d91a8347770b"). InnerVolumeSpecName "kube-api-access-mc9tt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:30:38.595074 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:38.595036    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-openshift-service-ca\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:38.595074 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:38.595067    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-maas-api-tls\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:38.595074 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:38.595079    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc9tt\" (UniqueName: \"kubernetes.io/projected/3d6f98bc-58ba-4c04-9bc5-d91a8347770b-kube-api-access-mc9tt\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:39.085487 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:39.085449    2580 generic.go:356] "Generic (PLEG): container finished" podID="3d6f98bc-58ba-4c04-9bc5-d91a8347770b" containerID="4fd0ca22aff21fe5e20205c1f67b04b16103efcf9afb29629b9ac34c241eeb32" exitCode=0
Jul 06 19:30:39.085689 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:39.085497    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"
Jul 06 19:30:39.085689 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:39.085540    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b" event={"ID":"3d6f98bc-58ba-4c04-9bc5-d91a8347770b","Type":"ContainerDied","Data":"4fd0ca22aff21fe5e20205c1f67b04b16103efcf9afb29629b9ac34c241eeb32"}
Jul 06 19:30:39.085689 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:39.085589    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b" event={"ID":"3d6f98bc-58ba-4c04-9bc5-d91a8347770b","Type":"ContainerDied","Data":"ca7eb251392d62adfd44eb62a5760fe3b8538a5a23a89d686c559258ab0f51cc"}
Jul 06 19:30:39.085689 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:39.085611    2580 scope.go:117] "RemoveContainer" containerID="4fd0ca22aff21fe5e20205c1f67b04b16103efcf9afb29629b9ac34c241eeb32"
Jul 06 19:30:39.096077 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:39.096059    2580 scope.go:117] "RemoveContainer" containerID="4fd0ca22aff21fe5e20205c1f67b04b16103efcf9afb29629b9ac34c241eeb32"
Jul 06 19:30:39.096523 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:30:39.096465    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fd0ca22aff21fe5e20205c1f67b04b16103efcf9afb29629b9ac34c241eeb32\": container with ID starting with 4fd0ca22aff21fe5e20205c1f67b04b16103efcf9afb29629b9ac34c241eeb32 not found: ID does not exist" containerID="4fd0ca22aff21fe5e20205c1f67b04b16103efcf9afb29629b9ac34c241eeb32"
Jul 06 19:30:39.096523 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:39.096499    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fd0ca22aff21fe5e20205c1f67b04b16103efcf9afb29629b9ac34c241eeb32"} err="failed to get container status \"4fd0ca22aff21fe5e20205c1f67b04b16103efcf9afb29629b9ac34c241eeb32\": rpc error: code = NotFound desc = could not find container \"4fd0ca22aff21fe5e20205c1f67b04b16103efcf9afb29629b9ac34c241eeb32\": container with ID starting with 4fd0ca22aff21fe5e20205c1f67b04b16103efcf9afb29629b9ac34c241eeb32 not found: ID does not exist"
Jul 06 19:30:39.104139 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:39.104112    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"]
Jul 06 19:30:39.108332 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:39.108305    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-116338c4-7c7d45cfb4-5ph9b"]
Jul 06 19:30:40.853027 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:40.852983    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d6f98bc-58ba-4c04-9bc5-d91a8347770b" path="/var/lib/kubelet/pods/3d6f98bc-58ba-4c04-9bc5-d91a8347770b/volumes"
Jul 06 19:30:43.109476 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:43.109387    2580 generic.go:356] "Generic (PLEG): container finished" podID="2d32c285-ed21-4483-b6dd-4df3e5645e9b" containerID="e887320c605b1b443eceb2278e91e5e93405520c60bee87ea3cd080a182146b0" exitCode=0
Jul 06 19:30:43.109476 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:43.109426    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4" event={"ID":"2d32c285-ed21-4483-b6dd-4df3e5645e9b","Type":"ContainerDied","Data":"e887320c605b1b443eceb2278e91e5e93405520c60bee87ea3cd080a182146b0"}
Jul 06 19:30:43.110076 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:43.109982    2580 scope.go:117] "RemoveContainer" containerID="e887320c605b1b443eceb2278e91e5e93405520c60bee87ea3cd080a182146b0"
Jul 06 19:30:43.111019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:43.110994    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:43.111084 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:43.111057    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:43.111134 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:43.111086    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:43.759265 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:43.759227    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"]
Jul 06 19:30:44.116267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:44.116171    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4" event={"ID":"2d32c285-ed21-4483-b6dd-4df3e5645e9b","Type":"ContainerStarted","Data":"0d102ea2339521bfe268fc6c59f9212978d7843c0d0519b29192dd95098d9d4f"}
Jul 06 19:30:44.116267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:44.116234    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4" podUID="2d32c285-ed21-4483-b6dd-4df3e5645e9b" containerName="istio-proxy" containerID="cri-o://0d102ea2339521bfe268fc6c59f9212978d7843c0d0519b29192dd95098d9d4f" gracePeriod=30
Jul 06 19:30:48.048899 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:48.048862    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:49.376302 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.376243    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:49.501989 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.501951    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-podinfo\") pod \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") "
Jul 06 19:30:49.501989 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.501995    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-workload-socket\") pod \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") "
Jul 06 19:30:49.502231 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.502027    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istiod-ca-cert\") pod \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") "
Jul 06 19:30:49.502231 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.502082    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-token\") pod \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") "
Jul 06 19:30:49.502231 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.502099    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-data\") pod \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") "
Jul 06 19:30:49.502231 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.502130    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-envoy\") pod \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") "
Jul 06 19:30:49.502231 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.502154    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5lfg\" (UniqueName: \"kubernetes.io/projected/2d32c285-ed21-4483-b6dd-4df3e5645e9b-kube-api-access-q5lfg\") pod \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") "
Jul 06 19:30:49.502231 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.502203    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-workload-certs\") pod \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") "
Jul 06 19:30:49.502231 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.502228    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-credential-socket\") pod \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\" (UID: \"2d32c285-ed21-4483-b6dd-4df3e5645e9b\") "
Jul 06 19:30:49.502595 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.502316    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d32c285-ed21-4483-b6dd-4df3e5645e9b" (UID: "2d32c285-ed21-4483-b6dd-4df3e5645e9b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:49.502595 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.502470    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d32c285-ed21-4483-b6dd-4df3e5645e9b" (UID: "2d32c285-ed21-4483-b6dd-4df3e5645e9b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:30:49.502595 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.502561    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d32c285-ed21-4483-b6dd-4df3e5645e9b" (UID: "2d32c285-ed21-4483-b6dd-4df3e5645e9b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:49.502869 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.502649    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-credential-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:49.502869 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.502669    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-workload-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:49.502869 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.502687    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istiod-ca-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:49.502869 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.502799    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d32c285-ed21-4483-b6dd-4df3e5645e9b" (UID: "2d32c285-ed21-4483-b6dd-4df3e5645e9b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:49.503224 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.503201    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d32c285-ed21-4483-b6dd-4df3e5645e9b" (UID: "2d32c285-ed21-4483-b6dd-4df3e5645e9b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:49.504301 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.504273    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d32c285-ed21-4483-b6dd-4df3e5645e9b" (UID: "2d32c285-ed21-4483-b6dd-4df3e5645e9b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:30:49.504396 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.504342    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d32c285-ed21-4483-b6dd-4df3e5645e9b" (UID: "2d32c285-ed21-4483-b6dd-4df3e5645e9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:30:49.504649 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.504629    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d32c285-ed21-4483-b6dd-4df3e5645e9b-kube-api-access-q5lfg" (OuterVolumeSpecName: "kube-api-access-q5lfg") pod "2d32c285-ed21-4483-b6dd-4df3e5645e9b" (UID: "2d32c285-ed21-4483-b6dd-4df3e5645e9b"). InnerVolumeSpecName "kube-api-access-q5lfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:30:49.504751 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.504727    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d32c285-ed21-4483-b6dd-4df3e5645e9b" (UID: "2d32c285-ed21-4483-b6dd-4df3e5645e9b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:30:49.604127 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.604094    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-token\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:49.604127 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.604120    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-data\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:49.604127 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.604128    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-envoy\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:49.604127 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.604137    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5lfg\" (UniqueName: \"kubernetes.io/projected/2d32c285-ed21-4483-b6dd-4df3e5645e9b-kube-api-access-q5lfg\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:49.604393 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.604146    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d32c285-ed21-4483-b6dd-4df3e5645e9b-workload-certs\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:49.604393 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:49.604154    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d32c285-ed21-4483-b6dd-4df3e5645e9b-istio-podinfo\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:50.086096 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.086063    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"]
Jul 06 19:30:50.086532 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.086512    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d32c285-ed21-4483-b6dd-4df3e5645e9b" containerName="istio-proxy"
Jul 06 19:30:50.086532 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.086535    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d32c285-ed21-4483-b6dd-4df3e5645e9b" containerName="istio-proxy"
Jul 06 19:30:50.086737 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.086552    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d32c285-ed21-4483-b6dd-4df3e5645e9b" containerName="istio-proxy"
Jul 06 19:30:50.086737 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.086558    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d32c285-ed21-4483-b6dd-4df3e5645e9b" containerName="istio-proxy"
Jul 06 19:30:50.086737 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.086571    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d6f98bc-58ba-4c04-9bc5-d91a8347770b" containerName="maas-api"
Jul 06 19:30:50.086737 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.086579    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6f98bc-58ba-4c04-9bc5-d91a8347770b" containerName="maas-api"
Jul 06 19:30:50.086737 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.086651    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d6f98bc-58ba-4c04-9bc5-d91a8347770b" containerName="maas-api"
Jul 06 19:30:50.086737 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.086666    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d32c285-ed21-4483-b6dd-4df3e5645e9b" containerName="istio-proxy"
Jul 06 19:30:50.089940 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.089920    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.092438 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.092415    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-eb60e1cc-openshift-default-dockercfg-zx8q5\""
Jul 06 19:30:50.100394 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.100372    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"]
Jul 06 19:30:50.147149 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.147120    2580 generic.go:356] "Generic (PLEG): container finished" podID="2d32c285-ed21-4483-b6dd-4df3e5645e9b" containerID="0d102ea2339521bfe268fc6c59f9212978d7843c0d0519b29192dd95098d9d4f" exitCode=0
Jul 06 19:30:50.147295 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.147165    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"
Jul 06 19:30:50.147295 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.147210    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4" event={"ID":"2d32c285-ed21-4483-b6dd-4df3e5645e9b","Type":"ContainerDied","Data":"0d102ea2339521bfe268fc6c59f9212978d7843c0d0519b29192dd95098d9d4f"}
Jul 06 19:30:50.147295 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.147265    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4" event={"ID":"2d32c285-ed21-4483-b6dd-4df3e5645e9b","Type":"ContainerDied","Data":"0fb95cadb81a305df38b86049fcb83129ff236d8cd9c9f34f5232b34254d7026"}
Jul 06 19:30:50.147295 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.147287    2580 scope.go:117] "RemoveContainer" containerID="0d102ea2339521bfe268fc6c59f9212978d7843c0d0519b29192dd95098d9d4f"
Jul 06 19:30:50.156337 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.156320    2580 scope.go:117] "RemoveContainer" containerID="e887320c605b1b443eceb2278e91e5e93405520c60bee87ea3cd080a182146b0"
Jul 06 19:30:50.164251 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.164231    2580 scope.go:117] "RemoveContainer" containerID="0d102ea2339521bfe268fc6c59f9212978d7843c0d0519b29192dd95098d9d4f"
Jul 06 19:30:50.164489 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:30:50.164470    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d102ea2339521bfe268fc6c59f9212978d7843c0d0519b29192dd95098d9d4f\": container with ID starting with 0d102ea2339521bfe268fc6c59f9212978d7843c0d0519b29192dd95098d9d4f not found: ID does not exist" containerID="0d102ea2339521bfe268fc6c59f9212978d7843c0d0519b29192dd95098d9d4f"
Jul 06 19:30:50.164532 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.164497    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d102ea2339521bfe268fc6c59f9212978d7843c0d0519b29192dd95098d9d4f"} err="failed to get container status \"0d102ea2339521bfe268fc6c59f9212978d7843c0d0519b29192dd95098d9d4f\": rpc error: code = NotFound desc = could not find container \"0d102ea2339521bfe268fc6c59f9212978d7843c0d0519b29192dd95098d9d4f\": container with ID starting with 0d102ea2339521bfe268fc6c59f9212978d7843c0d0519b29192dd95098d9d4f not found: ID does not exist"
Jul 06 19:30:50.164532 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.164513    2580 scope.go:117] "RemoveContainer" containerID="e887320c605b1b443eceb2278e91e5e93405520c60bee87ea3cd080a182146b0"
Jul 06 19:30:50.164766 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:30:50.164744    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e887320c605b1b443eceb2278e91e5e93405520c60bee87ea3cd080a182146b0\": container with ID starting with e887320c605b1b443eceb2278e91e5e93405520c60bee87ea3cd080a182146b0 not found: ID does not exist" containerID="e887320c605b1b443eceb2278e91e5e93405520c60bee87ea3cd080a182146b0"
Jul 06 19:30:50.164863 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.164769    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e887320c605b1b443eceb2278e91e5e93405520c60bee87ea3cd080a182146b0"} err="failed to get container status \"e887320c605b1b443eceb2278e91e5e93405520c60bee87ea3cd080a182146b0\": rpc error: code = NotFound desc = could not find container \"e887320c605b1b443eceb2278e91e5e93405520c60bee87ea3cd080a182146b0\": container with ID starting with e887320c605b1b443eceb2278e91e5e93405520c60bee87ea3cd080a182146b0 not found: ID does not exist"
Jul 06 19:30:50.168782 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.168761    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"]
Jul 06 19:30:50.172594 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.172575    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-116338c4-openshift-default-694bc54c49-qwsq4"]
Jul 06 19:30:50.210103 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.210066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-envoy\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.210103 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.210105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjvcj\" (UniqueName: \"kubernetes.io/projected/8606e4a8-8980-4ffe-9267-fe59781569c3-kube-api-access-bjvcj\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.210313 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.210132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-workload-certs\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.210313 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.210260    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-workload-socket\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.210313 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.210280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-data\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.210408 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.210314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-podinfo\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.210408 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.210342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-credential-socket\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.210408 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.210366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-token\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.210408 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.210380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8606e4a8-8980-4ffe-9267-fe59781569c3-istiod-ca-cert\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.311868 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.311827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-workload-socket\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.311868 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.311869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-data\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.312081 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.311912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-podinfo\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.312081 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.311938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-credential-socket\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.312081 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.311971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-token\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.312213 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.312118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8606e4a8-8980-4ffe-9267-fe59781569c3-istiod-ca-cert\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.312213 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.312197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-envoy\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.312336 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.312230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjvcj\" (UniqueName: \"kubernetes.io/projected/8606e4a8-8980-4ffe-9267-fe59781569c3-kube-api-access-bjvcj\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.312336 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.312273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-workload-certs\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.312454 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.312340    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-data\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.312454 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.312394    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-credential-socket\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.312579 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.312528    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-workload-socket\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.312637 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.312586    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-workload-certs\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.312905 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.312883    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8606e4a8-8980-4ffe-9267-fe59781569c3-istiod-ca-cert\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.314355 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.314327    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-envoy\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.314442 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.314402    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-podinfo\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.325228 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.320966    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-token\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.325228 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.321028    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjvcj\" (UniqueName: \"kubernetes.io/projected/8606e4a8-8980-4ffe-9267-fe59781569c3-kube-api-access-bjvcj\") pod \"e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") " pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.403459 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.403367    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:50.547210 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.547184    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"]
Jul 06 19:30:50.549493 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:30:50.549462    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8606e4a8_8980_4ffe_9267_fe59781569c3.slice/crio-c008c5565f1d211c33543d444cf76e1d42049b47f06d558f1c58739ff4233e32 WatchSource:0}: Error finding container c008c5565f1d211c33543d444cf76e1d42049b47f06d558f1c58739ff4233e32: Status 404 returned error can't find the container with id c008c5565f1d211c33543d444cf76e1d42049b47f06d558f1c58739ff4233e32
Jul 06 19:30:50.551962 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.551925    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:50.552098 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.551992    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:50.552098 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.552025    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:50.851184 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:50.851153    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d32c285-ed21-4483-b6dd-4df3e5645e9b" path="/var/lib/kubelet/pods/2d32c285-ed21-4483-b6dd-4df3e5645e9b/volumes"
Jul 06 19:30:51.155135 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.155050    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj" event={"ID":"8606e4a8-8980-4ffe-9267-fe59781569c3","Type":"ContainerStarted","Data":"ef9c913b11092471c5943c682062732f4378bcaf40a9e6168e4f18d7dc77bf50"}
Jul 06 19:30:51.155135 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.155101    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj" event={"ID":"8606e4a8-8980-4ffe-9267-fe59781569c3","Type":"ContainerStarted","Data":"c008c5565f1d211c33543d444cf76e1d42049b47f06d558f1c58739ff4233e32"}
Jul 06 19:30:51.184506 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.184450    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj" podStartSLOduration=1.184430372 podStartE2EDuration="1.184430372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:51.180857433 +0000 UTC m=+1524.790984773" watchObservedRunningTime="2026-07-06 19:30:51.184430372 +0000 UTC m=+1524.794557715"
Jul 06 19:30:51.351160 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.351124    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"]
Jul 06 19:30:51.351840 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.351813    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d32c285-ed21-4483-b6dd-4df3e5645e9b" containerName="istio-proxy"
Jul 06 19:30:51.355170 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.355153    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:51.358022 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.357994    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-eb60e1cc-serving-cert\""
Jul 06 19:30:51.374363 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.374335    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"]
Jul 06 19:30:51.403747 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.403702    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:51.408729 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.408652    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:51.524833 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.524794    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z672f\" (UniqueName: \"kubernetes.io/projected/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-kube-api-access-z672f\") pod \"maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr\" (UID: \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:51.525005 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.524845    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-maas-api-tls\") pod \"maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr\" (UID: \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:51.525005 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.524907    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-openshift-service-ca\") pod \"maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr\" (UID: \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:51.626231 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.626191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z672f\" (UniqueName: \"kubernetes.io/projected/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-kube-api-access-z672f\") pod \"maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr\" (UID: \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:51.626434 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.626244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-maas-api-tls\") pod \"maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr\" (UID: \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:51.626434 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.626293    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-openshift-service-ca\") pod \"maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr\" (UID: \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:51.626434 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:30:51.626404    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-serving-cert: secret "maas-api-e2e-derive-eb60e1cc-serving-cert" not found
Jul 06 19:30:51.626650 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:30:51.626466    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-maas-api-tls podName:1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0 nodeName:}" failed. No retries permitted until 2026-07-06 19:30:52.126451892 +0000 UTC m=+1525.736579214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-maas-api-tls") pod "maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr" (UID: "1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0") : secret "maas-api-e2e-derive-eb60e1cc-serving-cert" not found
Jul 06 19:30:51.627044 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.627020    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-openshift-service-ca\") pod \"maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr\" (UID: \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:51.634870 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:51.634845    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z672f\" (UniqueName: \"kubernetes.io/projected/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-kube-api-access-z672f\") pod \"maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr\" (UID: \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:52.132017 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:52.131979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-maas-api-tls\") pod \"maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr\" (UID: \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:52.134557 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:52.134519    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-maas-api-tls\") pod \"maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr\" (UID: \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:52.161967 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:52.161938    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:52.162967 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:52.162943    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:30:52.266117 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:52.266082    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:52.406477 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:52.406453    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"]
Jul 06 19:30:52.408996 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:30:52.408968    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4c2b2e_e012_45b6_9d04_e9fefc65f8e0.slice/crio-68733acb883d09482672d5168975e52c1dccf7974a1a4a6ede0be7099975577d WatchSource:0}: Error finding container 68733acb883d09482672d5168975e52c1dccf7974a1a4a6ede0be7099975577d: Status 404 returned error can't find the container with id 68733acb883d09482672d5168975e52c1dccf7974a1a4a6ede0be7099975577d
Jul 06 19:30:53.168368 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:53.168269    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr" event={"ID":"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0","Type":"ContainerStarted","Data":"f1976dbd64a1ed8c4c3c473880fba04c9f060a7eab7af6684ca1bd06f94d22d1"}
Jul 06 19:30:53.168368 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:53.168335    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr" event={"ID":"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0","Type":"ContainerStarted","Data":"68733acb883d09482672d5168975e52c1dccf7974a1a4a6ede0be7099975577d"}
Jul 06 19:30:53.168368 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:53.168363    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:53.188884 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:53.188840    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr" podStartSLOduration=1.684514011 podStartE2EDuration="2.188824663s" totalImagesPullingTime="504.310652ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:53.187427409 +0000 UTC m=+1526.797554777" watchObservedRunningTime="2026-07-06 19:30:53.188824663 +0000 UTC m=+1526.798952006"
Jul 06 19:30:55.835486 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:55.835442    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"]
Jul 06 19:30:55.836101 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:55.835678    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj" podUID="8606e4a8-8980-4ffe-9267-fe59781569c3" containerName="istio-proxy" containerID="cri-o://ef9c913b11092471c5943c682062732f4378bcaf40a9e6168e4f18d7dc77bf50" gracePeriod=30
Jul 06 19:30:56.142794 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:56.139462    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"]
Jul 06 19:30:56.142794 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:56.139876    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr" podUID="1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0" containerName="maas-api" containerID="cri-o://f1976dbd64a1ed8c4c3c473880fba04c9f060a7eab7af6684ca1bd06f94d22d1" gracePeriod=30
Jul 06 19:30:56.421608 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:56.421585    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:56.475266 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:56.475234    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-maas-api-tls\") pod \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\" (UID: \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\") "
Jul 06 19:30:56.475457 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:56.475303    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-openshift-service-ca\") pod \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\" (UID: \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\") "
Jul 06 19:30:56.475668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:56.475643    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0" (UID: "1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:30:56.477289 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:56.477269    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0" (UID: "1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:30:56.576127 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:56.576089    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z672f\" (UniqueName: \"kubernetes.io/projected/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-kube-api-access-z672f\") pod \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\" (UID: \"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0\") "
Jul 06 19:30:56.576284 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:56.576276    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-maas-api-tls\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:56.576326 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:56.576288    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-openshift-service-ca\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:56.578019 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:56.577989    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-kube-api-access-z672f" (OuterVolumeSpecName: "kube-api-access-z672f") pod "1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0" (UID: "1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0"). InnerVolumeSpecName "kube-api-access-z672f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:30:56.677011 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:56.676977    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z672f\" (UniqueName: \"kubernetes.io/projected/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0-kube-api-access-z672f\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:30:57.190000 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:57.189969    2580 generic.go:356] "Generic (PLEG): container finished" podID="1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0" containerID="f1976dbd64a1ed8c4c3c473880fba04c9f060a7eab7af6684ca1bd06f94d22d1" exitCode=0
Jul 06 19:30:57.190445 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:57.190019    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"
Jul 06 19:30:57.190445 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:57.190054    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr" event={"ID":"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0","Type":"ContainerDied","Data":"f1976dbd64a1ed8c4c3c473880fba04c9f060a7eab7af6684ca1bd06f94d22d1"}
Jul 06 19:30:57.190445 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:57.190103    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr" event={"ID":"1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0","Type":"ContainerDied","Data":"68733acb883d09482672d5168975e52c1dccf7974a1a4a6ede0be7099975577d"}
Jul 06 19:30:57.190445 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:57.190124    2580 scope.go:117] "RemoveContainer" containerID="f1976dbd64a1ed8c4c3c473880fba04c9f060a7eab7af6684ca1bd06f94d22d1"
Jul 06 19:30:57.201520 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:57.201497    2580 scope.go:117] "RemoveContainer" containerID="f1976dbd64a1ed8c4c3c473880fba04c9f060a7eab7af6684ca1bd06f94d22d1"
Jul 06 19:30:57.201833 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:30:57.201812    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1976dbd64a1ed8c4c3c473880fba04c9f060a7eab7af6684ca1bd06f94d22d1\": container with ID starting with f1976dbd64a1ed8c4c3c473880fba04c9f060a7eab7af6684ca1bd06f94d22d1 not found: ID does not exist" containerID="f1976dbd64a1ed8c4c3c473880fba04c9f060a7eab7af6684ca1bd06f94d22d1"
Jul 06 19:30:57.201886 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:57.201844    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1976dbd64a1ed8c4c3c473880fba04c9f060a7eab7af6684ca1bd06f94d22d1"} err="failed to get container status \"f1976dbd64a1ed8c4c3c473880fba04c9f060a7eab7af6684ca1bd06f94d22d1\": rpc error: code = NotFound desc = could not find container \"f1976dbd64a1ed8c4c3c473880fba04c9f060a7eab7af6684ca1bd06f94d22d1\": container with ID starting with f1976dbd64a1ed8c4c3c473880fba04c9f060a7eab7af6684ca1bd06f94d22d1 not found: ID does not exist"
Jul 06 19:30:57.214114 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:57.214084    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"]
Jul 06 19:30:57.220193 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:57.220170    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eb60e1cc-6769f6df77-jmgjr"]
Jul 06 19:30:58.853180 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:30:58.853141    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0" path="/var/lib/kubelet/pods/1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0/volumes"
Jul 06 19:31:00.012079 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:00.012037    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r"]
Jul 06 19:31:00.012566 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:00.012244    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r" podUID="05adc521-25b6-4448-96a2-d7deb3dfc1af" containerName="cleanup" containerID="cri-o://50ceb87a870ca8209339270cdfc5628bc108f6923d835f94969f96365ab99229" gracePeriod=30
Jul 06 19:31:01.700815 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.700762    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:31:01.724970 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.724696    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-credential-socket\") pod \"8606e4a8-8980-4ffe-9267-fe59781569c3\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") "
Jul 06 19:31:01.724970 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.724772    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-token\") pod \"8606e4a8-8980-4ffe-9267-fe59781569c3\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") "
Jul 06 19:31:01.724970 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.724818    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-workload-certs\") pod \"8606e4a8-8980-4ffe-9267-fe59781569c3\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") "
Jul 06 19:31:01.724970 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.724890    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-envoy\") pod \"8606e4a8-8980-4ffe-9267-fe59781569c3\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") "
Jul 06 19:31:01.724970 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.724932    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjvcj\" (UniqueName: \"kubernetes.io/projected/8606e4a8-8980-4ffe-9267-fe59781569c3-kube-api-access-bjvcj\") pod \"8606e4a8-8980-4ffe-9267-fe59781569c3\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") "
Jul 06 19:31:01.725387 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.724981    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8606e4a8-8980-4ffe-9267-fe59781569c3" (UID: "8606e4a8-8980-4ffe-9267-fe59781569c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:31:01.725387 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.725001    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-data\") pod \"8606e4a8-8980-4ffe-9267-fe59781569c3\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") "
Jul 06 19:31:01.726267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.725025    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-podinfo\") pod \"8606e4a8-8980-4ffe-9267-fe59781569c3\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") "
Jul 06 19:31:01.726267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.725619    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-workload-socket\") pod \"8606e4a8-8980-4ffe-9267-fe59781569c3\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") "
Jul 06 19:31:01.726267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.725723    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8606e4a8-8980-4ffe-9267-fe59781569c3-istiod-ca-cert\") pod \"8606e4a8-8980-4ffe-9267-fe59781569c3\" (UID: \"8606e4a8-8980-4ffe-9267-fe59781569c3\") "
Jul 06 19:31:01.726267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.725299    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8606e4a8-8980-4ffe-9267-fe59781569c3" (UID: "8606e4a8-8980-4ffe-9267-fe59781569c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:31:01.726267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.725874    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "8606e4a8-8980-4ffe-9267-fe59781569c3" (UID: "8606e4a8-8980-4ffe-9267-fe59781569c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:31:01.726267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.725862    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8606e4a8-8980-4ffe-9267-fe59781569c3" (UID: "8606e4a8-8980-4ffe-9267-fe59781569c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:31:01.726267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.726128    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-credential-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:31:01.726267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.726147    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-workload-certs\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:31:01.726267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.726161    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-data\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:31:01.726267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.726173    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-workload-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:31:01.726267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.726225    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8606e4a8-8980-4ffe-9267-fe59781569c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8606e4a8-8980-4ffe-9267-fe59781569c3" (UID: "8606e4a8-8980-4ffe-9267-fe59781569c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:31:01.727779 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.727751    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8606e4a8-8980-4ffe-9267-fe59781569c3" (UID: "8606e4a8-8980-4ffe-9267-fe59781569c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:31:01.728308 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.728281    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8606e4a8-8980-4ffe-9267-fe59781569c3" (UID: "8606e4a8-8980-4ffe-9267-fe59781569c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:31:01.728531 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.728499    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "8606e4a8-8980-4ffe-9267-fe59781569c3" (UID: "8606e4a8-8980-4ffe-9267-fe59781569c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:31:01.729050 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.728821    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8606e4a8-8980-4ffe-9267-fe59781569c3-kube-api-access-bjvcj" (OuterVolumeSpecName: "kube-api-access-bjvcj") pod "8606e4a8-8980-4ffe-9267-fe59781569c3" (UID: "8606e4a8-8980-4ffe-9267-fe59781569c3"). InnerVolumeSpecName "kube-api-access-bjvcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:31:01.826819 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.826735    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-token\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:31:01.826819 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.826762    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-envoy\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:31:01.826819 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.826773    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjvcj\" (UniqueName: \"kubernetes.io/projected/8606e4a8-8980-4ffe-9267-fe59781569c3-kube-api-access-bjvcj\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:31:01.826819 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.826783    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8606e4a8-8980-4ffe-9267-fe59781569c3-istio-podinfo\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:31:01.826819 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:01.826792    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8606e4a8-8980-4ffe-9267-fe59781569c3-istiod-ca-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:31:02.217308 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:02.217270    2580 generic.go:356] "Generic (PLEG): container finished" podID="8606e4a8-8980-4ffe-9267-fe59781569c3" containerID="ef9c913b11092471c5943c682062732f4378bcaf40a9e6168e4f18d7dc77bf50" exitCode=0
Jul 06 19:31:02.217483 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:02.217315    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"
Jul 06 19:31:02.217483 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:02.217357    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj" event={"ID":"8606e4a8-8980-4ffe-9267-fe59781569c3","Type":"ContainerDied","Data":"ef9c913b11092471c5943c682062732f4378bcaf40a9e6168e4f18d7dc77bf50"}
Jul 06 19:31:02.217483 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:02.217414    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj" event={"ID":"8606e4a8-8980-4ffe-9267-fe59781569c3","Type":"ContainerDied","Data":"c008c5565f1d211c33543d444cf76e1d42049b47f06d558f1c58739ff4233e32"}
Jul 06 19:31:02.217483 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:02.217441    2580 scope.go:117] "RemoveContainer" containerID="ef9c913b11092471c5943c682062732f4378bcaf40a9e6168e4f18d7dc77bf50"
Jul 06 19:31:02.227309 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:02.227290    2580 scope.go:117] "RemoveContainer" containerID="ef9c913b11092471c5943c682062732f4378bcaf40a9e6168e4f18d7dc77bf50"
Jul 06 19:31:02.227554 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:31:02.227535    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef9c913b11092471c5943c682062732f4378bcaf40a9e6168e4f18d7dc77bf50\": container with ID starting with ef9c913b11092471c5943c682062732f4378bcaf40a9e6168e4f18d7dc77bf50 not found: ID does not exist" containerID="ef9c913b11092471c5943c682062732f4378bcaf40a9e6168e4f18d7dc77bf50"
Jul 06 19:31:02.227618 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:02.227561    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef9c913b11092471c5943c682062732f4378bcaf40a9e6168e4f18d7dc77bf50"} err="failed to get container status \"ef9c913b11092471c5943c682062732f4378bcaf40a9e6168e4f18d7dc77bf50\": rpc error: code = NotFound desc = could not find container \"ef9c913b11092471c5943c682062732f4378bcaf40a9e6168e4f18d7dc77bf50\": container with ID starting with ef9c913b11092471c5943c682062732f4378bcaf40a9e6168e4f18d7dc77bf50 not found: ID does not exist"
Jul 06 19:31:02.243288 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:02.243263    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"]
Jul 06 19:31:02.248340 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:02.248316    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-eb60e1cc-openshift-default-5dd78bdbb7-4nzjj"]
Jul 06 19:31:02.851042 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:02.851007    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8606e4a8-8980-4ffe-9267-fe59781569c3" path="/var/lib/kubelet/pods/8606e4a8-8980-4ffe-9267-fe59781569c3/volumes"
Jul 06 19:31:30.190388 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:30.190361    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r"
Jul 06 19:31:30.287513 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:30.287424    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zk82\" (UniqueName: \"kubernetes.io/projected/05adc521-25b6-4448-96a2-d7deb3dfc1af-kube-api-access-8zk82\") pod \"05adc521-25b6-4448-96a2-d7deb3dfc1af\" (UID: \"05adc521-25b6-4448-96a2-d7deb3dfc1af\") "
Jul 06 19:31:30.289545 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:30.289518    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05adc521-25b6-4448-96a2-d7deb3dfc1af-kube-api-access-8zk82" (OuterVolumeSpecName: "kube-api-access-8zk82") pod "05adc521-25b6-4448-96a2-d7deb3dfc1af" (UID: "05adc521-25b6-4448-96a2-d7deb3dfc1af"). InnerVolumeSpecName "kube-api-access-8zk82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:31:30.358586 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:30.358548    2580 generic.go:356] "Generic (PLEG): container finished" podID="05adc521-25b6-4448-96a2-d7deb3dfc1af" containerID="50ceb87a870ca8209339270cdfc5628bc108f6923d835f94969f96365ab99229" exitCode=137
Jul 06 19:31:30.358752 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:30.358600    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r"
Jul 06 19:31:30.358752 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:30.358601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r" event={"ID":"05adc521-25b6-4448-96a2-d7deb3dfc1af","Type":"ContainerDied","Data":"50ceb87a870ca8209339270cdfc5628bc108f6923d835f94969f96365ab99229"}
Jul 06 19:31:30.358752 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:30.358658    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r" event={"ID":"05adc521-25b6-4448-96a2-d7deb3dfc1af","Type":"ContainerDied","Data":"a51a090ac1104ffb42fab553f573c651c5de25b447bac8e399e4c96888eb9999"}
Jul 06 19:31:30.358752 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:30.358681    2580 scope.go:117] "RemoveContainer" containerID="50ceb87a870ca8209339270cdfc5628bc108f6923d835f94969f96365ab99229"
Jul 06 19:31:30.368011 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:30.367992    2580 scope.go:117] "RemoveContainer" containerID="50ceb87a870ca8209339270cdfc5628bc108f6923d835f94969f96365ab99229"
Jul 06 19:31:30.368303 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:31:30.368281    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50ceb87a870ca8209339270cdfc5628bc108f6923d835f94969f96365ab99229\": container with ID starting with 50ceb87a870ca8209339270cdfc5628bc108f6923d835f94969f96365ab99229 not found: ID does not exist" containerID="50ceb87a870ca8209339270cdfc5628bc108f6923d835f94969f96365ab99229"
Jul 06 19:31:30.368382 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:30.368311    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50ceb87a870ca8209339270cdfc5628bc108f6923d835f94969f96365ab99229"} err="failed to get container status \"50ceb87a870ca8209339270cdfc5628bc108f6923d835f94969f96365ab99229\": rpc error: code = NotFound desc = could not find container \"50ceb87a870ca8209339270cdfc5628bc108f6923d835f94969f96365ab99229\": container with ID starting with 50ceb87a870ca8209339270cdfc5628bc108f6923d835f94969f96365ab99229 not found: ID does not exist"
Jul 06 19:31:30.379455 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:30.379428    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r"]
Jul 06 19:31:30.383628 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:30.383606    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29722770-kfh9r"]
Jul 06 19:31:30.389093 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:30.389072    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zk82\" (UniqueName: \"kubernetes.io/projected/05adc521-25b6-4448-96a2-d7deb3dfc1af-kube-api-access-8zk82\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:31:30.851105 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:31:30.851072    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05adc521-25b6-4448-96a2-d7deb3dfc1af" path="/var/lib/kubelet/pods/05adc521-25b6-4448-96a2-d7deb3dfc1af/volumes"
Jul 06 19:32:39.523085 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.523052    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"]
Jul 06 19:32:39.523485 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.523426    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0" containerName="maas-api"
Jul 06 19:32:39.523485 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.523436    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0" containerName="maas-api"
Jul 06 19:32:39.523485 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.523455    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8606e4a8-8980-4ffe-9267-fe59781569c3" containerName="istio-proxy"
Jul 06 19:32:39.523485 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.523461    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8606e4a8-8980-4ffe-9267-fe59781569c3" containerName="istio-proxy"
Jul 06 19:32:39.523485 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.523468    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05adc521-25b6-4448-96a2-d7deb3dfc1af" containerName="cleanup"
Jul 06 19:32:39.523485 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.523474    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="05adc521-25b6-4448-96a2-d7deb3dfc1af" containerName="cleanup"
Jul 06 19:32:39.523681 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.523554    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="05adc521-25b6-4448-96a2-d7deb3dfc1af" containerName="cleanup"
Jul 06 19:32:39.523681 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.523564    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8606e4a8-8980-4ffe-9267-fe59781569c3" containerName="istio-proxy"
Jul 06 19:32:39.523681 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.523571    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f4c2b2e-e012-45b6-9d04-e9fefc65f8e0" containerName="maas-api"
Jul 06 19:32:39.526587 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.526570    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.528899 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.528879    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bc2689dc-openshift-default-dockercfg-tk5mz\""
Jul 06 19:32:39.540360 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.540336    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"]
Jul 06 19:32:39.606318 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.606278    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-istio-envoy\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.606515 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.606321    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756b7244-9699-460e-9895-b3b5359ee443-istio-podinfo\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.606515 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.606408    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht4r7\" (UniqueName: \"kubernetes.io/projected/756b7244-9699-460e-9895-b3b5359ee443-kube-api-access-ht4r7\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.606515 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.606458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756b7244-9699-460e-9895-b3b5359ee443-istiod-ca-cert\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.606515 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.606486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-istio-data\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.606767 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.606520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756b7244-9699-460e-9895-b3b5359ee443-istio-token\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.606767 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.606572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-credential-socket\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.606767 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.606596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-workload-certs\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.606767 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.606636    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-workload-socket\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.708078 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.708042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-workload-socket\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.708284 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.708132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-istio-envoy\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.708284 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.708150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756b7244-9699-460e-9895-b3b5359ee443-istio-podinfo\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.708284 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.708178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht4r7\" (UniqueName: \"kubernetes.io/projected/756b7244-9699-460e-9895-b3b5359ee443-kube-api-access-ht4r7\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.708284 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.708197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756b7244-9699-460e-9895-b3b5359ee443-istiod-ca-cert\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.708284 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.708234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-istio-data\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.708284 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.708262    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756b7244-9699-460e-9895-b3b5359ee443-istio-token\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.708628 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.708312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-credential-socket\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.708628 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.708337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-workload-certs\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.708628 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.708491    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-workload-socket\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.708807 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.708661    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-workload-certs\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.708868 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.708848    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-credential-socket\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.708924 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.708871    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-istio-data\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.708979 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.708936    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756b7244-9699-460e-9895-b3b5359ee443-istiod-ca-cert\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.710630 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.710604    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-istio-envoy\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.710759 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.710737    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756b7244-9699-460e-9895-b3b5359ee443-istio-podinfo\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.716332 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.716305    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756b7244-9699-460e-9895-b3b5359ee443-istio-token\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.716539 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.716519    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht4r7\" (UniqueName: \"kubernetes.io/projected/756b7244-9699-460e-9895-b3b5359ee443-kube-api-access-ht4r7\") pod \"e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") " pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.837096 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.837015    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:39.982387 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.982361    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"]
Jul 06 19:32:39.984165 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:32:39.984137    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756b7244_9699_460e_9895_b3b5359ee443.slice/crio-3e5577feeaef459a097cff6c1dea4ee15c208c580324e1245fc2734116b2f038 WatchSource:0}: Error finding container 3e5577feeaef459a097cff6c1dea4ee15c208c580324e1245fc2734116b2f038: Status 404 returned error can't find the container with id 3e5577feeaef459a097cff6c1dea4ee15c208c580324e1245fc2734116b2f038
Jul 06 19:32:39.986334 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.986295    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:32:39.986401 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.986383    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:32:39.986460 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:39.986443    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:32:40.690036 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:40.689998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv" event={"ID":"756b7244-9699-460e-9895-b3b5359ee443","Type":"ContainerStarted","Data":"665100efe4be68bf11d7d6f5f655f28b121552954e4a48f2667ee255bb20880f"}
Jul 06 19:32:40.690490 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:40.690091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv" event={"ID":"756b7244-9699-460e-9895-b3b5359ee443","Type":"ContainerStarted","Data":"3e5577feeaef459a097cff6c1dea4ee15c208c580324e1245fc2734116b2f038"}
Jul 06 19:32:40.711439 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:40.711389    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv" podStartSLOduration=1.71137563 podStartE2EDuration="1.71137563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:40.709346818 +0000 UTC m=+1634.319474185" watchObservedRunningTime="2026-07-06 19:32:40.71137563 +0000 UTC m=+1634.321502973"
Jul 06 19:32:40.837251 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:40.837214    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:41.842411 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:41.842379    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:42.700865 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:42.700829    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:42.701928 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:42.701907    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:42.813790 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:42.813757    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"]
Jul 06 19:32:42.817486 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:42.817467    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:42.819935 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:42.819910    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-bc2689dc-serving-cert\""
Jul 06 19:32:42.826911 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:42.826888    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"]
Jul 06 19:32:42.938591 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:42.938557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9891402b-0817-4045-a93c-23c7157d9b21-maas-api-tls\") pod \"maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6\" (UID: \"9891402b-0817-4045-a93c-23c7157d9b21\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:42.939004 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:42.938649    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46zkp\" (UniqueName: \"kubernetes.io/projected/9891402b-0817-4045-a93c-23c7157d9b21-kube-api-access-46zkp\") pod \"maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6\" (UID: \"9891402b-0817-4045-a93c-23c7157d9b21\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:42.939004 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:42.938745    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9891402b-0817-4045-a93c-23c7157d9b21-openshift-service-ca\") pod \"maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6\" (UID: \"9891402b-0817-4045-a93c-23c7157d9b21\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:43.039902 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:43.039812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9891402b-0817-4045-a93c-23c7157d9b21-openshift-service-ca\") pod \"maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6\" (UID: \"9891402b-0817-4045-a93c-23c7157d9b21\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:43.039902 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:43.039861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9891402b-0817-4045-a93c-23c7157d9b21-maas-api-tls\") pod \"maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6\" (UID: \"9891402b-0817-4045-a93c-23c7157d9b21\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:43.040130 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:43.039923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46zkp\" (UniqueName: \"kubernetes.io/projected/9891402b-0817-4045-a93c-23c7157d9b21-kube-api-access-46zkp\") pod \"maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6\" (UID: \"9891402b-0817-4045-a93c-23c7157d9b21\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:43.040582 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:43.040558    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9891402b-0817-4045-a93c-23c7157d9b21-openshift-service-ca\") pod \"maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6\" (UID: \"9891402b-0817-4045-a93c-23c7157d9b21\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:43.042530 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:43.042507    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9891402b-0817-4045-a93c-23c7157d9b21-maas-api-tls\") pod \"maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6\" (UID: \"9891402b-0817-4045-a93c-23c7157d9b21\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:43.048093 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:43.048071    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46zkp\" (UniqueName: \"kubernetes.io/projected/9891402b-0817-4045-a93c-23c7157d9b21-kube-api-access-46zkp\") pod \"maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6\" (UID: \"9891402b-0817-4045-a93c-23c7157d9b21\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:43.131104 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:43.131070    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:43.272788 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:43.272763    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"]
Jul 06 19:32:43.275107 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:32:43.275075    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9891402b_0817_4045_a93c_23c7157d9b21.slice/crio-80be6862fc332594f16d0085880cb26eada8e16040f6afad2d398275b5c809ce WatchSource:0}: Error finding container 80be6862fc332594f16d0085880cb26eada8e16040f6afad2d398275b5c809ce: Status 404 returned error can't find the container with id 80be6862fc332594f16d0085880cb26eada8e16040f6afad2d398275b5c809ce
Jul 06 19:32:43.706277 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:43.706236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6" event={"ID":"9891402b-0817-4045-a93c-23c7157d9b21","Type":"ContainerStarted","Data":"80be6862fc332594f16d0085880cb26eada8e16040f6afad2d398275b5c809ce"}
Jul 06 19:32:44.712828 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:44.712784    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6" event={"ID":"9891402b-0817-4045-a93c-23c7157d9b21","Type":"ContainerStarted","Data":"6abce76f6125e3bd7347993f4626faa36421464c758c24abe6e598d2d04e03a3"}
Jul 06 19:32:44.713329 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:44.712953    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:44.729733 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:44.729674    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6" podStartSLOduration=2.212763494 podStartE2EDuration="2.729658577s" totalImagesPullingTime="516.895083ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:44.728728858 +0000 UTC m=+1638.338856200" watchObservedRunningTime="2026-07-06 19:32:44.729658577 +0000 UTC m=+1638.339785920"
Jul 06 19:32:50.724322 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:50.724293    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:54.954212 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:54.954178    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"]
Jul 06 19:32:54.954680 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:54.954416    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6" podUID="9891402b-0817-4045-a93c-23c7157d9b21" containerName="maas-api" containerID="cri-o://6abce76f6125e3bd7347993f4626faa36421464c758c24abe6e598d2d04e03a3" gracePeriod=30
Jul 06 19:32:55.213663 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.213599    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:55.356971 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.356926    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46zkp\" (UniqueName: \"kubernetes.io/projected/9891402b-0817-4045-a93c-23c7157d9b21-kube-api-access-46zkp\") pod \"9891402b-0817-4045-a93c-23c7157d9b21\" (UID: \"9891402b-0817-4045-a93c-23c7157d9b21\") "
Jul 06 19:32:55.357149 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.357022    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9891402b-0817-4045-a93c-23c7157d9b21-openshift-service-ca\") pod \"9891402b-0817-4045-a93c-23c7157d9b21\" (UID: \"9891402b-0817-4045-a93c-23c7157d9b21\") "
Jul 06 19:32:55.357149 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.357052    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9891402b-0817-4045-a93c-23c7157d9b21-maas-api-tls\") pod \"9891402b-0817-4045-a93c-23c7157d9b21\" (UID: \"9891402b-0817-4045-a93c-23c7157d9b21\") "
Jul 06 19:32:55.357477 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.357446    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9891402b-0817-4045-a93c-23c7157d9b21-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9891402b-0817-4045-a93c-23c7157d9b21" (UID: "9891402b-0817-4045-a93c-23c7157d9b21"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:32:55.359269 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.359242    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9891402b-0817-4045-a93c-23c7157d9b21-kube-api-access-46zkp" (OuterVolumeSpecName: "kube-api-access-46zkp") pod "9891402b-0817-4045-a93c-23c7157d9b21" (UID: "9891402b-0817-4045-a93c-23c7157d9b21"). InnerVolumeSpecName "kube-api-access-46zkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:32:55.359518 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.359503    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9891402b-0817-4045-a93c-23c7157d9b21-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9891402b-0817-4045-a93c-23c7157d9b21" (UID: "9891402b-0817-4045-a93c-23c7157d9b21"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:32:55.458824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.458779    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9891402b-0817-4045-a93c-23c7157d9b21-openshift-service-ca\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:32:55.458824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.458822    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9891402b-0817-4045-a93c-23c7157d9b21-maas-api-tls\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:32:55.459035 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.458838    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46zkp\" (UniqueName: \"kubernetes.io/projected/9891402b-0817-4045-a93c-23c7157d9b21-kube-api-access-46zkp\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:32:55.776871 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.776831    2580 generic.go:356] "Generic (PLEG): container finished" podID="9891402b-0817-4045-a93c-23c7157d9b21" containerID="6abce76f6125e3bd7347993f4626faa36421464c758c24abe6e598d2d04e03a3" exitCode=0
Jul 06 19:32:55.776871 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.776875    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"
Jul 06 19:32:55.777128 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.776914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6" event={"ID":"9891402b-0817-4045-a93c-23c7157d9b21","Type":"ContainerDied","Data":"6abce76f6125e3bd7347993f4626faa36421464c758c24abe6e598d2d04e03a3"}
Jul 06 19:32:55.777128 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.776970    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6" event={"ID":"9891402b-0817-4045-a93c-23c7157d9b21","Type":"ContainerDied","Data":"80be6862fc332594f16d0085880cb26eada8e16040f6afad2d398275b5c809ce"}
Jul 06 19:32:55.777128 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.776993    2580 scope.go:117] "RemoveContainer" containerID="6abce76f6125e3bd7347993f4626faa36421464c758c24abe6e598d2d04e03a3"
Jul 06 19:32:55.790767 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.790749    2580 scope.go:117] "RemoveContainer" containerID="6abce76f6125e3bd7347993f4626faa36421464c758c24abe6e598d2d04e03a3"
Jul 06 19:32:55.791086 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:32:55.791067    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6abce76f6125e3bd7347993f4626faa36421464c758c24abe6e598d2d04e03a3\": container with ID starting with 6abce76f6125e3bd7347993f4626faa36421464c758c24abe6e598d2d04e03a3 not found: ID does not exist" containerID="6abce76f6125e3bd7347993f4626faa36421464c758c24abe6e598d2d04e03a3"
Jul 06 19:32:55.791154 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.791097    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6abce76f6125e3bd7347993f4626faa36421464c758c24abe6e598d2d04e03a3"} err="failed to get container status \"6abce76f6125e3bd7347993f4626faa36421464c758c24abe6e598d2d04e03a3\": rpc error: code = NotFound desc = could not find container \"6abce76f6125e3bd7347993f4626faa36421464c758c24abe6e598d2d04e03a3\": container with ID starting with 6abce76f6125e3bd7347993f4626faa36421464c758c24abe6e598d2d04e03a3 not found: ID does not exist"
Jul 06 19:32:55.803497 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.803470    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"]
Jul 06 19:32:55.805484 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:55.805462    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc2689dc-7549fbcd7f-tnrw6"]
Jul 06 19:32:56.851336 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:56.851302    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9891402b-0817-4045-a93c-23c7157d9b21" path="/var/lib/kubelet/pods/9891402b-0817-4045-a93c-23c7157d9b21/volumes"
Jul 06 19:32:57.702909 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:57.702872    2580 patch_prober.go:28] interesting pod/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 06 19:32:57.703124 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:57.702935    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv" podUID="756b7244-9699-460e-9895-b3b5359ee443" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 06 19:32:57.790055 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:57.790022    2580 generic.go:356] "Generic (PLEG): container finished" podID="756b7244-9699-460e-9895-b3b5359ee443" containerID="665100efe4be68bf11d7d6f5f655f28b121552954e4a48f2667ee255bb20880f" exitCode=0
Jul 06 19:32:57.790224 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:57.790098    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv" event={"ID":"756b7244-9699-460e-9895-b3b5359ee443","Type":"ContainerDied","Data":"665100efe4be68bf11d7d6f5f655f28b121552954e4a48f2667ee255bb20880f"}
Jul 06 19:32:57.790587 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:57.790572    2580 scope.go:117] "RemoveContainer" containerID="665100efe4be68bf11d7d6f5f655f28b121552954e4a48f2667ee255bb20880f"
Jul 06 19:32:57.791587 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:57.791559    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:32:57.791660 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:57.791641    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:32:57.791734 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:57.791701    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:32:58.796614 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:58.796574    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv" event={"ID":"756b7244-9699-460e-9895-b3b5359ee443","Type":"ContainerStarted","Data":"3eb64e9cc261979b0bb4c802dd9505ab11bb0f0f9b54dc083819229fcab6bff7"}
Jul 06 19:32:58.837492 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:58.837458    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:58.841678 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:58.841653    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:59.801854 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:59.801827    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:32:59.802839 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:32:59.802817    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:33:01.426302 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:01.426257    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"]
Jul 06 19:33:01.812539 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:01.812454    2580 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv" secret="" err="secret \"e2e-mt-bc2689dc-openshift-default-dockercfg-tk5mz\" not found"
Jul 06 19:33:02.816899 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:02.816860    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv" podUID="756b7244-9699-460e-9895-b3b5359ee443" containerName="istio-proxy" containerID="cri-o://3eb64e9cc261979b0bb4c802dd9505ab11bb0f0f9b54dc083819229fcab6bff7" gracePeriod=30
Jul 06 19:33:08.067815 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.067789    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:33:08.179077 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179050    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht4r7\" (UniqueName: \"kubernetes.io/projected/756b7244-9699-460e-9895-b3b5359ee443-kube-api-access-ht4r7\") pod \"756b7244-9699-460e-9895-b3b5359ee443\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") "
Jul 06 19:33:08.179238 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179101    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-workload-socket\") pod \"756b7244-9699-460e-9895-b3b5359ee443\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") "
Jul 06 19:33:08.179238 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179142    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-istio-envoy\") pod \"756b7244-9699-460e-9895-b3b5359ee443\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") "
Jul 06 19:33:08.179238 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179178    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-istio-data\") pod \"756b7244-9699-460e-9895-b3b5359ee443\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") "
Jul 06 19:33:08.179238 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179220    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-workload-certs\") pod \"756b7244-9699-460e-9895-b3b5359ee443\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") "
Jul 06 19:33:08.179435 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179260    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756b7244-9699-460e-9895-b3b5359ee443-istiod-ca-cert\") pod \"756b7244-9699-460e-9895-b3b5359ee443\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") "
Jul 06 19:33:08.179435 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179275    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-credential-socket\") pod \"756b7244-9699-460e-9895-b3b5359ee443\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") "
Jul 06 19:33:08.179435 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179315    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756b7244-9699-460e-9895-b3b5359ee443-istio-podinfo\") pod \"756b7244-9699-460e-9895-b3b5359ee443\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") "
Jul 06 19:33:08.179435 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179345    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756b7244-9699-460e-9895-b3b5359ee443-istio-token\") pod \"756b7244-9699-460e-9895-b3b5359ee443\" (UID: \"756b7244-9699-460e-9895-b3b5359ee443\") "
Jul 06 19:33:08.179699 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179449    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "756b7244-9699-460e-9895-b3b5359ee443" (UID: "756b7244-9699-460e-9895-b3b5359ee443"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:33:08.179699 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179585    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "756b7244-9699-460e-9895-b3b5359ee443" (UID: "756b7244-9699-460e-9895-b3b5359ee443"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:33:08.179699 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179603    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "756b7244-9699-460e-9895-b3b5359ee443" (UID: "756b7244-9699-460e-9895-b3b5359ee443"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:33:08.179699 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179678    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-workload-certs\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:33:08.179699 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179697    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-credential-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:33:08.179984 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179696    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/756b7244-9699-460e-9895-b3b5359ee443-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "756b7244-9699-460e-9895-b3b5359ee443" (UID: "756b7244-9699-460e-9895-b3b5359ee443"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:33:08.179984 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.179741    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-workload-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:33:08.180346 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.180317    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-istio-data" (OuterVolumeSpecName: "istio-data") pod "756b7244-9699-460e-9895-b3b5359ee443" (UID: "756b7244-9699-460e-9895-b3b5359ee443"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:33:08.181538 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.181507    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "756b7244-9699-460e-9895-b3b5359ee443" (UID: "756b7244-9699-460e-9895-b3b5359ee443"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:33:08.181636 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.181545    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/756b7244-9699-460e-9895-b3b5359ee443-istio-token" (OuterVolumeSpecName: "istio-token") pod "756b7244-9699-460e-9895-b3b5359ee443" (UID: "756b7244-9699-460e-9895-b3b5359ee443"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:33:08.181681 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.181631    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/756b7244-9699-460e-9895-b3b5359ee443-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "756b7244-9699-460e-9895-b3b5359ee443" (UID: "756b7244-9699-460e-9895-b3b5359ee443"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:33:08.181681 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.181631    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/756b7244-9699-460e-9895-b3b5359ee443-kube-api-access-ht4r7" (OuterVolumeSpecName: "kube-api-access-ht4r7") pod "756b7244-9699-460e-9895-b3b5359ee443" (UID: "756b7244-9699-460e-9895-b3b5359ee443"). InnerVolumeSpecName "kube-api-access-ht4r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:33:08.280975 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.280927    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-istio-envoy\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:33:08.280975 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.280968    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/756b7244-9699-460e-9895-b3b5359ee443-istio-data\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:33:08.280975 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.280977    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/756b7244-9699-460e-9895-b3b5359ee443-istiod-ca-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:33:08.280975 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.280985    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/756b7244-9699-460e-9895-b3b5359ee443-istio-podinfo\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:33:08.280975 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.280993    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/756b7244-9699-460e-9895-b3b5359ee443-istio-token\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:33:08.281298 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.281002    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht4r7\" (UniqueName: \"kubernetes.io/projected/756b7244-9699-460e-9895-b3b5359ee443-kube-api-access-ht4r7\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:33:08.847155 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.847124    2580 generic.go:356] "Generic (PLEG): container finished" podID="756b7244-9699-460e-9895-b3b5359ee443" containerID="3eb64e9cc261979b0bb4c802dd9505ab11bb0f0f9b54dc083819229fcab6bff7" exitCode=0
Jul 06 19:33:08.847341 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.847214    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"
Jul 06 19:33:08.850296 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.850268    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv" event={"ID":"756b7244-9699-460e-9895-b3b5359ee443","Type":"ContainerDied","Data":"3eb64e9cc261979b0bb4c802dd9505ab11bb0f0f9b54dc083819229fcab6bff7"}
Jul 06 19:33:08.850442 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.850311    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv" event={"ID":"756b7244-9699-460e-9895-b3b5359ee443","Type":"ContainerDied","Data":"3e5577feeaef459a097cff6c1dea4ee15c208c580324e1245fc2734116b2f038"}
Jul 06 19:33:08.850442 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.850333    2580 scope.go:117] "RemoveContainer" containerID="3eb64e9cc261979b0bb4c802dd9505ab11bb0f0f9b54dc083819229fcab6bff7"
Jul 06 19:33:08.860338 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.860319    2580 scope.go:117] "RemoveContainer" containerID="665100efe4be68bf11d7d6f5f655f28b121552954e4a48f2667ee255bb20880f"
Jul 06 19:33:08.868145 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.868125    2580 scope.go:117] "RemoveContainer" containerID="3eb64e9cc261979b0bb4c802dd9505ab11bb0f0f9b54dc083819229fcab6bff7"
Jul 06 19:33:08.868392 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:33:08.868372    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eb64e9cc261979b0bb4c802dd9505ab11bb0f0f9b54dc083819229fcab6bff7\": container with ID starting with 3eb64e9cc261979b0bb4c802dd9505ab11bb0f0f9b54dc083819229fcab6bff7 not found: ID does not exist" containerID="3eb64e9cc261979b0bb4c802dd9505ab11bb0f0f9b54dc083819229fcab6bff7"
Jul 06 19:33:08.868439 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.868401    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eb64e9cc261979b0bb4c802dd9505ab11bb0f0f9b54dc083819229fcab6bff7"} err="failed to get container status \"3eb64e9cc261979b0bb4c802dd9505ab11bb0f0f9b54dc083819229fcab6bff7\": rpc error: code = NotFound desc = could not find container \"3eb64e9cc261979b0bb4c802dd9505ab11bb0f0f9b54dc083819229fcab6bff7\": container with ID starting with 3eb64e9cc261979b0bb4c802dd9505ab11bb0f0f9b54dc083819229fcab6bff7 not found: ID does not exist"
Jul 06 19:33:08.868439 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.868417    2580 scope.go:117] "RemoveContainer" containerID="665100efe4be68bf11d7d6f5f655f28b121552954e4a48f2667ee255bb20880f"
Jul 06 19:33:08.868689 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:33:08.868670    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"665100efe4be68bf11d7d6f5f655f28b121552954e4a48f2667ee255bb20880f\": container with ID starting with 665100efe4be68bf11d7d6f5f655f28b121552954e4a48f2667ee255bb20880f not found: ID does not exist" containerID="665100efe4be68bf11d7d6f5f655f28b121552954e4a48f2667ee255bb20880f"
Jul 06 19:33:08.868797 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.868697    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"665100efe4be68bf11d7d6f5f655f28b121552954e4a48f2667ee255bb20880f"} err="failed to get container status \"665100efe4be68bf11d7d6f5f655f28b121552954e4a48f2667ee255bb20880f\": rpc error: code = NotFound desc = could not find container \"665100efe4be68bf11d7d6f5f655f28b121552954e4a48f2667ee255bb20880f\": container with ID starting with 665100efe4be68bf11d7d6f5f655f28b121552954e4a48f2667ee255bb20880f not found: ID does not exist"
Jul 06 19:33:08.871098 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.871077    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"]
Jul 06 19:33:08.874852 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:08.874832    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bc2689dc-openshift-default-566c88fbc-tr8gv"]
Jul 06 19:33:10.851139 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:10.851104    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="756b7244-9699-460e-9895-b3b5359ee443" path="/var/lib/kubelet/pods/756b7244-9699-460e-9895-b3b5359ee443/volumes"
Jul 06 19:33:21.858046 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.858014    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"]
Jul 06 19:33:21.858515 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.858410    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9891402b-0817-4045-a93c-23c7157d9b21" containerName="maas-api"
Jul 06 19:33:21.858515 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.858422    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9891402b-0817-4045-a93c-23c7157d9b21" containerName="maas-api"
Jul 06 19:33:21.858515 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.858440    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756b7244-9699-460e-9895-b3b5359ee443" containerName="istio-proxy"
Jul 06 19:33:21.858515 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.858446    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="756b7244-9699-460e-9895-b3b5359ee443" containerName="istio-proxy"
Jul 06 19:33:21.858515 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.858461    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756b7244-9699-460e-9895-b3b5359ee443" containerName="istio-proxy"
Jul 06 19:33:21.858515 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.858467    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="756b7244-9699-460e-9895-b3b5359ee443" containerName="istio-proxy"
Jul 06 19:33:21.858752 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.858548    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9891402b-0817-4045-a93c-23c7157d9b21" containerName="maas-api"
Jul 06 19:33:21.858752 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.858557    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="756b7244-9699-460e-9895-b3b5359ee443" containerName="istio-proxy"
Jul 06 19:33:21.858752 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.858564    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="756b7244-9699-460e-9895-b3b5359ee443" containerName="istio-proxy"
Jul 06 19:33:21.863207 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.863188    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:21.865819 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.865796    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e2251edc-openshift-default-dockercfg-6wsdj\""
Jul 06 19:33:21.875688 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.875661    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"]
Jul 06 19:33:21.906219 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.906184    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6747cff0-2836-42fd-b47e-d5392eadd896-istio-podinfo\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:21.906219 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.906224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-workload-certs\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:21.906457 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.906318    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-credential-socket\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:21.906457 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.906347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6747cff0-2836-42fd-b47e-d5392eadd896-istio-token\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:21.906457 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.906363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6747cff0-2836-42fd-b47e-d5392eadd896-istiod-ca-cert\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:21.906621 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.906458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59zsm\" (UniqueName: \"kubernetes.io/projected/6747cff0-2836-42fd-b47e-d5392eadd896-kube-api-access-59zsm\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:21.906621 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.906499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-workload-socket\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:21.906621 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.906535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-istio-data\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:21.906621 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:21.906584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-istio-envoy\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.007523 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.007485    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-credential-socket\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.007523 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.007524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6747cff0-2836-42fd-b47e-d5392eadd896-istio-token\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.007804 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.007540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6747cff0-2836-42fd-b47e-d5392eadd896-istiod-ca-cert\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.007804 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.007572    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59zsm\" (UniqueName: \"kubernetes.io/projected/6747cff0-2836-42fd-b47e-d5392eadd896-kube-api-access-59zsm\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.007804 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.007592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-workload-socket\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.007804 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.007613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-istio-data\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.007804 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.007658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-istio-envoy\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.007804 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.007735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6747cff0-2836-42fd-b47e-d5392eadd896-istio-podinfo\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.007804 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.007774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-workload-certs\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.008170 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.008038    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-credential-socket\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.008170 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.008076    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-workload-socket\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.008170 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.008133    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-istio-data\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.008279 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.008243    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-workload-certs\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.008459 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.008436    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6747cff0-2836-42fd-b47e-d5392eadd896-istiod-ca-cert\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.010117 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.010094    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-istio-envoy\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.010367 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.010344    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6747cff0-2836-42fd-b47e-d5392eadd896-istio-podinfo\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.016123 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.016095    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59zsm\" (UniqueName: \"kubernetes.io/projected/6747cff0-2836-42fd-b47e-d5392eadd896-kube-api-access-59zsm\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.016237 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.016126    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6747cff0-2836-42fd-b47e-d5392eadd896-istio-token\") pod \"e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") " pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.174228 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.174195    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:22.317763 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.317736    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"]
Jul 06 19:33:22.319835 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:33:22.319804    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6747cff0_2836_42fd_b47e_d5392eadd896.slice/crio-1b147488e9f8bf469f72cc9293597d388c3f29d0433c3d169343d6a63048f2c1 WatchSource:0}: Error finding container 1b147488e9f8bf469f72cc9293597d388c3f29d0433c3d169343d6a63048f2c1: Status 404 returned error can't find the container with id 1b147488e9f8bf469f72cc9293597d388c3f29d0433c3d169343d6a63048f2c1
Jul 06 19:33:22.321912 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.321882    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:33:22.322005 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.321963    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:33:22.322005 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.321992    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:33:22.921202 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.921153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r" event={"ID":"6747cff0-2836-42fd-b47e-d5392eadd896","Type":"ContainerStarted","Data":"63bbcbd6910300a5a7dce03d7c98c59bbad63c14bb748c879806908cf1874568"}
Jul 06 19:33:22.921697 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.921223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r" event={"ID":"6747cff0-2836-42fd-b47e-d5392eadd896","Type":"ContainerStarted","Data":"1b147488e9f8bf469f72cc9293597d388c3f29d0433c3d169343d6a63048f2c1"}
Jul 06 19:33:22.943140 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:22.943081    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r" podStartSLOduration=1.943065942 podStartE2EDuration="1.943065942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:22.942127347 +0000 UTC m=+1676.552254707" watchObservedRunningTime="2026-07-06 19:33:22.943065942 +0000 UTC m=+1676.553193288"
Jul 06 19:33:23.174640 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:23.174544    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:23.179383 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:23.179357    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:23.926703 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:23.926667    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:23.927748 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:23.927730    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:24.899312 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:24.899272    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"]
Jul 06 19:33:24.903575 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:24.903554    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:33:24.906141 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:24.906117    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e2251edc-serving-cert\""
Jul 06 19:33:24.911966 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:24.911944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"]
Jul 06 19:33:24.938458 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:24.938429    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f14afb7-1b08-4360-b820-77af358644f8-openshift-service-ca\") pod \"maas-api-e2e-mt-e2251edc-787f87699-mnzgw\" (UID: \"8f14afb7-1b08-4360-b820-77af358644f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:33:24.938864 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:24.938469    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9prtm\" (UniqueName: \"kubernetes.io/projected/8f14afb7-1b08-4360-b820-77af358644f8-kube-api-access-9prtm\") pod \"maas-api-e2e-mt-e2251edc-787f87699-mnzgw\" (UID: \"8f14afb7-1b08-4360-b820-77af358644f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:33:24.938864 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:24.938510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f14afb7-1b08-4360-b820-77af358644f8-maas-api-tls\") pod \"maas-api-e2e-mt-e2251edc-787f87699-mnzgw\" (UID: \"8f14afb7-1b08-4360-b820-77af358644f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:33:25.039849 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:25.039819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f14afb7-1b08-4360-b820-77af358644f8-openshift-service-ca\") pod \"maas-api-e2e-mt-e2251edc-787f87699-mnzgw\" (UID: \"8f14afb7-1b08-4360-b820-77af358644f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:33:25.040045 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:25.039867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9prtm\" (UniqueName: \"kubernetes.io/projected/8f14afb7-1b08-4360-b820-77af358644f8-kube-api-access-9prtm\") pod \"maas-api-e2e-mt-e2251edc-787f87699-mnzgw\" (UID: \"8f14afb7-1b08-4360-b820-77af358644f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:33:25.040045 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:25.039900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f14afb7-1b08-4360-b820-77af358644f8-maas-api-tls\") pod \"maas-api-e2e-mt-e2251edc-787f87699-mnzgw\" (UID: \"8f14afb7-1b08-4360-b820-77af358644f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:33:25.040173 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:33:25.040130    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-serving-cert: secret "maas-api-e2e-mt-e2251edc-serving-cert" not found
Jul 06 19:33:25.040230 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:33:25.040212    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f14afb7-1b08-4360-b820-77af358644f8-maas-api-tls podName:8f14afb7-1b08-4360-b820-77af358644f8 nodeName:}" failed. No retries permitted until 2026-07-06 19:33:25.540190798 +0000 UTC m=+1679.150318133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8f14afb7-1b08-4360-b820-77af358644f8-maas-api-tls") pod "maas-api-e2e-mt-e2251edc-787f87699-mnzgw" (UID: "8f14afb7-1b08-4360-b820-77af358644f8") : secret "maas-api-e2e-mt-e2251edc-serving-cert" not found
Jul 06 19:33:25.040653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:25.040634    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f14afb7-1b08-4360-b820-77af358644f8-openshift-service-ca\") pod \"maas-api-e2e-mt-e2251edc-787f87699-mnzgw\" (UID: \"8f14afb7-1b08-4360-b820-77af358644f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:33:25.049201 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:25.049172    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9prtm\" (UniqueName: \"kubernetes.io/projected/8f14afb7-1b08-4360-b820-77af358644f8-kube-api-access-9prtm\") pod \"maas-api-e2e-mt-e2251edc-787f87699-mnzgw\" (UID: \"8f14afb7-1b08-4360-b820-77af358644f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:33:25.545159 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:25.545127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f14afb7-1b08-4360-b820-77af358644f8-maas-api-tls\") pod \"maas-api-e2e-mt-e2251edc-787f87699-mnzgw\" (UID: \"8f14afb7-1b08-4360-b820-77af358644f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:33:25.547589 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:25.547566    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f14afb7-1b08-4360-b820-77af358644f8-maas-api-tls\") pod \"maas-api-e2e-mt-e2251edc-787f87699-mnzgw\" (UID: \"8f14afb7-1b08-4360-b820-77af358644f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:33:25.818520 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:25.818432    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:33:25.957638 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:25.957482    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"]
Jul 06 19:33:25.960095 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:33:25.960058    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f14afb7_1b08_4360_b820_77af358644f8.slice/crio-7b7bf9d2d0eaf6b27fc6b6a5ddc90e667592f71371a30c1a6b1dec7a854ef7cc WatchSource:0}: Error finding container 7b7bf9d2d0eaf6b27fc6b6a5ddc90e667592f71371a30c1a6b1dec7a854ef7cc: Status 404 returned error can't find the container with id 7b7bf9d2d0eaf6b27fc6b6a5ddc90e667592f71371a30c1a6b1dec7a854ef7cc
Jul 06 19:33:26.943975 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:26.943937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw" event={"ID":"8f14afb7-1b08-4360-b820-77af358644f8","Type":"ContainerStarted","Data":"c41b1ac8c22adc826887c078768f2fffc5c575eb75969d7e8c301cf6d774aa02"}
Jul 06 19:33:26.944343 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:26.944216    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw" event={"ID":"8f14afb7-1b08-4360-b820-77af358644f8","Type":"ContainerStarted","Data":"7b7bf9d2d0eaf6b27fc6b6a5ddc90e667592f71371a30c1a6b1dec7a854ef7cc"}
Jul 06 19:33:26.944548 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:26.944526    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:33:26.966633 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:26.966574    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw" podStartSLOduration=2.586220698 podStartE2EDuration="2.966559773s" totalImagesPullingTime="380.339075ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:26.964502835 +0000 UTC m=+1680.574630182" watchObservedRunningTime="2026-07-06 19:33:26.966559773 +0000 UTC m=+1680.576687116"
Jul 06 19:33:32.955411 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:32.955372    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:33:35.993575 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:35.993542    2580 generic.go:356] "Generic (PLEG): container finished" podID="6747cff0-2836-42fd-b47e-d5392eadd896" containerID="63bbcbd6910300a5a7dce03d7c98c59bbad63c14bb748c879806908cf1874568" exitCode=0
Jul 06 19:33:35.994043 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:35.993623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r" event={"ID":"6747cff0-2836-42fd-b47e-d5392eadd896","Type":"ContainerDied","Data":"63bbcbd6910300a5a7dce03d7c98c59bbad63c14bb748c879806908cf1874568"}
Jul 06 19:33:35.994101 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:35.994087    2580 scope.go:117] "RemoveContainer" containerID="63bbcbd6910300a5a7dce03d7c98c59bbad63c14bb748c879806908cf1874568"
Jul 06 19:33:35.995219 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:35.995191    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:33:35.995309 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:35.995283    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:33:35.995362 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:35.995330    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:33:36.999845 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:36.999812    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r" event={"ID":"6747cff0-2836-42fd-b47e-d5392eadd896","Type":"ContainerStarted","Data":"41c6724252605a794946d28b5778b343b11a5c19c9e063621e2efda759e4f6e5"}
Jul 06 19:33:37.175033 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:37.175001    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:37.176371 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:37.176346    2580 patch_prober.go:28] interesting pod/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 06 19:33:37.176488 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:37.176398    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r" podUID="6747cff0-2836-42fd-b47e-d5392eadd896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 06 19:33:38.175412 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:38.175376    2580 patch_prober.go:28] interesting pod/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 06 19:33:38.175913 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:38.175434    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r" podUID="6747cff0-2836-42fd-b47e-d5392eadd896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 06 19:33:38.927216 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:38.927160    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:39.174671 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:39.174635    2580 patch_prober.go:28] interesting pod/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 06 19:33:39.174872 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:39.174696    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r" podUID="6747cff0-2836-42fd-b47e-d5392eadd896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 06 19:33:40.175146 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:40.175099    2580 patch_prober.go:28] interesting pod/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 06 19:33:40.175553 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:40.175174    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r" podUID="6747cff0-2836-42fd-b47e-d5392eadd896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 06 19:33:41.174551 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:41.174509    2580 patch_prober.go:28] interesting pod/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 06 19:33:41.174752 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:41.174577    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r" podUID="6747cff0-2836-42fd-b47e-d5392eadd896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 06 19:33:42.178936 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:42.178907    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:33:42.180436 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:33:42.180414    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:34:22.474896 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:22.474862    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"]
Jul 06 19:34:22.475410 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:22.475103    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw" podUID="8f14afb7-1b08-4360-b820-77af358644f8" containerName="maas-api" containerID="cri-o://c41b1ac8c22adc826887c078768f2fffc5c575eb75969d7e8c301cf6d774aa02" gracePeriod=30
Jul 06 19:34:22.727613 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:22.727554    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:34:22.869726 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:22.869673    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f14afb7-1b08-4360-b820-77af358644f8-openshift-service-ca\") pod \"8f14afb7-1b08-4360-b820-77af358644f8\" (UID: \"8f14afb7-1b08-4360-b820-77af358644f8\") "
Jul 06 19:34:22.869886 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:22.869736    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f14afb7-1b08-4360-b820-77af358644f8-maas-api-tls\") pod \"8f14afb7-1b08-4360-b820-77af358644f8\" (UID: \"8f14afb7-1b08-4360-b820-77af358644f8\") "
Jul 06 19:34:22.869886 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:22.869873    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9prtm\" (UniqueName: \"kubernetes.io/projected/8f14afb7-1b08-4360-b820-77af358644f8-kube-api-access-9prtm\") pod \"8f14afb7-1b08-4360-b820-77af358644f8\" (UID: \"8f14afb7-1b08-4360-b820-77af358644f8\") "
Jul 06 19:34:22.870058 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:22.870027    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f14afb7-1b08-4360-b820-77af358644f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8f14afb7-1b08-4360-b820-77af358644f8" (UID: "8f14afb7-1b08-4360-b820-77af358644f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:34:22.870196 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:22.870179    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f14afb7-1b08-4360-b820-77af358644f8-openshift-service-ca\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:34:22.871806 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:22.871777    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f14afb7-1b08-4360-b820-77af358644f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8f14afb7-1b08-4360-b820-77af358644f8" (UID: "8f14afb7-1b08-4360-b820-77af358644f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:34:22.871886 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:22.871813    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f14afb7-1b08-4360-b820-77af358644f8-kube-api-access-9prtm" (OuterVolumeSpecName: "kube-api-access-9prtm") pod "8f14afb7-1b08-4360-b820-77af358644f8" (UID: "8f14afb7-1b08-4360-b820-77af358644f8"). InnerVolumeSpecName "kube-api-access-9prtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:34:22.971141 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:22.971109    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f14afb7-1b08-4360-b820-77af358644f8-maas-api-tls\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:34:22.971141 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:22.971135    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9prtm\" (UniqueName: \"kubernetes.io/projected/8f14afb7-1b08-4360-b820-77af358644f8-kube-api-access-9prtm\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:34:23.223554 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:23.223521    2580 generic.go:356] "Generic (PLEG): container finished" podID="8f14afb7-1b08-4360-b820-77af358644f8" containerID="c41b1ac8c22adc826887c078768f2fffc5c575eb75969d7e8c301cf6d774aa02" exitCode=0
Jul 06 19:34:23.223730 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:23.223562    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"
Jul 06 19:34:23.223730 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:23.223600    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw" event={"ID":"8f14afb7-1b08-4360-b820-77af358644f8","Type":"ContainerDied","Data":"c41b1ac8c22adc826887c078768f2fffc5c575eb75969d7e8c301cf6d774aa02"}
Jul 06 19:34:23.223730 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:23.223658    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw" event={"ID":"8f14afb7-1b08-4360-b820-77af358644f8","Type":"ContainerDied","Data":"7b7bf9d2d0eaf6b27fc6b6a5ddc90e667592f71371a30c1a6b1dec7a854ef7cc"}
Jul 06 19:34:23.223730 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:23.223686    2580 scope.go:117] "RemoveContainer" containerID="c41b1ac8c22adc826887c078768f2fffc5c575eb75969d7e8c301cf6d774aa02"
Jul 06 19:34:23.232825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:23.232803    2580 scope.go:117] "RemoveContainer" containerID="c41b1ac8c22adc826887c078768f2fffc5c575eb75969d7e8c301cf6d774aa02"
Jul 06 19:34:23.233091 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:34:23.233073    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c41b1ac8c22adc826887c078768f2fffc5c575eb75969d7e8c301cf6d774aa02\": container with ID starting with c41b1ac8c22adc826887c078768f2fffc5c575eb75969d7e8c301cf6d774aa02 not found: ID does not exist" containerID="c41b1ac8c22adc826887c078768f2fffc5c575eb75969d7e8c301cf6d774aa02"
Jul 06 19:34:23.233139 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:23.233102    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41b1ac8c22adc826887c078768f2fffc5c575eb75969d7e8c301cf6d774aa02"} err="failed to get container status \"c41b1ac8c22adc826887c078768f2fffc5c575eb75969d7e8c301cf6d774aa02\": rpc error: code = NotFound desc = could not find container \"c41b1ac8c22adc826887c078768f2fffc5c575eb75969d7e8c301cf6d774aa02\": container with ID starting with c41b1ac8c22adc826887c078768f2fffc5c575eb75969d7e8c301cf6d774aa02 not found: ID does not exist"
Jul 06 19:34:23.245067 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:23.245046    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"]
Jul 06 19:34:23.251110 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:23.251092    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e2251edc-787f87699-mnzgw"]
Jul 06 19:34:24.851355 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:34:24.851318    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f14afb7-1b08-4360-b820-77af358644f8" path="/var/lib/kubelet/pods/8f14afb7-1b08-4360-b820-77af358644f8/volumes"
Jul 06 19:35:16.714172 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:16.714141    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"]
Jul 06 19:35:16.714685 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:16.714373    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r" podUID="6747cff0-2836-42fd-b47e-d5392eadd896" containerName="istio-proxy" containerID="cri-o://41c6724252605a794946d28b5778b343b11a5c19c9e063621e2efda759e4f6e5" gracePeriod=30
Jul 06 19:35:21.969108 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:21.969082    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:35:22.121320 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.121220    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-workload-socket\") pod \"6747cff0-2836-42fd-b47e-d5392eadd896\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") "
Jul 06 19:35:22.121320 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.121275    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6747cff0-2836-42fd-b47e-d5392eadd896-istiod-ca-cert\") pod \"6747cff0-2836-42fd-b47e-d5392eadd896\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") "
Jul 06 19:35:22.121320 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.121295    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6747cff0-2836-42fd-b47e-d5392eadd896-istio-token\") pod \"6747cff0-2836-42fd-b47e-d5392eadd896\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") "
Jul 06 19:35:22.121622 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.121354    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-istio-envoy\") pod \"6747cff0-2836-42fd-b47e-d5392eadd896\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") "
Jul 06 19:35:22.121622 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.121391    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-credential-socket\") pod \"6747cff0-2836-42fd-b47e-d5392eadd896\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") "
Jul 06 19:35:22.121622 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.121538    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59zsm\" (UniqueName: \"kubernetes.io/projected/6747cff0-2836-42fd-b47e-d5392eadd896-kube-api-access-59zsm\") pod \"6747cff0-2836-42fd-b47e-d5392eadd896\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") "
Jul 06 19:35:22.121622 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.121581    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-workload-certs\") pod \"6747cff0-2836-42fd-b47e-d5392eadd896\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") "
Jul 06 19:35:22.121622 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.121589    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6747cff0-2836-42fd-b47e-d5392eadd896" (UID: "6747cff0-2836-42fd-b47e-d5392eadd896"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:22.121942 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.121627    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6747cff0-2836-42fd-b47e-d5392eadd896-istio-podinfo\") pod \"6747cff0-2836-42fd-b47e-d5392eadd896\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") "
Jul 06 19:35:22.121942 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.121624    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6747cff0-2836-42fd-b47e-d5392eadd896-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6747cff0-2836-42fd-b47e-d5392eadd896" (UID: "6747cff0-2836-42fd-b47e-d5392eadd896"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:35:22.121942 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.121680    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-istio-data\") pod \"6747cff0-2836-42fd-b47e-d5392eadd896\" (UID: \"6747cff0-2836-42fd-b47e-d5392eadd896\") "
Jul 06 19:35:22.121942 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.121743    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6747cff0-2836-42fd-b47e-d5392eadd896" (UID: "6747cff0-2836-42fd-b47e-d5392eadd896"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:22.122148 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.121945    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6747cff0-2836-42fd-b47e-d5392eadd896" (UID: "6747cff0-2836-42fd-b47e-d5392eadd896"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:22.122148 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.122125    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-workload-certs\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:35:22.122148 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.122146    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-workload-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:35:22.122306 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.122161    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6747cff0-2836-42fd-b47e-d5392eadd896-istiod-ca-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:35:22.122306 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.122175    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-credential-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:35:22.122533 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.122507    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-istio-data" (OuterVolumeSpecName: "istio-data") pod "6747cff0-2836-42fd-b47e-d5392eadd896" (UID: "6747cff0-2836-42fd-b47e-d5392eadd896"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:22.123658 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.123626    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6747cff0-2836-42fd-b47e-d5392eadd896" (UID: "6747cff0-2836-42fd-b47e-d5392eadd896"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:35:22.123803 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.123686    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6747cff0-2836-42fd-b47e-d5392eadd896-kube-api-access-59zsm" (OuterVolumeSpecName: "kube-api-access-59zsm") pod "6747cff0-2836-42fd-b47e-d5392eadd896" (UID: "6747cff0-2836-42fd-b47e-d5392eadd896"). InnerVolumeSpecName "kube-api-access-59zsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:22.123803 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.123683    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6747cff0-2836-42fd-b47e-d5392eadd896-istio-token" (OuterVolumeSpecName: "istio-token") pod "6747cff0-2836-42fd-b47e-d5392eadd896" (UID: "6747cff0-2836-42fd-b47e-d5392eadd896"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:35:22.123803 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.123790    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6747cff0-2836-42fd-b47e-d5392eadd896-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6747cff0-2836-42fd-b47e-d5392eadd896" (UID: "6747cff0-2836-42fd-b47e-d5392eadd896"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:35:22.223173 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.223114    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-istio-data\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:35:22.223173 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.223165    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6747cff0-2836-42fd-b47e-d5392eadd896-istio-token\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:35:22.223173 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.223175    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6747cff0-2836-42fd-b47e-d5392eadd896-istio-envoy\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:35:22.223173 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.223185    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59zsm\" (UniqueName: \"kubernetes.io/projected/6747cff0-2836-42fd-b47e-d5392eadd896-kube-api-access-59zsm\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:35:22.223173 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.223194    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6747cff0-2836-42fd-b47e-d5392eadd896-istio-podinfo\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:35:22.517922 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.517888    2580 generic.go:356] "Generic (PLEG): container finished" podID="6747cff0-2836-42fd-b47e-d5392eadd896" containerID="41c6724252605a794946d28b5778b343b11a5c19c9e063621e2efda759e4f6e5" exitCode=0
Jul 06 19:35:22.518096 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.517956    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"
Jul 06 19:35:22.518096 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.517973    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r" event={"ID":"6747cff0-2836-42fd-b47e-d5392eadd896","Type":"ContainerDied","Data":"41c6724252605a794946d28b5778b343b11a5c19c9e063621e2efda759e4f6e5"}
Jul 06 19:35:22.518096 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.518070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r" event={"ID":"6747cff0-2836-42fd-b47e-d5392eadd896","Type":"ContainerDied","Data":"1b147488e9f8bf469f72cc9293597d388c3f29d0433c3d169343d6a63048f2c1"}
Jul 06 19:35:22.518201 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.518102    2580 scope.go:117] "RemoveContainer" containerID="41c6724252605a794946d28b5778b343b11a5c19c9e063621e2efda759e4f6e5"
Jul 06 19:35:22.527640 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.527622    2580 scope.go:117] "RemoveContainer" containerID="63bbcbd6910300a5a7dce03d7c98c59bbad63c14bb748c879806908cf1874568"
Jul 06 19:35:22.535547 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.535529    2580 scope.go:117] "RemoveContainer" containerID="41c6724252605a794946d28b5778b343b11a5c19c9e063621e2efda759e4f6e5"
Jul 06 19:35:22.535803 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:35:22.535772    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41c6724252605a794946d28b5778b343b11a5c19c9e063621e2efda759e4f6e5\": container with ID starting with 41c6724252605a794946d28b5778b343b11a5c19c9e063621e2efda759e4f6e5 not found: ID does not exist" containerID="41c6724252605a794946d28b5778b343b11a5c19c9e063621e2efda759e4f6e5"
Jul 06 19:35:22.535868 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.535800    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41c6724252605a794946d28b5778b343b11a5c19c9e063621e2efda759e4f6e5"} err="failed to get container status \"41c6724252605a794946d28b5778b343b11a5c19c9e063621e2efda759e4f6e5\": rpc error: code = NotFound desc = could not find container \"41c6724252605a794946d28b5778b343b11a5c19c9e063621e2efda759e4f6e5\": container with ID starting with 41c6724252605a794946d28b5778b343b11a5c19c9e063621e2efda759e4f6e5 not found: ID does not exist"
Jul 06 19:35:22.535868 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.535818    2580 scope.go:117] "RemoveContainer" containerID="63bbcbd6910300a5a7dce03d7c98c59bbad63c14bb748c879806908cf1874568"
Jul 06 19:35:22.536071 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:35:22.536052    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63bbcbd6910300a5a7dce03d7c98c59bbad63c14bb748c879806908cf1874568\": container with ID starting with 63bbcbd6910300a5a7dce03d7c98c59bbad63c14bb748c879806908cf1874568 not found: ID does not exist" containerID="63bbcbd6910300a5a7dce03d7c98c59bbad63c14bb748c879806908cf1874568"
Jul 06 19:35:22.536129 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.536081    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63bbcbd6910300a5a7dce03d7c98c59bbad63c14bb748c879806908cf1874568"} err="failed to get container status \"63bbcbd6910300a5a7dce03d7c98c59bbad63c14bb748c879806908cf1874568\": rpc error: code = NotFound desc = could not find container \"63bbcbd6910300a5a7dce03d7c98c59bbad63c14bb748c879806908cf1874568\": container with ID starting with 63bbcbd6910300a5a7dce03d7c98c59bbad63c14bb748c879806908cf1874568 not found: ID does not exist"
Jul 06 19:35:22.541178 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.541149    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"]
Jul 06 19:35:22.547038 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.547014    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e2251edc-openshift-default-6f57bbd44c-cjv7r"]
Jul 06 19:35:22.853050 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:22.852967    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6747cff0-2836-42fd-b47e-d5392eadd896" path="/var/lib/kubelet/pods/6747cff0-2836-42fd-b47e-d5392eadd896/volumes"
Jul 06 19:35:26.908603 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:26.908573    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:35:26.914557 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:35:26.914532    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:36:12.148496 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.148459    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"]
Jul 06 19:36:12.149679 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.149648    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f14afb7-1b08-4360-b820-77af358644f8" containerName="maas-api"
Jul 06 19:36:12.149679 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.149679    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f14afb7-1b08-4360-b820-77af358644f8" containerName="maas-api"
Jul 06 19:36:12.149898 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.149733    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6747cff0-2836-42fd-b47e-d5392eadd896" containerName="istio-proxy"
Jul 06 19:36:12.149898 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.149744    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6747cff0-2836-42fd-b47e-d5392eadd896" containerName="istio-proxy"
Jul 06 19:36:12.149898 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.149762    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6747cff0-2836-42fd-b47e-d5392eadd896" containerName="istio-proxy"
Jul 06 19:36:12.149898 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.149771    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6747cff0-2836-42fd-b47e-d5392eadd896" containerName="istio-proxy"
Jul 06 19:36:12.150090 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.150001    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6747cff0-2836-42fd-b47e-d5392eadd896" containerName="istio-proxy"
Jul 06 19:36:12.150090 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.150028    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f14afb7-1b08-4360-b820-77af358644f8" containerName="maas-api"
Jul 06 19:36:12.155661 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.155626    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.159812 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.159786    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-90ac12-openshift-default-dockercfg-92rn4\""
Jul 06 19:36:12.182273 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.182251    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"]
Jul 06 19:36:12.190951 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.190919    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-data\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.191065 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.190969    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-token\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.191065 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.191014    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istiod-ca-cert\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.191065 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.191040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-podinfo\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.191065 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.191061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5md7x\" (UniqueName: \"kubernetes.io/projected/2bba3bb0-c577-4265-bcd9-6d757b2c7602-kube-api-access-5md7x\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.191259 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.191127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-workload-certs\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.191259 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.191165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-workload-socket\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.191259 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.191191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-envoy\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.191259 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.191224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-credential-socket\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.292242 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.292201    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-workload-certs\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.292242 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.292240    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-workload-socket\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.292495 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.292257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-envoy\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.292495 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.292281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-credential-socket\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.292495 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.292323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-data\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.292495 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.292351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-token\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.292495 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.292375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istiod-ca-cert\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.292495 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.292410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-podinfo\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.292495 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.292436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5md7x\" (UniqueName: \"kubernetes.io/projected/2bba3bb0-c577-4265-bcd9-6d757b2c7602-kube-api-access-5md7x\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.292829 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.292666    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-workload-certs\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.292829 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.292670    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-workload-socket\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.293061 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.293039    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-credential-socket\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.293138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.293081    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-data\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.293189 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.293142    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istiod-ca-cert\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.294653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.294633    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-envoy\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.294896 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.294879    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-podinfo\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.310428 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.310407    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-token\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.310543 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.310482    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5md7x\" (UniqueName: \"kubernetes.io/projected/2bba3bb0-c577-4265-bcd9-6d757b2c7602-kube-api-access-5md7x\") pod \"e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") " pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.466899 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.466864    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:12.607276 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.607149    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"]
Jul 06 19:36:12.610197 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:36:12.610167    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bba3bb0_c577_4265_bcd9_6d757b2c7602.slice/crio-c86de68653568443dadfc97306529144eeaee073061402897302a96d71a63cb7 WatchSource:0}: Error finding container c86de68653568443dadfc97306529144eeaee073061402897302a96d71a63cb7: Status 404 returned error can't find the container with id c86de68653568443dadfc97306529144eeaee073061402897302a96d71a63cb7
Jul 06 19:36:12.612320 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.612291    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:12.612388 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.612354    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:12.612388 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.612382    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:12.762610 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.762512    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv" event={"ID":"2bba3bb0-c577-4265-bcd9-6d757b2c7602","Type":"ContainerStarted","Data":"61d07d023e789502837406982fa2a573a0e9faa1a1c91b684f5362b4dea48878"}
Jul 06 19:36:12.762610 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.762575    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv" event={"ID":"2bba3bb0-c577-4265-bcd9-6d757b2c7602","Type":"ContainerStarted","Data":"c86de68653568443dadfc97306529144eeaee073061402897302a96d71a63cb7"}
Jul 06 19:36:12.787016 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:12.786960    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv" podStartSLOduration=0.786944959 podStartE2EDuration="786.944959ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:12.784960107 +0000 UTC m=+1846.395087461" watchObservedRunningTime="2026-07-06 19:36:12.786944959 +0000 UTC m=+1846.397072304"
Jul 06 19:36:13.467761 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:13.467721    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:13.472603 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:13.472582    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:13.768014 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:13.767924    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:13.769010 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:13.768988    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:14.798827 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:14.798799    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"]
Jul 06 19:36:14.799240 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:14.799228    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6747cff0-2836-42fd-b47e-d5392eadd896" containerName="istio-proxy"
Jul 06 19:36:14.802405 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:14.802389    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:14.804810 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:14.804790    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-90ac12-serving-cert\""
Jul 06 19:36:14.812677 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:14.812654    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"]
Jul 06 19:36:14.814723 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:14.814684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9011b815-4db5-437e-ad26-8cb0ecd989f0-maas-api-tls\") pod \"maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj\" (UID: \"9011b815-4db5-437e-ad26-8cb0ecd989f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:14.814824 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:14.814781    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9011b815-4db5-437e-ad26-8cb0ecd989f0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj\" (UID: \"9011b815-4db5-437e-ad26-8cb0ecd989f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:14.815129 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:14.815095    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2zrp\" (UniqueName: \"kubernetes.io/projected/9011b815-4db5-437e-ad26-8cb0ecd989f0-kube-api-access-c2zrp\") pod \"maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj\" (UID: \"9011b815-4db5-437e-ad26-8cb0ecd989f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:14.916506 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:14.916469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2zrp\" (UniqueName: \"kubernetes.io/projected/9011b815-4db5-437e-ad26-8cb0ecd989f0-kube-api-access-c2zrp\") pod \"maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj\" (UID: \"9011b815-4db5-437e-ad26-8cb0ecd989f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:14.916733 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:14.916681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9011b815-4db5-437e-ad26-8cb0ecd989f0-maas-api-tls\") pod \"maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj\" (UID: \"9011b815-4db5-437e-ad26-8cb0ecd989f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:14.916831 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:14.916797    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9011b815-4db5-437e-ad26-8cb0ecd989f0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj\" (UID: \"9011b815-4db5-437e-ad26-8cb0ecd989f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:14.916831 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:36:14.916824    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-serving-cert: secret "maas-api-e2e-inf-a-90ac12-serving-cert" not found
Jul 06 19:36:14.916930 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:36:14.916880    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9011b815-4db5-437e-ad26-8cb0ecd989f0-maas-api-tls podName:9011b815-4db5-437e-ad26-8cb0ecd989f0 nodeName:}" failed. No retries permitted until 2026-07-06 19:36:15.416858802 +0000 UTC m=+1849.026986127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9011b815-4db5-437e-ad26-8cb0ecd989f0-maas-api-tls") pod "maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj" (UID: "9011b815-4db5-437e-ad26-8cb0ecd989f0") : secret "maas-api-e2e-inf-a-90ac12-serving-cert" not found
Jul 06 19:36:14.917457 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:14.917434    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9011b815-4db5-437e-ad26-8cb0ecd989f0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj\" (UID: \"9011b815-4db5-437e-ad26-8cb0ecd989f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:14.926353 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:14.926326    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2zrp\" (UniqueName: \"kubernetes.io/projected/9011b815-4db5-437e-ad26-8cb0ecd989f0-kube-api-access-c2zrp\") pod \"maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj\" (UID: \"9011b815-4db5-437e-ad26-8cb0ecd989f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:15.422266 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:15.422229    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9011b815-4db5-437e-ad26-8cb0ecd989f0-maas-api-tls\") pod \"maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj\" (UID: \"9011b815-4db5-437e-ad26-8cb0ecd989f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:15.422497 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:36:15.422379    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-serving-cert: secret "maas-api-e2e-inf-a-90ac12-serving-cert" not found
Jul 06 19:36:15.422497 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:36:15.422459    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9011b815-4db5-437e-ad26-8cb0ecd989f0-maas-api-tls podName:9011b815-4db5-437e-ad26-8cb0ecd989f0 nodeName:}" failed. No retries permitted until 2026-07-06 19:36:16.422440526 +0000 UTC m=+1850.032567862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9011b815-4db5-437e-ad26-8cb0ecd989f0-maas-api-tls") pod "maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj" (UID: "9011b815-4db5-437e-ad26-8cb0ecd989f0") : secret "maas-api-e2e-inf-a-90ac12-serving-cert" not found
Jul 06 19:36:16.431696 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:16.431649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9011b815-4db5-437e-ad26-8cb0ecd989f0-maas-api-tls\") pod \"maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj\" (UID: \"9011b815-4db5-437e-ad26-8cb0ecd989f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:16.434207 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:16.434179    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9011b815-4db5-437e-ad26-8cb0ecd989f0-maas-api-tls\") pod \"maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj\" (UID: \"9011b815-4db5-437e-ad26-8cb0ecd989f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:16.614784 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:16.614749    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:16.746430 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:16.746389    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"]
Jul 06 19:36:16.748137 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:36:16.748112    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9011b815_4db5_437e_ad26_8cb0ecd989f0.slice/crio-89b77cf697fcfa82554d41a884c75b99eb18172b5dba0a64094e0d4be20d670a WatchSource:0}: Error finding container 89b77cf697fcfa82554d41a884c75b99eb18172b5dba0a64094e0d4be20d670a: Status 404 returned error can't find the container with id 89b77cf697fcfa82554d41a884c75b99eb18172b5dba0a64094e0d4be20d670a
Jul 06 19:36:16.749512 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:16.749496    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:36:16.786735 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:16.786675    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj" event={"ID":"9011b815-4db5-437e-ad26-8cb0ecd989f0","Type":"ContainerStarted","Data":"89b77cf697fcfa82554d41a884c75b99eb18172b5dba0a64094e0d4be20d670a"}
Jul 06 19:36:17.792447 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:17.792405    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj" event={"ID":"9011b815-4db5-437e-ad26-8cb0ecd989f0","Type":"ContainerStarted","Data":"c29df647f029e787daf5b0d40dbd6d3cafaaa00e2fcf6aeaf8979ca730d26cd4"}
Jul 06 19:36:17.792876 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:17.792489    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:17.810999 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:17.810950    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj" podStartSLOduration=3.392607826 podStartE2EDuration="3.810936182s" totalImagesPullingTime="418.328356ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:17.808721507 +0000 UTC m=+1851.418848861" watchObservedRunningTime="2026-07-06 19:36:17.810936182 +0000 UTC m=+1851.421063525"
Jul 06 19:36:19.950730 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:19.950549    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"]
Jul 06 19:36:19.955104 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:19.955073    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:19.958260 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:19.958236    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-67fa37-openshift-default-dockercfg-pc9d6\""
Jul 06 19:36:19.962977 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:19.962738    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"]
Jul 06 19:36:20.067616 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.067575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-credential-socket\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.067616 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.067618    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de421687-ed2e-4d80-9282-3cd131b6ef4d-istiod-ca-cert\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.067862 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.067677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59cqf\" (UniqueName: \"kubernetes.io/projected/de421687-ed2e-4d80-9282-3cd131b6ef4d-kube-api-access-59cqf\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.067862 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.067778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-workload-certs\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.067862 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.067816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-token\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.067862 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.067840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-data\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.068027 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.067881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-envoy\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.068027 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.067912    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-podinfo\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.068027 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.067934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-workload-socket\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.169245 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.169169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-token\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.169447 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.169256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-data\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.169447 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.169301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-envoy\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.169447 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.169334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-podinfo\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.169447 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.169367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-workload-socket\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.169672 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.169448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-credential-socket\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.169672 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.169473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de421687-ed2e-4d80-9282-3cd131b6ef4d-istiod-ca-cert\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.169672 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.169525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59cqf\" (UniqueName: \"kubernetes.io/projected/de421687-ed2e-4d80-9282-3cd131b6ef4d-kube-api-access-59cqf\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.169672 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.169571    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-workload-certs\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.169982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.169766    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-data\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.169982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.169826    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-workload-socket\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.169982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.169922    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-workload-certs\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.170147 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.170120    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-credential-socket\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.170633 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.170605    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de421687-ed2e-4d80-9282-3cd131b6ef4d-istiod-ca-cert\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.173646 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.173603    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-podinfo\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.173846 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.173826    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-envoy\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.176980 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.176939    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-token\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.177200 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.177175    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59cqf\" (UniqueName: \"kubernetes.io/projected/de421687-ed2e-4d80-9282-3cd131b6ef4d-kube-api-access-59cqf\") pod \"e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") " pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.267130 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.267028    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:20.445731 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.439474    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"]
Jul 06 19:36:20.455515 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:36:20.455489    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde421687_ed2e_4d80_9282_3cd131b6ef4d.slice/crio-56b295b5e35cfb00aee83b51a7459ee57275578b1d27ecb3eb3f247100ba7336 WatchSource:0}: Error finding container 56b295b5e35cfb00aee83b51a7459ee57275578b1d27ecb3eb3f247100ba7336: Status 404 returned error can't find the container with id 56b295b5e35cfb00aee83b51a7459ee57275578b1d27ecb3eb3f247100ba7336
Jul 06 19:36:20.457845 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.457808    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:20.457917 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.457897    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:20.457957 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.457938    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:20.808923 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.808882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb" event={"ID":"de421687-ed2e-4d80-9282-3cd131b6ef4d","Type":"ContainerStarted","Data":"3866e803dbe8792e7492be4c02c2e3af2f6dd754c084a60564b5100ff28a9634"}
Jul 06 19:36:20.809107 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.808946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb" event={"ID":"de421687-ed2e-4d80-9282-3cd131b6ef4d","Type":"ContainerStarted","Data":"56b295b5e35cfb00aee83b51a7459ee57275578b1d27ecb3eb3f247100ba7336"}
Jul 06 19:36:20.829952 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:20.829893    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb" podStartSLOduration=1.8298748219999998 podStartE2EDuration="1.829874822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:20.827096312 +0000 UTC m=+1854.437223676" watchObservedRunningTime="2026-07-06 19:36:20.829874822 +0000 UTC m=+1854.440002168"
Jul 06 19:36:21.267243 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:21.267207    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:21.271733 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:21.271685    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:21.813966 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:21.813932    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:21.814986 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:21.814968    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:23.802907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:23.802884    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:36:26.845136 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:26.845096    2580 generic.go:356] "Generic (PLEG): container finished" podID="2bba3bb0-c577-4265-bcd9-6d757b2c7602" containerID="61d07d023e789502837406982fa2a573a0e9faa1a1c91b684f5362b4dea48878" exitCode=0
Jul 06 19:36:26.851170 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:26.851140    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv" event={"ID":"2bba3bb0-c577-4265-bcd9-6d757b2c7602","Type":"ContainerDied","Data":"61d07d023e789502837406982fa2a573a0e9faa1a1c91b684f5362b4dea48878"}
Jul 06 19:36:26.851507 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:26.851489    2580 scope.go:117] "RemoveContainer" containerID="61d07d023e789502837406982fa2a573a0e9faa1a1c91b684f5362b4dea48878"
Jul 06 19:36:26.852518 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:26.852489    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:26.852608 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:26.852554    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:26.852608 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:26.852584    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:27.854781 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:27.854749    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv" event={"ID":"2bba3bb0-c577-4265-bcd9-6d757b2c7602","Type":"ContainerStarted","Data":"2b3d464bdb8f4c979fb2a03c2bcf4f80b446a0e0ee501475d25db728b8baf37e"}
Jul 06 19:36:28.467095 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:28.467051    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:28.468317 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:28.468291    2580 patch_prober.go:28] interesting pod/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 06 19:36:28.468425 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:28.468346    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv" podUID="2bba3bb0-c577-4265-bcd9-6d757b2c7602" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 06 19:36:28.768849 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:28.768760    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:29.467987 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:29.467951    2580 patch_prober.go:28] interesting pod/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 06 19:36:29.468393 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:29.468004    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv" podUID="2bba3bb0-c577-4265-bcd9-6d757b2c7602" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 06 19:36:30.467576 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:30.467539    2580 patch_prober.go:28] interesting pod/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 06 19:36:30.467757 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:30.467607    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv" podUID="2bba3bb0-c577-4265-bcd9-6d757b2c7602" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 06 19:36:31.468128 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:31.468075    2580 patch_prober.go:28] interesting pod/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 06 19:36:31.468631 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:31.468150    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv" podUID="2bba3bb0-c577-4265-bcd9-6d757b2c7602" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 06 19:36:32.471101 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:32.471070    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:32.472079 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:32.472059    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:36:37.850210 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:37.849868    2580 patch_prober.go:28] interesting pod/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 19:36:37.850210 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:37.849952    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb" podUID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 19:36:37.912561 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:37.912529    2580 generic.go:356] "Generic (PLEG): container finished" podID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerID="3866e803dbe8792e7492be4c02c2e3af2f6dd754c084a60564b5100ff28a9634" exitCode=0
Jul 06 19:36:37.912745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:37.912601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb" event={"ID":"de421687-ed2e-4d80-9282-3cd131b6ef4d","Type":"ContainerDied","Data":"3866e803dbe8792e7492be4c02c2e3af2f6dd754c084a60564b5100ff28a9634"}
Jul 06 19:36:37.913024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:37.913010    2580 scope.go:117] "RemoveContainer" containerID="3866e803dbe8792e7492be4c02c2e3af2f6dd754c084a60564b5100ff28a9634"
Jul 06 19:36:37.914039 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:37.914009    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:37.914142 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:37.914095    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:37.914203 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:37.914145    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:36:38.921297 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:38.921264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb" event={"ID":"de421687-ed2e-4d80-9282-3cd131b6ef4d","Type":"ContainerStarted","Data":"88a11b022f3cfc53401bf5ee5e229f3119c52cf1588040ea8cfd4cbc2161fdfd"}
Jul 06 19:36:39.267865 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:39.267765    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:39.268085 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:39.268058    2580 patch_prober.go:28] interesting pod/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 06 19:36:39.268186 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:39.268118    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb" podUID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 06 19:36:40.268097 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:40.268059    2580 patch_prober.go:28] interesting pod/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 06 19:36:40.268519 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:40.268116    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb" podUID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 06 19:36:41.267494 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:41.267462    2580 patch_prober.go:28] interesting pod/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 06 19:36:41.267665 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:41.267530    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb" podUID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 06 19:36:42.267954 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:42.267917    2580 patch_prober.go:28] interesting pod/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 06 19:36:42.268404 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:42.267975    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb" podUID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 06 19:36:43.271254 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:43.271223    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:43.271836 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:43.271516    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:36:43.272280 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:36:43.272265    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:37:22.365820 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:22.365783    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"]
Jul 06 19:37:22.366360 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:22.366148    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj" podUID="9011b815-4db5-437e-ad26-8cb0ecd989f0" containerName="maas-api" containerID="cri-o://c29df647f029e787daf5b0d40dbd6d3cafaaa00e2fcf6aeaf8979ca730d26cd4" gracePeriod=30
Jul 06 19:37:22.611144 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:22.611119    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:37:22.773607 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:22.773573    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9011b815-4db5-437e-ad26-8cb0ecd989f0-maas-api-tls\") pod \"9011b815-4db5-437e-ad26-8cb0ecd989f0\" (UID: \"9011b815-4db5-437e-ad26-8cb0ecd989f0\") "
Jul 06 19:37:22.773835 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:22.773691    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9011b815-4db5-437e-ad26-8cb0ecd989f0-openshift-service-ca\") pod \"9011b815-4db5-437e-ad26-8cb0ecd989f0\" (UID: \"9011b815-4db5-437e-ad26-8cb0ecd989f0\") "
Jul 06 19:37:22.773835 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:22.773732    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2zrp\" (UniqueName: \"kubernetes.io/projected/9011b815-4db5-437e-ad26-8cb0ecd989f0-kube-api-access-c2zrp\") pod \"9011b815-4db5-437e-ad26-8cb0ecd989f0\" (UID: \"9011b815-4db5-437e-ad26-8cb0ecd989f0\") "
Jul 06 19:37:22.774127 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:22.774092    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9011b815-4db5-437e-ad26-8cb0ecd989f0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9011b815-4db5-437e-ad26-8cb0ecd989f0" (UID: "9011b815-4db5-437e-ad26-8cb0ecd989f0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:37:22.775855 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:22.775824    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9011b815-4db5-437e-ad26-8cb0ecd989f0-kube-api-access-c2zrp" (OuterVolumeSpecName: "kube-api-access-c2zrp") pod "9011b815-4db5-437e-ad26-8cb0ecd989f0" (UID: "9011b815-4db5-437e-ad26-8cb0ecd989f0"). InnerVolumeSpecName "kube-api-access-c2zrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:37:22.775952 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:22.775909    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9011b815-4db5-437e-ad26-8cb0ecd989f0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9011b815-4db5-437e-ad26-8cb0ecd989f0" (UID: "9011b815-4db5-437e-ad26-8cb0ecd989f0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:37:22.875081 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:22.875052    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9011b815-4db5-437e-ad26-8cb0ecd989f0-openshift-service-ca\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:37:22.875081 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:22.875079    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2zrp\" (UniqueName: \"kubernetes.io/projected/9011b815-4db5-437e-ad26-8cb0ecd989f0-kube-api-access-c2zrp\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:37:22.875234 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:22.875089    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9011b815-4db5-437e-ad26-8cb0ecd989f0-maas-api-tls\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:37:23.155884 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:23.155797    2580 generic.go:356] "Generic (PLEG): container finished" podID="9011b815-4db5-437e-ad26-8cb0ecd989f0" containerID="c29df647f029e787daf5b0d40dbd6d3cafaaa00e2fcf6aeaf8979ca730d26cd4" exitCode=0
Jul 06 19:37:23.155884 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:23.155849    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"
Jul 06 19:37:23.156095 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:23.155882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj" event={"ID":"9011b815-4db5-437e-ad26-8cb0ecd989f0","Type":"ContainerDied","Data":"c29df647f029e787daf5b0d40dbd6d3cafaaa00e2fcf6aeaf8979ca730d26cd4"}
Jul 06 19:37:23.156095 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:23.155934    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj" event={"ID":"9011b815-4db5-437e-ad26-8cb0ecd989f0","Type":"ContainerDied","Data":"89b77cf697fcfa82554d41a884c75b99eb18172b5dba0a64094e0d4be20d670a"}
Jul 06 19:37:23.156095 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:23.155956    2580 scope.go:117] "RemoveContainer" containerID="c29df647f029e787daf5b0d40dbd6d3cafaaa00e2fcf6aeaf8979ca730d26cd4"
Jul 06 19:37:23.164898 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:23.164858    2580 scope.go:117] "RemoveContainer" containerID="c29df647f029e787daf5b0d40dbd6d3cafaaa00e2fcf6aeaf8979ca730d26cd4"
Jul 06 19:37:23.165109 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:37:23.165090    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c29df647f029e787daf5b0d40dbd6d3cafaaa00e2fcf6aeaf8979ca730d26cd4\": container with ID starting with c29df647f029e787daf5b0d40dbd6d3cafaaa00e2fcf6aeaf8979ca730d26cd4 not found: ID does not exist" containerID="c29df647f029e787daf5b0d40dbd6d3cafaaa00e2fcf6aeaf8979ca730d26cd4"
Jul 06 19:37:23.165169 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:23.165117    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c29df647f029e787daf5b0d40dbd6d3cafaaa00e2fcf6aeaf8979ca730d26cd4"} err="failed to get container status \"c29df647f029e787daf5b0d40dbd6d3cafaaa00e2fcf6aeaf8979ca730d26cd4\": rpc error: code = NotFound desc = could not find container \"c29df647f029e787daf5b0d40dbd6d3cafaaa00e2fcf6aeaf8979ca730d26cd4\": container with ID starting with c29df647f029e787daf5b0d40dbd6d3cafaaa00e2fcf6aeaf8979ca730d26cd4 not found: ID does not exist"
Jul 06 19:37:23.172000 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:23.171978    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"]
Jul 06 19:37:23.177776 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:23.177748    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-90ac12-5cb564fdd6-t2gdj"]
Jul 06 19:37:24.850519 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:37:24.850485    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9011b815-4db5-437e-ad26-8cb0ecd989f0" path="/var/lib/kubelet/pods/9011b815-4db5-437e-ad26-8cb0ecd989f0/volumes"
Jul 06 19:38:04.748103 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:04.748068    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"]
Jul 06 19:38:04.748672 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:04.748262    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv" podUID="2bba3bb0-c577-4265-bcd9-6d757b2c7602" containerName="istio-proxy" containerID="cri-o://2b3d464bdb8f4c979fb2a03c2bcf4f80b446a0e0ee501475d25db728b8baf37e" gracePeriod=30
Jul 06 19:38:10.005024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.004994    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:38:10.127685 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.127598    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-credential-socket\") pod \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") "
Jul 06 19:38:10.127685 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.127662    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-data\") pod \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") "
Jul 06 19:38:10.127958 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.127690    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-workload-certs\") pod \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") "
Jul 06 19:38:10.127958 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.127735    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5md7x\" (UniqueName: \"kubernetes.io/projected/2bba3bb0-c577-4265-bcd9-6d757b2c7602-kube-api-access-5md7x\") pod \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") "
Jul 06 19:38:10.127958 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.127774    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-workload-socket\") pod \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") "
Jul 06 19:38:10.127958 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.127803    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istiod-ca-cert\") pod \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") "
Jul 06 19:38:10.127958 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.127835    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-podinfo\") pod \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") "
Jul 06 19:38:10.127958 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.127850    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-token\") pod \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") "
Jul 06 19:38:10.127958 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.127881    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-envoy\") pod \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\" (UID: \"2bba3bb0-c577-4265-bcd9-6d757b2c7602\") "
Jul 06 19:38:10.127958 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.127950    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2bba3bb0-c577-4265-bcd9-6d757b2c7602" (UID: "2bba3bb0-c577-4265-bcd9-6d757b2c7602"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:10.128398 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.128162    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2bba3bb0-c577-4265-bcd9-6d757b2c7602" (UID: "2bba3bb0-c577-4265-bcd9-6d757b2c7602"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:10.128398 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.128204    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-credential-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:10.128398 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.128315    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2bba3bb0-c577-4265-bcd9-6d757b2c7602" (UID: "2bba3bb0-c577-4265-bcd9-6d757b2c7602"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:10.128398 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.128248    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2bba3bb0-c577-4265-bcd9-6d757b2c7602" (UID: "2bba3bb0-c577-4265-bcd9-6d757b2c7602"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:38:10.128601 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.128558    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-data" (OuterVolumeSpecName: "istio-data") pod "2bba3bb0-c577-4265-bcd9-6d757b2c7602" (UID: "2bba3bb0-c577-4265-bcd9-6d757b2c7602"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:10.130078 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.130054    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2bba3bb0-c577-4265-bcd9-6d757b2c7602" (UID: "2bba3bb0-c577-4265-bcd9-6d757b2c7602"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:38:10.130189 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.130119    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-token" (OuterVolumeSpecName: "istio-token") pod "2bba3bb0-c577-4265-bcd9-6d757b2c7602" (UID: "2bba3bb0-c577-4265-bcd9-6d757b2c7602"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:38:10.130366 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.130348    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bba3bb0-c577-4265-bcd9-6d757b2c7602-kube-api-access-5md7x" (OuterVolumeSpecName: "kube-api-access-5md7x") pod "2bba3bb0-c577-4265-bcd9-6d757b2c7602" (UID: "2bba3bb0-c577-4265-bcd9-6d757b2c7602"). InnerVolumeSpecName "kube-api-access-5md7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:38:10.130427 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.130360    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2bba3bb0-c577-4265-bcd9-6d757b2c7602" (UID: "2bba3bb0-c577-4265-bcd9-6d757b2c7602"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:10.229373 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.229318    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-workload-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:10.229373 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.229364    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istiod-ca-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:10.229373 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.229376    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-podinfo\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:10.229373 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.229384    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-token\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:10.229373 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.229392    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-envoy\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:10.229695 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.229400    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-istio-data\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:10.229695 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.229408    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bba3bb0-c577-4265-bcd9-6d757b2c7602-workload-certs\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:10.229695 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.229415    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5md7x\" (UniqueName: \"kubernetes.io/projected/2bba3bb0-c577-4265-bcd9-6d757b2c7602-kube-api-access-5md7x\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:10.392577 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.392490    2580 generic.go:356] "Generic (PLEG): container finished" podID="2bba3bb0-c577-4265-bcd9-6d757b2c7602" containerID="2b3d464bdb8f4c979fb2a03c2bcf4f80b446a0e0ee501475d25db728b8baf37e" exitCode=0
Jul 06 19:38:10.392577 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.392551    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"
Jul 06 19:38:10.392866 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.392581    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv" event={"ID":"2bba3bb0-c577-4265-bcd9-6d757b2c7602","Type":"ContainerDied","Data":"2b3d464bdb8f4c979fb2a03c2bcf4f80b446a0e0ee501475d25db728b8baf37e"}
Jul 06 19:38:10.392866 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.392674    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv" event={"ID":"2bba3bb0-c577-4265-bcd9-6d757b2c7602","Type":"ContainerDied","Data":"c86de68653568443dadfc97306529144eeaee073061402897302a96d71a63cb7"}
Jul 06 19:38:10.392866 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.392732    2580 scope.go:117] "RemoveContainer" containerID="2b3d464bdb8f4c979fb2a03c2bcf4f80b446a0e0ee501475d25db728b8baf37e"
Jul 06 19:38:10.402064 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.402047    2580 scope.go:117] "RemoveContainer" containerID="61d07d023e789502837406982fa2a573a0e9faa1a1c91b684f5362b4dea48878"
Jul 06 19:38:10.409962 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.409943    2580 scope.go:117] "RemoveContainer" containerID="2b3d464bdb8f4c979fb2a03c2bcf4f80b446a0e0ee501475d25db728b8baf37e"
Jul 06 19:38:10.410196 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:38:10.410180    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b3d464bdb8f4c979fb2a03c2bcf4f80b446a0e0ee501475d25db728b8baf37e\": container with ID starting with 2b3d464bdb8f4c979fb2a03c2bcf4f80b446a0e0ee501475d25db728b8baf37e not found: ID does not exist" containerID="2b3d464bdb8f4c979fb2a03c2bcf4f80b446a0e0ee501475d25db728b8baf37e"
Jul 06 19:38:10.410256 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.410203    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b3d464bdb8f4c979fb2a03c2bcf4f80b446a0e0ee501475d25db728b8baf37e"} err="failed to get container status \"2b3d464bdb8f4c979fb2a03c2bcf4f80b446a0e0ee501475d25db728b8baf37e\": rpc error: code = NotFound desc = could not find container \"2b3d464bdb8f4c979fb2a03c2bcf4f80b446a0e0ee501475d25db728b8baf37e\": container with ID starting with 2b3d464bdb8f4c979fb2a03c2bcf4f80b446a0e0ee501475d25db728b8baf37e not found: ID does not exist"
Jul 06 19:38:10.410256 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.410219    2580 scope.go:117] "RemoveContainer" containerID="61d07d023e789502837406982fa2a573a0e9faa1a1c91b684f5362b4dea48878"
Jul 06 19:38:10.410447 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:38:10.410425    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d07d023e789502837406982fa2a573a0e9faa1a1c91b684f5362b4dea48878\": container with ID starting with 61d07d023e789502837406982fa2a573a0e9faa1a1c91b684f5362b4dea48878 not found: ID does not exist" containerID="61d07d023e789502837406982fa2a573a0e9faa1a1c91b684f5362b4dea48878"
Jul 06 19:38:10.410498 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.410458    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d07d023e789502837406982fa2a573a0e9faa1a1c91b684f5362b4dea48878"} err="failed to get container status \"61d07d023e789502837406982fa2a573a0e9faa1a1c91b684f5362b4dea48878\": rpc error: code = NotFound desc = could not find container \"61d07d023e789502837406982fa2a573a0e9faa1a1c91b684f5362b4dea48878\": container with ID starting with 61d07d023e789502837406982fa2a573a0e9faa1a1c91b684f5362b4dea48878 not found: ID does not exist"
Jul 06 19:38:10.417139 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.417118    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"]
Jul 06 19:38:10.420509 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.420490    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-90ac12-openshift-default-b4bb88d45-qcnbv"]
Jul 06 19:38:10.850961 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:10.850933    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bba3bb0-c577-4265-bcd9-6d757b2c7602" path="/var/lib/kubelet/pods/2bba3bb0-c577-4265-bcd9-6d757b2c7602/volumes"
Jul 06 19:38:12.082386 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:12.082352    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"]
Jul 06 19:38:12.082848 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:12.082578    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb" podUID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerName="istio-proxy" containerID="cri-o://88a11b022f3cfc53401bf5ee5e229f3119c52cf1588040ea8cfd4cbc2161fdfd" gracePeriod=30
Jul 06 19:38:13.274233 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:13.274191    2580 patch_prober.go:28] interesting pod/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:38:13.274690 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:13.274270    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb" podUID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:38:17.343643 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.343580    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:38:17.392854 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.392825    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-workload-socket\") pod \"de421687-ed2e-4d80-9282-3cd131b6ef4d\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") "
Jul 06 19:38:17.393034 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.392877    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de421687-ed2e-4d80-9282-3cd131b6ef4d-istiod-ca-cert\") pod \"de421687-ed2e-4d80-9282-3cd131b6ef4d\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") "
Jul 06 19:38:17.393034 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.392912    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-data\") pod \"de421687-ed2e-4d80-9282-3cd131b6ef4d\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") "
Jul 06 19:38:17.393034 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.392933    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59cqf\" (UniqueName: \"kubernetes.io/projected/de421687-ed2e-4d80-9282-3cd131b6ef4d-kube-api-access-59cqf\") pod \"de421687-ed2e-4d80-9282-3cd131b6ef4d\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") "
Jul 06 19:38:17.393034 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.392958    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-envoy\") pod \"de421687-ed2e-4d80-9282-3cd131b6ef4d\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") "
Jul 06 19:38:17.393034 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.393008    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-credential-socket\") pod \"de421687-ed2e-4d80-9282-3cd131b6ef4d\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") "
Jul 06 19:38:17.393350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.393139    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de421687-ed2e-4d80-9282-3cd131b6ef4d" (UID: "de421687-ed2e-4d80-9282-3cd131b6ef4d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:17.393350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.393232    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-workload-certs\") pod \"de421687-ed2e-4d80-9282-3cd131b6ef4d\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") "
Jul 06 19:38:17.393350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.393278    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-token\") pod \"de421687-ed2e-4d80-9282-3cd131b6ef4d\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") "
Jul 06 19:38:17.393350 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.393302    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-podinfo\") pod \"de421687-ed2e-4d80-9282-3cd131b6ef4d\" (UID: \"de421687-ed2e-4d80-9282-3cd131b6ef4d\") "
Jul 06 19:38:17.393572 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.393381    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de421687-ed2e-4d80-9282-3cd131b6ef4d" (UID: "de421687-ed2e-4d80-9282-3cd131b6ef4d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:17.393572 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.393522    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de421687-ed2e-4d80-9282-3cd131b6ef4d" (UID: "de421687-ed2e-4d80-9282-3cd131b6ef4d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:17.393572 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.393535    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de421687-ed2e-4d80-9282-3cd131b6ef4d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de421687-ed2e-4d80-9282-3cd131b6ef4d" (UID: "de421687-ed2e-4d80-9282-3cd131b6ef4d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:38:17.393766 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.393728    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-workload-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:17.393766 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.393750    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de421687-ed2e-4d80-9282-3cd131b6ef4d-istiod-ca-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:17.393895 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.393765    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-credential-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:17.393895 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.393779    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-workload-certs\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:17.394008 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.393925    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-data" (OuterVolumeSpecName: "istio-data") pod "de421687-ed2e-4d80-9282-3cd131b6ef4d" (UID: "de421687-ed2e-4d80-9282-3cd131b6ef4d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:17.395438 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.395362    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de421687-ed2e-4d80-9282-3cd131b6ef4d" (UID: "de421687-ed2e-4d80-9282-3cd131b6ef4d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:38:17.395564 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.395484    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-token" (OuterVolumeSpecName: "istio-token") pod "de421687-ed2e-4d80-9282-3cd131b6ef4d" (UID: "de421687-ed2e-4d80-9282-3cd131b6ef4d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:38:17.395701 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.395681    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de421687-ed2e-4d80-9282-3cd131b6ef4d-kube-api-access-59cqf" (OuterVolumeSpecName: "kube-api-access-59cqf") pod "de421687-ed2e-4d80-9282-3cd131b6ef4d" (UID: "de421687-ed2e-4d80-9282-3cd131b6ef4d"). InnerVolumeSpecName "kube-api-access-59cqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:38:17.395701 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.395684    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de421687-ed2e-4d80-9282-3cd131b6ef4d" (UID: "de421687-ed2e-4d80-9282-3cd131b6ef4d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:17.428825 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.428791    2580 generic.go:356] "Generic (PLEG): container finished" podID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerID="88a11b022f3cfc53401bf5ee5e229f3119c52cf1588040ea8cfd4cbc2161fdfd" exitCode=0
Jul 06 19:38:17.428993 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.428859    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"
Jul 06 19:38:17.428993 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.428875    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb" event={"ID":"de421687-ed2e-4d80-9282-3cd131b6ef4d","Type":"ContainerDied","Data":"88a11b022f3cfc53401bf5ee5e229f3119c52cf1588040ea8cfd4cbc2161fdfd"}
Jul 06 19:38:17.428993 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.428955    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb" event={"ID":"de421687-ed2e-4d80-9282-3cd131b6ef4d","Type":"ContainerDied","Data":"56b295b5e35cfb00aee83b51a7459ee57275578b1d27ecb3eb3f247100ba7336"}
Jul 06 19:38:17.428993 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.428979    2580 scope.go:117] "RemoveContainer" containerID="88a11b022f3cfc53401bf5ee5e229f3119c52cf1588040ea8cfd4cbc2161fdfd"
Jul 06 19:38:17.438267 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.438251    2580 scope.go:117] "RemoveContainer" containerID="3866e803dbe8792e7492be4c02c2e3af2f6dd754c084a60564b5100ff28a9634"
Jul 06 19:38:17.446093 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.446071    2580 scope.go:117] "RemoveContainer" containerID="88a11b022f3cfc53401bf5ee5e229f3119c52cf1588040ea8cfd4cbc2161fdfd"
Jul 06 19:38:17.446368 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:38:17.446347    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88a11b022f3cfc53401bf5ee5e229f3119c52cf1588040ea8cfd4cbc2161fdfd\": container with ID starting with 88a11b022f3cfc53401bf5ee5e229f3119c52cf1588040ea8cfd4cbc2161fdfd not found: ID does not exist" containerID="88a11b022f3cfc53401bf5ee5e229f3119c52cf1588040ea8cfd4cbc2161fdfd"
Jul 06 19:38:17.446434 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.446376    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88a11b022f3cfc53401bf5ee5e229f3119c52cf1588040ea8cfd4cbc2161fdfd"} err="failed to get container status \"88a11b022f3cfc53401bf5ee5e229f3119c52cf1588040ea8cfd4cbc2161fdfd\": rpc error: code = NotFound desc = could not find container \"88a11b022f3cfc53401bf5ee5e229f3119c52cf1588040ea8cfd4cbc2161fdfd\": container with ID starting with 88a11b022f3cfc53401bf5ee5e229f3119c52cf1588040ea8cfd4cbc2161fdfd not found: ID does not exist"
Jul 06 19:38:17.446434 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.446394    2580 scope.go:117] "RemoveContainer" containerID="3866e803dbe8792e7492be4c02c2e3af2f6dd754c084a60564b5100ff28a9634"
Jul 06 19:38:17.446616 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:38:17.446601    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3866e803dbe8792e7492be4c02c2e3af2f6dd754c084a60564b5100ff28a9634\": container with ID starting with 3866e803dbe8792e7492be4c02c2e3af2f6dd754c084a60564b5100ff28a9634 not found: ID does not exist" containerID="3866e803dbe8792e7492be4c02c2e3af2f6dd754c084a60564b5100ff28a9634"
Jul 06 19:38:17.446657 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.446619    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3866e803dbe8792e7492be4c02c2e3af2f6dd754c084a60564b5100ff28a9634"} err="failed to get container status \"3866e803dbe8792e7492be4c02c2e3af2f6dd754c084a60564b5100ff28a9634\": rpc error: code = NotFound desc = could not find container \"3866e803dbe8792e7492be4c02c2e3af2f6dd754c084a60564b5100ff28a9634\": container with ID starting with 3866e803dbe8792e7492be4c02c2e3af2f6dd754c084a60564b5100ff28a9634 not found: ID does not exist"
Jul 06 19:38:17.452974 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.452949    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"]
Jul 06 19:38:17.457312 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.457289    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-67fa37-openshift-default-577b46f89f-nf9kb"]
Jul 06 19:38:17.494422 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.494385    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-envoy\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:17.494422 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.494414    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-token\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:17.494422 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.494427    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-podinfo\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:17.494628 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.494438    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de421687-ed2e-4d80-9282-3cd131b6ef4d-istio-data\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:17.494628 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:17.494452    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59cqf\" (UniqueName: \"kubernetes.io/projected/de421687-ed2e-4d80-9282-3cd131b6ef4d-kube-api-access-59cqf\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:18.851662 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:18.851623    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de421687-ed2e-4d80-9282-3cd131b6ef4d" path="/var/lib/kubelet/pods/de421687-ed2e-4d80-9282-3cd131b6ef4d/volumes"
Jul 06 19:38:21.143301 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.143265    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"]
Jul 06 19:38:21.143834 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.143823    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bba3bb0-c577-4265-bcd9-6d757b2c7602" containerName="istio-proxy"
Jul 06 19:38:21.143912 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.143840    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bba3bb0-c577-4265-bcd9-6d757b2c7602" containerName="istio-proxy"
Jul 06 19:38:21.143912 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.143873    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9011b815-4db5-437e-ad26-8cb0ecd989f0" containerName="maas-api"
Jul 06 19:38:21.143912 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.143882    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9011b815-4db5-437e-ad26-8cb0ecd989f0" containerName="maas-api"
Jul 06 19:38:21.143912 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.143898    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bba3bb0-c577-4265-bcd9-6d757b2c7602" containerName="istio-proxy"
Jul 06 19:38:21.143912 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.143907    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bba3bb0-c577-4265-bcd9-6d757b2c7602" containerName="istio-proxy"
Jul 06 19:38:21.144077 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.143918    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerName="istio-proxy"
Jul 06 19:38:21.144077 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.143926    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerName="istio-proxy"
Jul 06 19:38:21.144077 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.143946    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerName="istio-proxy"
Jul 06 19:38:21.144077 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.143955    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerName="istio-proxy"
Jul 06 19:38:21.144077 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.144032    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerName="istio-proxy"
Jul 06 19:38:21.144077 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.144041    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bba3bb0-c577-4265-bcd9-6d757b2c7602" containerName="istio-proxy"
Jul 06 19:38:21.144077 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.144052    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bba3bb0-c577-4265-bcd9-6d757b2c7602" containerName="istio-proxy"
Jul 06 19:38:21.144077 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.144065    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9011b815-4db5-437e-ad26-8cb0ecd989f0" containerName="maas-api"
Jul 06 19:38:21.149176 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.149153    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.151367 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.151347    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5ba231-openshift-default-dockercfg-2srsx\""
Jul 06 19:38:21.157587 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.157565    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"]
Jul 06 19:38:21.231989 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.231953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-token\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.232194 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.231996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istiod-ca-cert\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.232194 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.232032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-workload-certs\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.232194 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.232072    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-credential-socket\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.232194 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.232107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-workload-socket\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.232194 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.232125    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckw9n\" (UniqueName: \"kubernetes.io/projected/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-kube-api-access-ckw9n\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.232194 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.232180    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-envoy\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.232525 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.232199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-data\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.232525 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.232234    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-podinfo\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.333409 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.333376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-token\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.333580 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.333413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istiod-ca-cert\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.333580 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.333441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-workload-certs\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.333580 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.333555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-credential-socket\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.333746 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.333617    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-workload-socket\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.333746 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.333648    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckw9n\" (UniqueName: \"kubernetes.io/projected/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-kube-api-access-ckw9n\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.333746 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.333696    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-envoy\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.333907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.333798    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-workload-certs\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.333907 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.333853    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-data\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.334015 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.333905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-podinfo\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.334015 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.333917    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-credential-socket\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.334015 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.333984    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-workload-socket\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.334127 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.334106    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-data\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.334175 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.334157    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istiod-ca-cert\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.335887 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.335862    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-envoy\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.336138 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.336121    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-podinfo\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.341264 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.341239    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckw9n\" (UniqueName: \"kubernetes.io/projected/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-kube-api-access-ckw9n\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.341605 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.341588    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-token\") pod \"e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") " pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.461391 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.461356    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:21.602863 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.602833    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"]
Jul 06 19:38:21.605551 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:38:21.605523    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6cd5a0_7f31_4595_a2a2_6ddbcc699ed0.slice/crio-16eb8336caa62262b0ab65183b06d989d2d043a8e9c2f923f40019036052ae2c WatchSource:0}: Error finding container 16eb8336caa62262b0ab65183b06d989d2d043a8e9c2f923f40019036052ae2c: Status 404 returned error can't find the container with id 16eb8336caa62262b0ab65183b06d989d2d043a8e9c2f923f40019036052ae2c
Jul 06 19:38:21.607787 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.607750    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:38:21.607871 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.607844    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:38:21.607913 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:21.607889    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:38:22.454414 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:22.454376    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk" event={"ID":"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0","Type":"ContainerStarted","Data":"01d0685802c878088d4d86c61e2a98ffc9f8b50a71fc4e128fcb6f0c0766ecbc"}
Jul 06 19:38:22.454828 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:22.454437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk" event={"ID":"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0","Type":"ContainerStarted","Data":"16eb8336caa62262b0ab65183b06d989d2d043a8e9c2f923f40019036052ae2c"}
Jul 06 19:38:22.462381 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:22.462358    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:22.467485 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:22.467456    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:22.474403 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:22.474350    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk" podStartSLOduration=1.4743333060000001 podStartE2EDuration="1.474333306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:22.473577654 +0000 UTC m=+1976.083705019" watchObservedRunningTime="2026-07-06 19:38:22.474333306 +0000 UTC m=+1976.084460652"
Jul 06 19:38:23.460121 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:23.460082    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:23.461130 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:23.461107    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:24.587956 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:24.587924    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"]
Jul 06 19:38:24.588593 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:24.588573    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="de421687-ed2e-4d80-9282-3cd131b6ef4d" containerName="istio-proxy"
Jul 06 19:38:24.591858 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:24.591836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:24.594111 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:24.594090    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-5ba231-serving-cert\""
Jul 06 19:38:24.600688 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:24.600663    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"]
Jul 06 19:38:24.665429 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:24.665389    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/198eb980-adcf-458d-a073-e52682503662-maas-api-tls\") pod \"maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v\" (UID: \"198eb980-adcf-458d-a073-e52682503662\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:24.665609 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:24.665440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtv4g\" (UniqueName: \"kubernetes.io/projected/198eb980-adcf-458d-a073-e52682503662-kube-api-access-dtv4g\") pod \"maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v\" (UID: \"198eb980-adcf-458d-a073-e52682503662\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:24.665609 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:24.665542    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/198eb980-adcf-458d-a073-e52682503662-openshift-service-ca\") pod \"maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v\" (UID: \"198eb980-adcf-458d-a073-e52682503662\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:24.766567 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:24.766526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/198eb980-adcf-458d-a073-e52682503662-maas-api-tls\") pod \"maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v\" (UID: \"198eb980-adcf-458d-a073-e52682503662\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:24.766567 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:24.766568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtv4g\" (UniqueName: \"kubernetes.io/projected/198eb980-adcf-458d-a073-e52682503662-kube-api-access-dtv4g\") pod \"maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v\" (UID: \"198eb980-adcf-458d-a073-e52682503662\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:24.766815 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:24.766607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/198eb980-adcf-458d-a073-e52682503662-openshift-service-ca\") pod \"maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v\" (UID: \"198eb980-adcf-458d-a073-e52682503662\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:24.766815 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:38:24.766680    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-serving-cert: secret "maas-api-e2e-api-b-5ba231-serving-cert" not found
Jul 06 19:38:24.766815 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:38:24.766769    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198eb980-adcf-458d-a073-e52682503662-maas-api-tls podName:198eb980-adcf-458d-a073-e52682503662 nodeName:}" failed. No retries permitted until 2026-07-06 19:38:25.26675369 +0000 UTC m=+1978.876881012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/198eb980-adcf-458d-a073-e52682503662-maas-api-tls") pod "maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v" (UID: "198eb980-adcf-458d-a073-e52682503662") : secret "maas-api-e2e-api-b-5ba231-serving-cert" not found
Jul 06 19:38:24.767196 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:24.767178    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/198eb980-adcf-458d-a073-e52682503662-openshift-service-ca\") pod \"maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v\" (UID: \"198eb980-adcf-458d-a073-e52682503662\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:24.779272 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:24.779249    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtv4g\" (UniqueName: \"kubernetes.io/projected/198eb980-adcf-458d-a073-e52682503662-kube-api-access-dtv4g\") pod \"maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v\" (UID: \"198eb980-adcf-458d-a073-e52682503662\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:25.273145 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:25.273112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/198eb980-adcf-458d-a073-e52682503662-maas-api-tls\") pod \"maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v\" (UID: \"198eb980-adcf-458d-a073-e52682503662\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:25.275562 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:25.275539    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/198eb980-adcf-458d-a073-e52682503662-maas-api-tls\") pod \"maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v\" (UID: \"198eb980-adcf-458d-a073-e52682503662\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:25.504375 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:25.504338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:25.641956 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:25.641929    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"]
Jul 06 19:38:25.644187 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:38:25.644160    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198eb980_adcf_458d_a073_e52682503662.slice/crio-7cb2bcae13fe8c3bc56e857be6743d7db04d6c60ab2c92fea34fbc4e272c31e9 WatchSource:0}: Error finding container 7cb2bcae13fe8c3bc56e857be6743d7db04d6c60ab2c92fea34fbc4e272c31e9: Status 404 returned error can't find the container with id 7cb2bcae13fe8c3bc56e857be6743d7db04d6c60ab2c92fea34fbc4e272c31e9
Jul 06 19:38:26.475850 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:26.475807    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v" event={"ID":"198eb980-adcf-458d-a073-e52682503662","Type":"ContainerStarted","Data":"a97fcdf78bb001ee771bfa88203ecadd44dc95a853afb33664cf8f15f75321a5"}
Jul 06 19:38:26.476045 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:26.475877    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:26.476045 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:26.475898    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v" event={"ID":"198eb980-adcf-458d-a073-e52682503662","Type":"ContainerStarted","Data":"7cb2bcae13fe8c3bc56e857be6743d7db04d6c60ab2c92fea34fbc4e272c31e9"}
Jul 06 19:38:26.497425 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:26.497376    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v" podStartSLOduration=2.149348173 podStartE2EDuration="2.497361111s" totalImagesPullingTime="348.012938ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:26.495371938 +0000 UTC m=+1980.105499296" watchObservedRunningTime="2026-07-06 19:38:26.497361111 +0000 UTC m=+1980.107488454"
Jul 06 19:38:32.487541 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:32.487514    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:37.535482 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:37.535445    2580 generic.go:356] "Generic (PLEG): container finished" podID="cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" containerID="01d0685802c878088d4d86c61e2a98ffc9f8b50a71fc4e128fcb6f0c0766ecbc" exitCode=0
Jul 06 19:38:37.535915 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:37.535518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk" event={"ID":"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0","Type":"ContainerDied","Data":"01d0685802c878088d4d86c61e2a98ffc9f8b50a71fc4e128fcb6f0c0766ecbc"}
Jul 06 19:38:37.535960 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:37.535945    2580 scope.go:117] "RemoveContainer" containerID="01d0685802c878088d4d86c61e2a98ffc9f8b50a71fc4e128fcb6f0c0766ecbc"
Jul 06 19:38:37.536971 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:37.536944    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:38:37.537037 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:37.537019    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:38:37.537077 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:37.537055    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:38:38.460521 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:38.460483    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:38.543571 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:38.543538    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk" event={"ID":"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0","Type":"ContainerStarted","Data":"b711a45efece96f26c309eb77fd74d8a33acc722600bafd7e1bf15e10cdf7ece"}
Jul 06 19:38:39.462229 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:39.462188    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:39.463434 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:39.463405    2580 patch_prober.go:28] interesting pod/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 06 19:38:39.463556 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:39.463476    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk" podUID="cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 06 19:38:40.462692 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:40.462650    2580 patch_prober.go:28] interesting pod/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 06 19:38:40.463124 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:40.462736    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk" podUID="cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 06 19:38:41.462177 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:41.462139    2580 patch_prober.go:28] interesting pod/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 06 19:38:41.462373 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:41.462206    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk" podUID="cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 06 19:38:42.462548 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:42.462510    2580 patch_prober.go:28] interesting pod/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 06 19:38:42.463057 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:42.462582    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk" podUID="cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 06 19:38:43.466290 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:43.466259    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:43.466700 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:43.466633    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:43.467240 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:43.467224    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:44.834963 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:44.834918    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"]
Jul 06 19:38:44.835456 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:44.835169    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v" podUID="198eb980-adcf-458d-a073-e52682503662" containerName="maas-api" containerID="cri-o://a97fcdf78bb001ee771bfa88203ecadd44dc95a853afb33664cf8f15f75321a5" gracePeriod=30
Jul 06 19:38:45.087286 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.087224    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:45.185285 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.185225    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtv4g\" (UniqueName: \"kubernetes.io/projected/198eb980-adcf-458d-a073-e52682503662-kube-api-access-dtv4g\") pod \"198eb980-adcf-458d-a073-e52682503662\" (UID: \"198eb980-adcf-458d-a073-e52682503662\") "
Jul 06 19:38:45.185482 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.185309    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/198eb980-adcf-458d-a073-e52682503662-openshift-service-ca\") pod \"198eb980-adcf-458d-a073-e52682503662\" (UID: \"198eb980-adcf-458d-a073-e52682503662\") "
Jul 06 19:38:45.185482 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.185355    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/198eb980-adcf-458d-a073-e52682503662-maas-api-tls\") pod \"198eb980-adcf-458d-a073-e52682503662\" (UID: \"198eb980-adcf-458d-a073-e52682503662\") "
Jul 06 19:38:45.185680 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.185655    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/198eb980-adcf-458d-a073-e52682503662-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "198eb980-adcf-458d-a073-e52682503662" (UID: "198eb980-adcf-458d-a073-e52682503662"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:38:45.187423 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.187402    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/198eb980-adcf-458d-a073-e52682503662-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "198eb980-adcf-458d-a073-e52682503662" (UID: "198eb980-adcf-458d-a073-e52682503662"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:38:45.187497 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.187417    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/198eb980-adcf-458d-a073-e52682503662-kube-api-access-dtv4g" (OuterVolumeSpecName: "kube-api-access-dtv4g") pod "198eb980-adcf-458d-a073-e52682503662" (UID: "198eb980-adcf-458d-a073-e52682503662"). InnerVolumeSpecName "kube-api-access-dtv4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:38:45.286734 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.286665    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/198eb980-adcf-458d-a073-e52682503662-maas-api-tls\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:45.286734 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.286699    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtv4g\" (UniqueName: \"kubernetes.io/projected/198eb980-adcf-458d-a073-e52682503662-kube-api-access-dtv4g\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:45.286734 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.286734    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/198eb980-adcf-458d-a073-e52682503662-openshift-service-ca\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:45.582344 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.582312    2580 generic.go:356] "Generic (PLEG): container finished" podID="198eb980-adcf-458d-a073-e52682503662" containerID="a97fcdf78bb001ee771bfa88203ecadd44dc95a853afb33664cf8f15f75321a5" exitCode=0
Jul 06 19:38:45.582560 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.582368    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"
Jul 06 19:38:45.582560 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.582397    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v" event={"ID":"198eb980-adcf-458d-a073-e52682503662","Type":"ContainerDied","Data":"a97fcdf78bb001ee771bfa88203ecadd44dc95a853afb33664cf8f15f75321a5"}
Jul 06 19:38:45.582560 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.582452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v" event={"ID":"198eb980-adcf-458d-a073-e52682503662","Type":"ContainerDied","Data":"7cb2bcae13fe8c3bc56e857be6743d7db04d6c60ab2c92fea34fbc4e272c31e9"}
Jul 06 19:38:45.582560 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.582474    2580 scope.go:117] "RemoveContainer" containerID="a97fcdf78bb001ee771bfa88203ecadd44dc95a853afb33664cf8f15f75321a5"
Jul 06 19:38:45.591665 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.591647    2580 scope.go:117] "RemoveContainer" containerID="a97fcdf78bb001ee771bfa88203ecadd44dc95a853afb33664cf8f15f75321a5"
Jul 06 19:38:45.591973 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:38:45.591954    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a97fcdf78bb001ee771bfa88203ecadd44dc95a853afb33664cf8f15f75321a5\": container with ID starting with a97fcdf78bb001ee771bfa88203ecadd44dc95a853afb33664cf8f15f75321a5 not found: ID does not exist" containerID="a97fcdf78bb001ee771bfa88203ecadd44dc95a853afb33664cf8f15f75321a5"
Jul 06 19:38:45.592035 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.591985    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a97fcdf78bb001ee771bfa88203ecadd44dc95a853afb33664cf8f15f75321a5"} err="failed to get container status \"a97fcdf78bb001ee771bfa88203ecadd44dc95a853afb33664cf8f15f75321a5\": rpc error: code = NotFound desc = could not find container \"a97fcdf78bb001ee771bfa88203ecadd44dc95a853afb33664cf8f15f75321a5\": container with ID starting with a97fcdf78bb001ee771bfa88203ecadd44dc95a853afb33664cf8f15f75321a5 not found: ID does not exist"
Jul 06 19:38:45.603374 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.603349    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"]
Jul 06 19:38:45.607251 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:45.607229    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5ba231-8569c5b54b-plp9v"]
Jul 06 19:38:46.852438 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:46.852403    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="198eb980-adcf-458d-a073-e52682503662" path="/var/lib/kubelet/pods/198eb980-adcf-458d-a073-e52682503662/volumes"
Jul 06 19:38:50.602839 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:50.602803    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"]
Jul 06 19:38:50.603273 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:50.603078    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk" podUID="cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" containerName="istio-proxy" containerID="cri-o://b711a45efece96f26c309eb77fd74d8a33acc722600bafd7e1bf15e10cdf7ece" gracePeriod=30
Jul 06 19:38:51.433627 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.433591    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"]
Jul 06 19:38:51.434020 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.434007    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="198eb980-adcf-458d-a073-e52682503662" containerName="maas-api"
Jul 06 19:38:51.434067 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.434022    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="198eb980-adcf-458d-a073-e52682503662" containerName="maas-api"
Jul 06 19:38:51.434157 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.434124    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="198eb980-adcf-458d-a073-e52682503662" containerName="maas-api"
Jul 06 19:38:51.437142 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.437123    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.439497 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.439475    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-f969f4-openshift-default-dockercfg-6p86r\""
Jul 06 19:38:51.448872 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.448848    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"]
Jul 06 19:38:51.544610 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.544564    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-workload-socket\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.544852 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.544635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-workload-certs\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.544852 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.544660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-credential-socket\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.544852 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.544684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfhsc\" (UniqueName: \"kubernetes.io/projected/442077db-ee68-4619-b8b7-28fb2d2e2a09-kube-api-access-rfhsc\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.544852 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.544752    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-envoy\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.544852 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.544828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-token\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.544852 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.544849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-podinfo\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.545095 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.544904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-data\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.545095 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.544948    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/442077db-ee68-4619-b8b7-28fb2d2e2a09-istiod-ca-cert\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.646486 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.646452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-workload-socket\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.646486 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.646496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-workload-certs\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.647035 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.646519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-credential-socket\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.647035 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.646536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfhsc\" (UniqueName: \"kubernetes.io/projected/442077db-ee68-4619-b8b7-28fb2d2e2a09-kube-api-access-rfhsc\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.647035 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.646559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-envoy\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.647035 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.646604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-token\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.647035 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.646619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-podinfo\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.647035 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.646639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-data\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.647035 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.646673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/442077db-ee68-4619-b8b7-28fb2d2e2a09-istiod-ca-cert\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.647035 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.647021    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-credential-socket\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.647409 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.647224    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-workload-certs\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.647409 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.647287    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-data\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.647409 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.647328    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-workload-socket\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.647512 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.647443    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/442077db-ee68-4619-b8b7-28fb2d2e2a09-istiod-ca-cert\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.649120 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.649088    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-envoy\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.649312 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.649293    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-podinfo\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.654054 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.654032    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-token\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.654590 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.654572    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfhsc\" (UniqueName: \"kubernetes.io/projected/442077db-ee68-4619-b8b7-28fb2d2e2a09-kube-api-access-rfhsc\") pod \"e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") " pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.749460 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.749366    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:51.891276 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.891241    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"]
Jul 06 19:38:51.894417 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:38:51.894383    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442077db_ee68_4619_b8b7_28fb2d2e2a09.slice/crio-45ff7ee3e9587a42c225b0ac78bbae4c02ac9f4e56031ce21b066f27d452bdd5 WatchSource:0}: Error finding container 45ff7ee3e9587a42c225b0ac78bbae4c02ac9f4e56031ce21b066f27d452bdd5: Status 404 returned error can't find the container with id 45ff7ee3e9587a42c225b0ac78bbae4c02ac9f4e56031ce21b066f27d452bdd5
Jul 06 19:38:51.896686 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.896653    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:38:51.896789 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.896770    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:38:51.896835 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:51.896820    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:38:52.618839 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:52.618798    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw" event={"ID":"442077db-ee68-4619-b8b7-28fb2d2e2a09","Type":"ContainerStarted","Data":"1d097a145c06e5678f244df2920b61cf8b867dda82c24be260c756b6505a1b56"}
Jul 06 19:38:52.618998 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:52.618859    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw" event={"ID":"442077db-ee68-4619-b8b7-28fb2d2e2a09","Type":"ContainerStarted","Data":"45ff7ee3e9587a42c225b0ac78bbae4c02ac9f4e56031ce21b066f27d452bdd5"}
Jul 06 19:38:52.638722 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:52.638662    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw" podStartSLOduration=1.6386432389999999 podStartE2EDuration="1.638643239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:52.637614374 +0000 UTC m=+2006.247741719" watchObservedRunningTime="2026-07-06 19:38:52.638643239 +0000 UTC m=+2006.248770582"
Jul 06 19:38:52.750028 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:52.749993    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:52.756864 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:52.756837    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:53.623416 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:53.623383    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:53.624384 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:53.624363    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:38:55.858565 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.858534    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:55.884839 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.884773    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-data\") pod \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") "
Jul 06 19:38:55.884839 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.884808    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-workload-socket\") pod \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") "
Jul 06 19:38:55.885001 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.884847    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-podinfo\") pod \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") "
Jul 06 19:38:55.885001 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.884887    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-credential-socket\") pod \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") "
Jul 06 19:38:55.885001 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.884944    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckw9n\" (UniqueName: \"kubernetes.io/projected/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-kube-api-access-ckw9n\") pod \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") "
Jul 06 19:38:55.885001 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.884991    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-workload-certs\") pod \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") "
Jul 06 19:38:55.885173 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.885015    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-envoy\") pod \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") "
Jul 06 19:38:55.885173 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.885056    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-token\") pod \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") "
Jul 06 19:38:55.885173 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.885106    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istiod-ca-cert\") pod \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\" (UID: \"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0\") "
Jul 06 19:38:55.885317 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.885055    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" (UID: "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:55.885494 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.885467    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-workload-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:55.885601 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.885572    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" (UID: "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:55.885601 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.885580    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" (UID: "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:38:55.885862 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.885827    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-data" (OuterVolumeSpecName: "istio-data") pod "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" (UID: "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:55.885962 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.885867    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" (UID: "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:55.887291 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.887243    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" (UID: "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:38:55.887291 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.887254    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" (UID: "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:38:55.887291 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.887280    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-kube-api-access-ckw9n" (OuterVolumeSpecName: "kube-api-access-ckw9n") pod "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" (UID: "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0"). InnerVolumeSpecName "kube-api-access-ckw9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:38:55.887668 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.887566    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-token" (OuterVolumeSpecName: "istio-token") pod "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" (UID: "cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:38:55.986160 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.986128    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-credential-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:55.986160 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.986154    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckw9n\" (UniqueName: \"kubernetes.io/projected/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-kube-api-access-ckw9n\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:55.986160 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.986164    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-workload-certs\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:55.986352 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.986174    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-envoy\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:55.986352 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.986182    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-token\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:55.986352 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.986190    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istiod-ca-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:55.986352 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.986197    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-data\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:55.986352 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:55.986204    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0-istio-podinfo\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:38:56.642643 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:56.642601    2580 generic.go:356] "Generic (PLEG): container finished" podID="cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" containerID="b711a45efece96f26c309eb77fd74d8a33acc722600bafd7e1bf15e10cdf7ece" exitCode=0
Jul 06 19:38:56.642643 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:56.642640    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"
Jul 06 19:38:56.642885 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:56.642682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk" event={"ID":"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0","Type":"ContainerDied","Data":"b711a45efece96f26c309eb77fd74d8a33acc722600bafd7e1bf15e10cdf7ece"}
Jul 06 19:38:56.642885 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:56.642760    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk" event={"ID":"cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0","Type":"ContainerDied","Data":"16eb8336caa62262b0ab65183b06d989d2d043a8e9c2f923f40019036052ae2c"}
Jul 06 19:38:56.642885 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:56.642788    2580 scope.go:117] "RemoveContainer" containerID="b711a45efece96f26c309eb77fd74d8a33acc722600bafd7e1bf15e10cdf7ece"
Jul 06 19:38:56.654632 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:56.654614    2580 scope.go:117] "RemoveContainer" containerID="01d0685802c878088d4d86c61e2a98ffc9f8b50a71fc4e128fcb6f0c0766ecbc"
Jul 06 19:38:56.662719 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:56.662691    2580 scope.go:117] "RemoveContainer" containerID="b711a45efece96f26c309eb77fd74d8a33acc722600bafd7e1bf15e10cdf7ece"
Jul 06 19:38:56.662978 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:38:56.662961    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b711a45efece96f26c309eb77fd74d8a33acc722600bafd7e1bf15e10cdf7ece\": container with ID starting with b711a45efece96f26c309eb77fd74d8a33acc722600bafd7e1bf15e10cdf7ece not found: ID does not exist" containerID="b711a45efece96f26c309eb77fd74d8a33acc722600bafd7e1bf15e10cdf7ece"
Jul 06 19:38:56.663024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:56.662988    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b711a45efece96f26c309eb77fd74d8a33acc722600bafd7e1bf15e10cdf7ece"} err="failed to get container status \"b711a45efece96f26c309eb77fd74d8a33acc722600bafd7e1bf15e10cdf7ece\": rpc error: code = NotFound desc = could not find container \"b711a45efece96f26c309eb77fd74d8a33acc722600bafd7e1bf15e10cdf7ece\": container with ID starting with b711a45efece96f26c309eb77fd74d8a33acc722600bafd7e1bf15e10cdf7ece not found: ID does not exist"
Jul 06 19:38:56.663024 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:56.663004    2580 scope.go:117] "RemoveContainer" containerID="01d0685802c878088d4d86c61e2a98ffc9f8b50a71fc4e128fcb6f0c0766ecbc"
Jul 06 19:38:56.663236 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:38:56.663216    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01d0685802c878088d4d86c61e2a98ffc9f8b50a71fc4e128fcb6f0c0766ecbc\": container with ID starting with 01d0685802c878088d4d86c61e2a98ffc9f8b50a71fc4e128fcb6f0c0766ecbc not found: ID does not exist" containerID="01d0685802c878088d4d86c61e2a98ffc9f8b50a71fc4e128fcb6f0c0766ecbc"
Jul 06 19:38:56.663272 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:56.663241    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d0685802c878088d4d86c61e2a98ffc9f8b50a71fc4e128fcb6f0c0766ecbc"} err="failed to get container status \"01d0685802c878088d4d86c61e2a98ffc9f8b50a71fc4e128fcb6f0c0766ecbc\": rpc error: code = NotFound desc = could not find container \"01d0685802c878088d4d86c61e2a98ffc9f8b50a71fc4e128fcb6f0c0766ecbc\": container with ID starting with 01d0685802c878088d4d86c61e2a98ffc9f8b50a71fc4e128fcb6f0c0766ecbc not found: ID does not exist"
Jul 06 19:38:56.670696 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:56.670672    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"]
Jul 06 19:38:56.678105 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:56.678077    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5ba231-openshift-default-7df6d68897-wdngk"]
Jul 06 19:38:56.852382 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:56.852349    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" path="/var/lib/kubelet/pods/cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0/volumes"
Jul 06 19:38:59.643514 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.643479    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"]
Jul 06 19:38:59.644143 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.644121    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" containerName="istio-proxy"
Jul 06 19:38:59.644196 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.644148    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" containerName="istio-proxy"
Jul 06 19:38:59.644196 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.644179    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" containerName="istio-proxy"
Jul 06 19:38:59.644196 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.644187    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" containerName="istio-proxy"
Jul 06 19:38:59.644333 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.644281    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" containerName="istio-proxy"
Jul 06 19:38:59.649561 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.649537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.651804 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.651784    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-f31ab4-openshift-default-dockercfg-l98xk\""
Jul 06 19:38:59.668006 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.667975    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"]
Jul 06 19:38:59.719328 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.719284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-token\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.719328 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.719328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-envoy\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.719598 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.719344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istiod-ca-cert\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.719598 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.719453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-credential-socket\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.719598 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.719491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-workload-certs\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.719598 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.719513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-data\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.719598 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.719586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-workload-socket\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.719982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.719614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-podinfo\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.719982 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.719637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6bkc\" (UniqueName: \"kubernetes.io/projected/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-kube-api-access-t6bkc\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.820541 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.820501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-token\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.820541 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.820542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-envoy\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.820842 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.820563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istiod-ca-cert\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.820842 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.820807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-credential-socket\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.820969 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.820869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-workload-certs\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.820969 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.820901    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-data\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.820969 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.820951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-workload-socket\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.821128 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.820979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-podinfo\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.821128 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.821002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6bkc\" (UniqueName: \"kubernetes.io/projected/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-kube-api-access-t6bkc\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.821268 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.821205    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-credential-socket\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.821499 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.821476    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-data\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.821590 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.821572    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istiod-ca-cert\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.821669 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.821647    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-workload-socket\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.821767 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.821745    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-workload-certs\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.823009 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.822988    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-envoy\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.824103 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.824066    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-podinfo\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.828972 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.828951    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6bkc\" (UniqueName: \"kubernetes.io/projected/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-kube-api-access-t6bkc\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.829325 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.829303    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-token\") pod \"e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") " pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:38:59.967510 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:38:59.967475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:39:00.104789 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:00.104762    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"]
Jul 06 19:39:00.107028 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:39:00.106989    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee8863c_77f0_4669_96fc_70d6bafc8a2f.slice/crio-eebd14cbf99a56a0483b427a7a8eeb5cdf055986cff882b4b4ca46d5a000ef66 WatchSource:0}: Error finding container eebd14cbf99a56a0483b427a7a8eeb5cdf055986cff882b4b4ca46d5a000ef66: Status 404 returned error can't find the container with id eebd14cbf99a56a0483b427a7a8eeb5cdf055986cff882b4b4ca46d5a000ef66
Jul 06 19:39:00.109036 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:00.109007    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:39:00.109109 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:00.109069    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:39:00.109109 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:00.109093    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:39:00.677678 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:00.677636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt" event={"ID":"5ee8863c-77f0-4669-96fc-70d6bafc8a2f","Type":"ContainerStarted","Data":"6375e0724d4a1565daa30b82c01436de99fbb32cfd8b9332d695d5ad7961daa2"}
Jul 06 19:39:00.678295 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:00.677694    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt" event={"ID":"5ee8863c-77f0-4669-96fc-70d6bafc8a2f","Type":"ContainerStarted","Data":"eebd14cbf99a56a0483b427a7a8eeb5cdf055986cff882b4b4ca46d5a000ef66"}
Jul 06 19:39:00.699602 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:00.699545    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt" podStartSLOduration=1.699530301 podStartE2EDuration="1.699530301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:00.697162004 +0000 UTC m=+2014.307289361" watchObservedRunningTime="2026-07-06 19:39:00.699530301 +0000 UTC m=+2014.309657694"
Jul 06 19:39:00.968367 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:00.968278    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:39:01.972961 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:01.972932    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:39:02.686931 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:02.686901    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:39:02.687913 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:02.687892    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:39:02.861528 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:02.861497    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"]
Jul 06 19:39:02.862260 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:02.862239    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6cd5a0-7f31-4595-a2a2-6ddbcc699ed0" containerName="istio-proxy"
Jul 06 19:39:02.865652 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:02.865631    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:39:02.868166 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:02.868149    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-f31ab4-serving-cert\""
Jul 06 19:39:02.885647 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:02.885621    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"]
Jul 06 19:39:02.959570 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:02.959462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6zgn\" (UniqueName: \"kubernetes.io/projected/e21bb9d0-035b-47b1-8443-0a96f6d91477-kube-api-access-c6zgn\") pod \"maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9\" (UID: \"e21bb9d0-035b-47b1-8443-0a96f6d91477\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:39:02.959570 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:02.959548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21bb9d0-035b-47b1-8443-0a96f6d91477-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9\" (UID: \"e21bb9d0-035b-47b1-8443-0a96f6d91477\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:39:02.959845 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:02.959585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e21bb9d0-035b-47b1-8443-0a96f6d91477-maas-api-tls\") pod \"maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9\" (UID: \"e21bb9d0-035b-47b1-8443-0a96f6d91477\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:39:03.061113 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:03.061070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21bb9d0-035b-47b1-8443-0a96f6d91477-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9\" (UID: \"e21bb9d0-035b-47b1-8443-0a96f6d91477\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:39:03.061113 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:03.061115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e21bb9d0-035b-47b1-8443-0a96f6d91477-maas-api-tls\") pod \"maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9\" (UID: \"e21bb9d0-035b-47b1-8443-0a96f6d91477\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:39:03.061592 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:03.061202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6zgn\" (UniqueName: \"kubernetes.io/projected/e21bb9d0-035b-47b1-8443-0a96f6d91477-kube-api-access-c6zgn\") pod \"maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9\" (UID: \"e21bb9d0-035b-47b1-8443-0a96f6d91477\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:39:03.061877 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:03.061858    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21bb9d0-035b-47b1-8443-0a96f6d91477-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9\" (UID: \"e21bb9d0-035b-47b1-8443-0a96f6d91477\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:39:03.063720 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:03.063682    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e21bb9d0-035b-47b1-8443-0a96f6d91477-maas-api-tls\") pod \"maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9\" (UID: \"e21bb9d0-035b-47b1-8443-0a96f6d91477\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:39:03.069323 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:03.069294    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6zgn\" (UniqueName: \"kubernetes.io/projected/e21bb9d0-035b-47b1-8443-0a96f6d91477-kube-api-access-c6zgn\") pod \"maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9\" (UID: \"e21bb9d0-035b-47b1-8443-0a96f6d91477\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:39:03.178425 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:03.178369    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:39:03.350829 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:03.347450    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"]
Jul 06 19:39:03.356761 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:39:03.356679    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode21bb9d0_035b_47b1_8443_0a96f6d91477.slice/crio-e37b229fb32f5a04366204de851c623b174b27140f7a4a4e39fe1c06eac2f870 WatchSource:0}: Error finding container e37b229fb32f5a04366204de851c623b174b27140f7a4a4e39fe1c06eac2f870: Status 404 returned error can't find the container with id e37b229fb32f5a04366204de851c623b174b27140f7a4a4e39fe1c06eac2f870
Jul 06 19:39:03.694047 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:03.694014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9" event={"ID":"e21bb9d0-035b-47b1-8443-0a96f6d91477","Type":"ContainerStarted","Data":"e37b229fb32f5a04366204de851c623b174b27140f7a4a4e39fe1c06eac2f870"}
Jul 06 19:39:04.708737 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:04.708685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9" event={"ID":"e21bb9d0-035b-47b1-8443-0a96f6d91477","Type":"ContainerStarted","Data":"1387955a7a2b7f493d33f451d779149c6d33ce5c3f92bcf2a27e4802aefb78c8"}
Jul 06 19:39:04.709373 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:04.709344    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:39:04.728137 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:04.728088    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9" podStartSLOduration=2.343892544 podStartE2EDuration="2.728073883s" totalImagesPullingTime="384.181339ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:39:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:04.725579595 +0000 UTC m=+2018.335706952" watchObservedRunningTime="2026-07-06 19:39:04.728073883 +0000 UTC m=+2018.338201273"
Jul 06 19:39:07.727003 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:07.726973    2580 generic.go:356] "Generic (PLEG): container finished" podID="442077db-ee68-4619-b8b7-28fb2d2e2a09" containerID="1d097a145c06e5678f244df2920b61cf8b867dda82c24be260c756b6505a1b56" exitCode=0
Jul 06 19:39:07.727441 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:07.727043    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw" event={"ID":"442077db-ee68-4619-b8b7-28fb2d2e2a09","Type":"ContainerDied","Data":"1d097a145c06e5678f244df2920b61cf8b867dda82c24be260c756b6505a1b56"}
Jul 06 19:39:07.727485 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:07.727450    2580 scope.go:117] "RemoveContainer" containerID="1d097a145c06e5678f244df2920b61cf8b867dda82c24be260c756b6505a1b56"
Jul 06 19:39:07.728600 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:07.728570    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:39:07.728676 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:07.728659    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:39:07.728745 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:07.728729    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:39:08.623509 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:08.623476    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:39:08.743643 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:08.743598    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw" event={"ID":"442077db-ee68-4619-b8b7-28fb2d2e2a09","Type":"ContainerStarted","Data":"1f9cd10653a7eb91201f4a434abd8bda33836201cca9db01856a17f081cb893d"}
Jul 06 19:39:08.749686 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:08.749652    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:39:08.750757 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:08.750699    2580 patch_prober.go:28] interesting pod/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 06 19:39:08.750891 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:08.750772    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw" podUID="442077db-ee68-4619-b8b7-28fb2d2e2a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 06 19:39:09.749864 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:09.749823    2580 patch_prober.go:28] interesting pod/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 06 19:39:09.750426 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:09.749904    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw" podUID="442077db-ee68-4619-b8b7-28fb2d2e2a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 06 19:39:10.750639 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:10.750584    2580 patch_prober.go:28] interesting pod/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 06 19:39:10.751189 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:10.750676    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw" podUID="442077db-ee68-4619-b8b7-28fb2d2e2a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 06 19:39:11.727319 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:11.727289    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:39:11.750454 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:11.750412    2580 patch_prober.go:28] interesting pod/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 06 19:39:11.750653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:11.750518    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw" podUID="442077db-ee68-4619-b8b7-28fb2d2e2a09" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 06 19:39:12.754847 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:12.754814    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:39:12.755271 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:12.755097    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:39:12.755854 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:12.755835    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:39:16.795661 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:16.795631    2580 generic.go:356] "Generic (PLEG): container finished" podID="5ee8863c-77f0-4669-96fc-70d6bafc8a2f" containerID="6375e0724d4a1565daa30b82c01436de99fbb32cfd8b9332d695d5ad7961daa2" exitCode=0
Jul 06 19:39:16.796236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:16.795735    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt" event={"ID":"5ee8863c-77f0-4669-96fc-70d6bafc8a2f","Type":"ContainerDied","Data":"6375e0724d4a1565daa30b82c01436de99fbb32cfd8b9332d695d5ad7961daa2"}
Jul 06 19:39:16.796308 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:16.796257    2580 scope.go:117] "RemoveContainer" containerID="6375e0724d4a1565daa30b82c01436de99fbb32cfd8b9332d695d5ad7961daa2"
Jul 06 19:39:16.797268 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:16.797221    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:39:16.797390 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:16.797316    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:39:16.797390 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:16.797347    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:39:17.687057 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:17.687000    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:39:17.803785 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:17.803743    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt" event={"ID":"5ee8863c-77f0-4669-96fc-70d6bafc8a2f","Type":"ContainerStarted","Data":"147ff1146395768a21882017848af4b22c0e724f54abb45b20eb301b63b36074"}
Jul 06 19:39:17.968243 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:17.968152    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:39:17.969181 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:17.969153    2580 patch_prober.go:28] interesting pod/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 06 19:39:17.969333 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:17.969225    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt" podUID="5ee8863c-77f0-4669-96fc-70d6bafc8a2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 06 19:39:18.967908 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:18.967871    2580 patch_prober.go:28] interesting pod/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 06 19:39:18.968305 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:18.967940    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt" podUID="5ee8863c-77f0-4669-96fc-70d6bafc8a2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 06 19:39:19.968309 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:19.968274    2580 patch_prober.go:28] interesting pod/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 06 19:39:19.968741 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:19.968326    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt" podUID="5ee8863c-77f0-4669-96fc-70d6bafc8a2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 06 19:39:20.968068 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:20.968029    2580 patch_prober.go:28] interesting pod/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 06 19:39:20.968275 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:20.968089    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt" podUID="5ee8863c-77f0-4669-96fc-70d6bafc8a2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 06 19:39:21.972258 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:21.972230    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:39:21.972649 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:21.972546    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:39:21.973228 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:39:21.973206    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:40:26.941171 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:40:26.941137    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:40:26.948848 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:40:26.948824    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:45:26.973479 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:45:26.973450    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:45:26.982363 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:45:26.982337    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:46:00.878134 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:00.878041    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"]
Jul 06 19:46:00.878624 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:00.878292    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw" podUID="442077db-ee68-4619-b8b7-28fb2d2e2a09" containerName="istio-proxy" containerID="cri-o://1f9cd10653a7eb91201f4a434abd8bda33836201cca9db01856a17f081cb893d" gracePeriod=30
Jul 06 19:46:02.024383 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.024343    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"]
Jul 06 19:46:02.024934 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.024596    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9" podUID="e21bb9d0-035b-47b1-8443-0a96f6d91477" containerName="maas-api" containerID="cri-o://1387955a7a2b7f493d33f451d779149c6d33ce5c3f92bcf2a27e4802aefb78c8" gracePeriod=30
Jul 06 19:46:02.283092 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.283014    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:46:02.410403 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.410368    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6zgn\" (UniqueName: \"kubernetes.io/projected/e21bb9d0-035b-47b1-8443-0a96f6d91477-kube-api-access-c6zgn\") pod \"e21bb9d0-035b-47b1-8443-0a96f6d91477\" (UID: \"e21bb9d0-035b-47b1-8443-0a96f6d91477\") "
Jul 06 19:46:02.410586 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.410409    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e21bb9d0-035b-47b1-8443-0a96f6d91477-maas-api-tls\") pod \"e21bb9d0-035b-47b1-8443-0a96f6d91477\" (UID: \"e21bb9d0-035b-47b1-8443-0a96f6d91477\") "
Jul 06 19:46:02.410586 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.410524    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21bb9d0-035b-47b1-8443-0a96f6d91477-openshift-service-ca\") pod \"e21bb9d0-035b-47b1-8443-0a96f6d91477\" (UID: \"e21bb9d0-035b-47b1-8443-0a96f6d91477\") "
Jul 06 19:46:02.410939 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.410906    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e21bb9d0-035b-47b1-8443-0a96f6d91477-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e21bb9d0-035b-47b1-8443-0a96f6d91477" (UID: "e21bb9d0-035b-47b1-8443-0a96f6d91477"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:46:02.412587 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.412553    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e21bb9d0-035b-47b1-8443-0a96f6d91477-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e21bb9d0-035b-47b1-8443-0a96f6d91477" (UID: "e21bb9d0-035b-47b1-8443-0a96f6d91477"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:46:02.412679 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.412595    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e21bb9d0-035b-47b1-8443-0a96f6d91477-kube-api-access-c6zgn" (OuterVolumeSpecName: "kube-api-access-c6zgn") pod "e21bb9d0-035b-47b1-8443-0a96f6d91477" (UID: "e21bb9d0-035b-47b1-8443-0a96f6d91477"). InnerVolumeSpecName "kube-api-access-c6zgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:02.512188 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.512140    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6zgn\" (UniqueName: \"kubernetes.io/projected/e21bb9d0-035b-47b1-8443-0a96f6d91477-kube-api-access-c6zgn\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:02.512188 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.512176    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e21bb9d0-035b-47b1-8443-0a96f6d91477-maas-api-tls\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:02.512188 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.512186    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21bb9d0-035b-47b1-8443-0a96f6d91477-openshift-service-ca\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:02.794093 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.794056    2580 generic.go:356] "Generic (PLEG): container finished" podID="e21bb9d0-035b-47b1-8443-0a96f6d91477" containerID="1387955a7a2b7f493d33f451d779149c6d33ce5c3f92bcf2a27e4802aefb78c8" exitCode=0
Jul 06 19:46:02.794299 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.794099    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"
Jul 06 19:46:02.794299 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.794135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9" event={"ID":"e21bb9d0-035b-47b1-8443-0a96f6d91477","Type":"ContainerDied","Data":"1387955a7a2b7f493d33f451d779149c6d33ce5c3f92bcf2a27e4802aefb78c8"}
Jul 06 19:46:02.794299 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.794190    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9" event={"ID":"e21bb9d0-035b-47b1-8443-0a96f6d91477","Type":"ContainerDied","Data":"e37b229fb32f5a04366204de851c623b174b27140f7a4a4e39fe1c06eac2f870"}
Jul 06 19:46:02.794299 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.794216    2580 scope.go:117] "RemoveContainer" containerID="1387955a7a2b7f493d33f451d779149c6d33ce5c3f92bcf2a27e4802aefb78c8"
Jul 06 19:46:02.804037 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.804003    2580 scope.go:117] "RemoveContainer" containerID="1387955a7a2b7f493d33f451d779149c6d33ce5c3f92bcf2a27e4802aefb78c8"
Jul 06 19:46:02.804301 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:46:02.804283    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1387955a7a2b7f493d33f451d779149c6d33ce5c3f92bcf2a27e4802aefb78c8\": container with ID starting with 1387955a7a2b7f493d33f451d779149c6d33ce5c3f92bcf2a27e4802aefb78c8 not found: ID does not exist" containerID="1387955a7a2b7f493d33f451d779149c6d33ce5c3f92bcf2a27e4802aefb78c8"
Jul 06 19:46:02.804373 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.804310    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1387955a7a2b7f493d33f451d779149c6d33ce5c3f92bcf2a27e4802aefb78c8"} err="failed to get container status \"1387955a7a2b7f493d33f451d779149c6d33ce5c3f92bcf2a27e4802aefb78c8\": rpc error: code = NotFound desc = could not find container \"1387955a7a2b7f493d33f451d779149c6d33ce5c3f92bcf2a27e4802aefb78c8\": container with ID starting with 1387955a7a2b7f493d33f451d779149c6d33ce5c3f92bcf2a27e4802aefb78c8 not found: ID does not exist"
Jul 06 19:46:02.816724 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.816673    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"]
Jul 06 19:46:02.820378 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.820352    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f31ab4-6f8dc67546-5d2b9"]
Jul 06 19:46:02.851661 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:02.851628    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e21bb9d0-035b-47b1-8443-0a96f6d91477" path="/var/lib/kubelet/pods/e21bb9d0-035b-47b1-8443-0a96f6d91477/volumes"
Jul 06 19:46:06.139074 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.139009    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:46:06.145500 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.145471    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-credential-socket\") pod \"442077db-ee68-4619-b8b7-28fb2d2e2a09\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") "
Jul 06 19:46:06.145641 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.145508    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-envoy\") pod \"442077db-ee68-4619-b8b7-28fb2d2e2a09\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") "
Jul 06 19:46:06.145641 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.145536    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-data\") pod \"442077db-ee68-4619-b8b7-28fb2d2e2a09\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") "
Jul 06 19:46:06.145641 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.145573    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfhsc\" (UniqueName: \"kubernetes.io/projected/442077db-ee68-4619-b8b7-28fb2d2e2a09-kube-api-access-rfhsc\") pod \"442077db-ee68-4619-b8b7-28fb2d2e2a09\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") "
Jul 06 19:46:06.145641 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.145590    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-token\") pod \"442077db-ee68-4619-b8b7-28fb2d2e2a09\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") "
Jul 06 19:46:06.145641 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.145609    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-podinfo\") pod \"442077db-ee68-4619-b8b7-28fb2d2e2a09\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") "
Jul 06 19:46:06.145941 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.145665    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-workload-certs\") pod \"442077db-ee68-4619-b8b7-28fb2d2e2a09\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") "
Jul 06 19:46:06.145941 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.145731    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-workload-socket\") pod \"442077db-ee68-4619-b8b7-28fb2d2e2a09\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") "
Jul 06 19:46:06.145941 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.145736    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "442077db-ee68-4619-b8b7-28fb2d2e2a09" (UID: "442077db-ee68-4619-b8b7-28fb2d2e2a09"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:06.145941 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.145766    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/442077db-ee68-4619-b8b7-28fb2d2e2a09-istiod-ca-cert\") pod \"442077db-ee68-4619-b8b7-28fb2d2e2a09\" (UID: \"442077db-ee68-4619-b8b7-28fb2d2e2a09\") "
Jul 06 19:46:06.146147 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.146095    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-credential-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:06.146236 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.146211    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "442077db-ee68-4619-b8b7-28fb2d2e2a09" (UID: "442077db-ee68-4619-b8b7-28fb2d2e2a09"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:06.146343 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.146292    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "442077db-ee68-4619-b8b7-28fb2d2e2a09" (UID: "442077db-ee68-4619-b8b7-28fb2d2e2a09"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:06.146343 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.146331    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/442077db-ee68-4619-b8b7-28fb2d2e2a09-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "442077db-ee68-4619-b8b7-28fb2d2e2a09" (UID: "442077db-ee68-4619-b8b7-28fb2d2e2a09"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:46:06.146675 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.146648    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-data" (OuterVolumeSpecName: "istio-data") pod "442077db-ee68-4619-b8b7-28fb2d2e2a09" (UID: "442077db-ee68-4619-b8b7-28fb2d2e2a09"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:06.147917 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.147892    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "442077db-ee68-4619-b8b7-28fb2d2e2a09" (UID: "442077db-ee68-4619-b8b7-28fb2d2e2a09"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:06.147917 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.147910    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/442077db-ee68-4619-b8b7-28fb2d2e2a09-kube-api-access-rfhsc" (OuterVolumeSpecName: "kube-api-access-rfhsc") pod "442077db-ee68-4619-b8b7-28fb2d2e2a09" (UID: "442077db-ee68-4619-b8b7-28fb2d2e2a09"). InnerVolumeSpecName "kube-api-access-rfhsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:06.148060 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.147908    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "442077db-ee68-4619-b8b7-28fb2d2e2a09" (UID: "442077db-ee68-4619-b8b7-28fb2d2e2a09"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:46:06.148060 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.148006    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-token" (OuterVolumeSpecName: "istio-token") pod "442077db-ee68-4619-b8b7-28fb2d2e2a09" (UID: "442077db-ee68-4619-b8b7-28fb2d2e2a09"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:06.246886 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.246854    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/442077db-ee68-4619-b8b7-28fb2d2e2a09-istiod-ca-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:06.246886 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.246883    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-envoy\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:06.246886 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.246894    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-data\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:06.247190 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.246906    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfhsc\" (UniqueName: \"kubernetes.io/projected/442077db-ee68-4619-b8b7-28fb2d2e2a09-kube-api-access-rfhsc\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:06.247190 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.246919    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-token\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:06.247190 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.246933    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/442077db-ee68-4619-b8b7-28fb2d2e2a09-istio-podinfo\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:06.247190 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.246944    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-workload-certs\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:06.247190 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.246955    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/442077db-ee68-4619-b8b7-28fb2d2e2a09-workload-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:06.816832 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.816791    2580 generic.go:356] "Generic (PLEG): container finished" podID="442077db-ee68-4619-b8b7-28fb2d2e2a09" containerID="1f9cd10653a7eb91201f4a434abd8bda33836201cca9db01856a17f081cb893d" exitCode=0
Jul 06 19:46:06.817040 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.816850    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"
Jul 06 19:46:06.817040 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.816854    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw" event={"ID":"442077db-ee68-4619-b8b7-28fb2d2e2a09","Type":"ContainerDied","Data":"1f9cd10653a7eb91201f4a434abd8bda33836201cca9db01856a17f081cb893d"}
Jul 06 19:46:06.817040 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.817002    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw" event={"ID":"442077db-ee68-4619-b8b7-28fb2d2e2a09","Type":"ContainerDied","Data":"45ff7ee3e9587a42c225b0ac78bbae4c02ac9f4e56031ce21b066f27d452bdd5"}
Jul 06 19:46:06.817040 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.817036    2580 scope.go:117] "RemoveContainer" containerID="1f9cd10653a7eb91201f4a434abd8bda33836201cca9db01856a17f081cb893d"
Jul 06 19:46:06.826463 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.826445    2580 scope.go:117] "RemoveContainer" containerID="1d097a145c06e5678f244df2920b61cf8b867dda82c24be260c756b6505a1b56"
Jul 06 19:46:06.834471 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.834449    2580 scope.go:117] "RemoveContainer" containerID="1f9cd10653a7eb91201f4a434abd8bda33836201cca9db01856a17f081cb893d"
Jul 06 19:46:06.834718 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:46:06.834686    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f9cd10653a7eb91201f4a434abd8bda33836201cca9db01856a17f081cb893d\": container with ID starting with 1f9cd10653a7eb91201f4a434abd8bda33836201cca9db01856a17f081cb893d not found: ID does not exist" containerID="1f9cd10653a7eb91201f4a434abd8bda33836201cca9db01856a17f081cb893d"
Jul 06 19:46:06.834798 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.834744    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f9cd10653a7eb91201f4a434abd8bda33836201cca9db01856a17f081cb893d"} err="failed to get container status \"1f9cd10653a7eb91201f4a434abd8bda33836201cca9db01856a17f081cb893d\": rpc error: code = NotFound desc = could not find container \"1f9cd10653a7eb91201f4a434abd8bda33836201cca9db01856a17f081cb893d\": container with ID starting with 1f9cd10653a7eb91201f4a434abd8bda33836201cca9db01856a17f081cb893d not found: ID does not exist"
Jul 06 19:46:06.834798 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.834770    2580 scope.go:117] "RemoveContainer" containerID="1d097a145c06e5678f244df2920b61cf8b867dda82c24be260c756b6505a1b56"
Jul 06 19:46:06.835054 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:46:06.835037    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d097a145c06e5678f244df2920b61cf8b867dda82c24be260c756b6505a1b56\": container with ID starting with 1d097a145c06e5678f244df2920b61cf8b867dda82c24be260c756b6505a1b56 not found: ID does not exist" containerID="1d097a145c06e5678f244df2920b61cf8b867dda82c24be260c756b6505a1b56"
Jul 06 19:46:06.835099 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.835060    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d097a145c06e5678f244df2920b61cf8b867dda82c24be260c756b6505a1b56"} err="failed to get container status \"1d097a145c06e5678f244df2920b61cf8b867dda82c24be260c756b6505a1b56\": rpc error: code = NotFound desc = could not find container \"1d097a145c06e5678f244df2920b61cf8b867dda82c24be260c756b6505a1b56\": container with ID starting with 1d097a145c06e5678f244df2920b61cf8b867dda82c24be260c756b6505a1b56 not found: ID does not exist"
Jul 06 19:46:06.839617 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.839597    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"]
Jul 06 19:46:06.843125 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.843106    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-f969f4-openshift-default-6dbbb5f74c-xjwhw"]
Jul 06 19:46:06.851422 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:06.851393    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="442077db-ee68-4619-b8b7-28fb2d2e2a09" path="/var/lib/kubelet/pods/442077db-ee68-4619-b8b7-28fb2d2e2a09/volumes"
Jul 06 19:46:08.014268 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:08.014233    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"]
Jul 06 19:46:08.014690 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:08.014453    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt" podUID="5ee8863c-77f0-4669-96fc-70d6bafc8a2f" containerName="istio-proxy" containerID="cri-o://147ff1146395768a21882017848af4b22c0e724f54abb45b20eb301b63b36074" gracePeriod=30
Jul 06 19:46:13.276772 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.276746    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:46:13.320901 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.320811    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-workload-certs\") pod \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") "
Jul 06 19:46:13.320901 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.320869    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-workload-socket\") pod \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") "
Jul 06 19:46:13.321144 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.320908    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-credential-socket\") pod \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") "
Jul 06 19:46:13.321144 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.320935    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-data\") pod \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") "
Jul 06 19:46:13.321144 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.320966    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6bkc\" (UniqueName: \"kubernetes.io/projected/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-kube-api-access-t6bkc\") pod \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") "
Jul 06 19:46:13.321144 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.321004    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istiod-ca-cert\") pod \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") "
Jul 06 19:46:13.321144 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.321029    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-envoy\") pod \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") "
Jul 06 19:46:13.321144 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.321068    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-token\") pod \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") "
Jul 06 19:46:13.321144 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.321117    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-podinfo\") pod \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\" (UID: \"5ee8863c-77f0-4669-96fc-70d6bafc8a2f\") "
Jul 06 19:46:13.321507 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.321179    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ee8863c-77f0-4669-96fc-70d6bafc8a2f" (UID: "5ee8863c-77f0-4669-96fc-70d6bafc8a2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:13.321507 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.321287    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ee8863c-77f0-4669-96fc-70d6bafc8a2f" (UID: "5ee8863c-77f0-4669-96fc-70d6bafc8a2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:13.321507 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.321301    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ee8863c-77f0-4669-96fc-70d6bafc8a2f" (UID: "5ee8863c-77f0-4669-96fc-70d6bafc8a2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:13.321662 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.321506    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ee8863c-77f0-4669-96fc-70d6bafc8a2f" (UID: "5ee8863c-77f0-4669-96fc-70d6bafc8a2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:46:13.321662 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.321568    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-workload-certs\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:13.321662 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.321588    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-workload-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:13.321662 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.321603    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-credential-socket\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:13.322135 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.322098    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ee8863c-77f0-4669-96fc-70d6bafc8a2f" (UID: "5ee8863c-77f0-4669-96fc-70d6bafc8a2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:13.323536 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.323491    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-kube-api-access-t6bkc" (OuterVolumeSpecName: "kube-api-access-t6bkc") pod "5ee8863c-77f0-4669-96fc-70d6bafc8a2f" (UID: "5ee8863c-77f0-4669-96fc-70d6bafc8a2f"). InnerVolumeSpecName "kube-api-access-t6bkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:13.323536 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.323511    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ee8863c-77f0-4669-96fc-70d6bafc8a2f" (UID: "5ee8863c-77f0-4669-96fc-70d6bafc8a2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:46:13.323737 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.323591    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ee8863c-77f0-4669-96fc-70d6bafc8a2f" (UID: "5ee8863c-77f0-4669-96fc-70d6bafc8a2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:13.323813 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.323793    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ee8863c-77f0-4669-96fc-70d6bafc8a2f" (UID: "5ee8863c-77f0-4669-96fc-70d6bafc8a2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:13.422941 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.422907    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-data\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:13.422941 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.422935    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6bkc\" (UniqueName: \"kubernetes.io/projected/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-kube-api-access-t6bkc\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:13.422941 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.422946    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istiod-ca-cert\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:13.423169 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.422956    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-envoy\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:13.423169 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.422964    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-token\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:13.423169 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.422971    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ee8863c-77f0-4669-96fc-70d6bafc8a2f-istio-podinfo\") on node \"ip-10-0-133-117.ec2.internal\" DevicePath \"\""
Jul 06 19:46:13.516429 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.516384    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86c44fb47b-zhl2z_48b1484a-dea1-4511-84a1-c42b61c5a387/manager/0.log"
Jul 06 19:46:13.855148 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.855109    2580 generic.go:356] "Generic (PLEG): container finished" podID="5ee8863c-77f0-4669-96fc-70d6bafc8a2f" containerID="147ff1146395768a21882017848af4b22c0e724f54abb45b20eb301b63b36074" exitCode=0
Jul 06 19:46:13.855327 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.855159    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"
Jul 06 19:46:13.855327 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.855163    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt" event={"ID":"5ee8863c-77f0-4669-96fc-70d6bafc8a2f","Type":"ContainerDied","Data":"147ff1146395768a21882017848af4b22c0e724f54abb45b20eb301b63b36074"}
Jul 06 19:46:13.855327 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.855223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt" event={"ID":"5ee8863c-77f0-4669-96fc-70d6bafc8a2f","Type":"ContainerDied","Data":"eebd14cbf99a56a0483b427a7a8eeb5cdf055986cff882b4b4ca46d5a000ef66"}
Jul 06 19:46:13.855327 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.855248    2580 scope.go:117] "RemoveContainer" containerID="147ff1146395768a21882017848af4b22c0e724f54abb45b20eb301b63b36074"
Jul 06 19:46:13.865168 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.865150    2580 scope.go:117] "RemoveContainer" containerID="6375e0724d4a1565daa30b82c01436de99fbb32cfd8b9332d695d5ad7961daa2"
Jul 06 19:46:13.873653 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.873635    2580 scope.go:117] "RemoveContainer" containerID="147ff1146395768a21882017848af4b22c0e724f54abb45b20eb301b63b36074"
Jul 06 19:46:13.873995 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:46:13.873975    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"147ff1146395768a21882017848af4b22c0e724f54abb45b20eb301b63b36074\": container with ID starting with 147ff1146395768a21882017848af4b22c0e724f54abb45b20eb301b63b36074 not found: ID does not exist" containerID="147ff1146395768a21882017848af4b22c0e724f54abb45b20eb301b63b36074"
Jul 06 19:46:13.874087 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.874009    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"147ff1146395768a21882017848af4b22c0e724f54abb45b20eb301b63b36074"} err="failed to get container status \"147ff1146395768a21882017848af4b22c0e724f54abb45b20eb301b63b36074\": rpc error: code = NotFound desc = could not find container \"147ff1146395768a21882017848af4b22c0e724f54abb45b20eb301b63b36074\": container with ID starting with 147ff1146395768a21882017848af4b22c0e724f54abb45b20eb301b63b36074 not found: ID does not exist"
Jul 06 19:46:13.874087 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.874034    2580 scope.go:117] "RemoveContainer" containerID="6375e0724d4a1565daa30b82c01436de99fbb32cfd8b9332d695d5ad7961daa2"
Jul 06 19:46:13.874291 ip-10-0-133-117 kubenswrapper[2580]: E0706 19:46:13.874273    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6375e0724d4a1565daa30b82c01436de99fbb32cfd8b9332d695d5ad7961daa2\": container with ID starting with 6375e0724d4a1565daa30b82c01436de99fbb32cfd8b9332d695d5ad7961daa2 not found: ID does not exist" containerID="6375e0724d4a1565daa30b82c01436de99fbb32cfd8b9332d695d5ad7961daa2"
Jul 06 19:46:13.874332 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.874297    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6375e0724d4a1565daa30b82c01436de99fbb32cfd8b9332d695d5ad7961daa2"} err="failed to get container status \"6375e0724d4a1565daa30b82c01436de99fbb32cfd8b9332d695d5ad7961daa2\": rpc error: code = NotFound desc = could not find container \"6375e0724d4a1565daa30b82c01436de99fbb32cfd8b9332d695d5ad7961daa2\": container with ID starting with 6375e0724d4a1565daa30b82c01436de99fbb32cfd8b9332d695d5ad7961daa2 not found: ID does not exist"
Jul 06 19:46:13.879739 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.879657    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"]
Jul 06 19:46:13.881985 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:13.881963    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-f31ab4-openshift-default-5bd4f86db7-f7rjt"]
Jul 06 19:46:14.139135 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:14.139058    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7598fdd968-z8d6m_8f456dc1-980a-441d-a042-d60e52953bbd/copy-manifests/0.log"
Jul 06 19:46:14.146851 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:14.146831    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7598fdd968-z8d6m_8f456dc1-980a-441d-a042-d60e52953bbd/manager/0.log"
Jul 06 19:46:14.851327 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:14.851294    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ee8863c-77f0-4669-96fc-70d6bafc8a2f" path="/var/lib/kubelet/pods/5ee8863c-77f0-4669-96fc-70d6bafc8a2f/volumes"
Jul 06 19:46:15.634171 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:15.634139    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mk22q_02297939-99e8-4b70-8d7f-46924827812c/manager/0.log"
Jul 06 19:46:17.050614 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:17.050581    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-bqxcb_3a6d9f4d-262d-4b38-85a1-96b3dfb8f419/istio-proxy/1.log"
Jul 06 19:46:17.184453 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:17.184421    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-4ksqd_8dfc89c4-396a-4718-9897-b2557c39c4a0/payload-pre-processing/0.log"
Jul 06 19:46:17.306206 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:17.306122    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-b7xzq_68ffa339-302b-44c8-bb21-76eea323787a/payload-processing/0.log"
Jul 06 19:46:17.425053 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:17.425021    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cd66fb969-l6b4g_47cefdd7-3087-4e22-b0cd-569e3862dd1b/router/0.log"
Jul 06 19:46:17.774799 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:17.774768    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-ls4lx_f62f4f88-a1f7-425e-9501-25b97b80d0e2/main/0.log"
Jul 06 19:46:18.011618 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:18.011594    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-8dnds_34f6ca65-6880-435c-9c82-aa91776e1013/main/0.log"
Jul 06 19:46:18.133498 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:18.133422    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdbnls_aa6d0179-bd7a-4f61-983d-cac5136383de/main/0.log"
Jul 06 19:46:25.711092 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:25.711059    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6zm9c_c3a18cca-96fa-4abb-b1e8-d061a4a0599c/global-pull-secret-syncer/0.log"
Jul 06 19:46:25.916645 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:25.916609    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rxxnr_08b7a2ec-da87-41ff-b581-e0c745521671/konnectivity-agent/0.log"
Jul 06 19:46:25.974727 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:25.974625    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-117.ec2.internal_aef998b8d3d262608292fb209e53a208/haproxy/0.log"
Jul 06 19:46:30.515865 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:30.515836    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mk22q_02297939-99e8-4b70-8d7f-46924827812c/manager/0.log"
Jul 06 19:46:32.898068 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:32.897987    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-sshgz_c25aa9b5-06e8-4aa0-8cea-d1179e62a508/cluster-monitoring-operator/0.log"
Jul 06 19:46:33.070823 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:33.070795    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7628t_1ad539c3-a537-43fa-a6a0-abb62021ce68/node-exporter/0.log"
Jul 06 19:46:33.092866 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:33.092837    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7628t_1ad539c3-a537-43fa-a6a0-abb62021ce68/kube-rbac-proxy/0.log"
Jul 06 19:46:33.115552 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:33.115518    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7628t_1ad539c3-a537-43fa-a6a0-abb62021ce68/init-textfile/0.log"
Jul 06 19:46:35.145676 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.145649    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-8427r_710d5b79-850d-4434-bbec-c627665523c3/networking-console-plugin/0.log"
Jul 06 19:46:35.352875 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.352842    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"]
Jul 06 19:46:35.353276 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.353261    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee8863c-77f0-4669-96fc-70d6bafc8a2f" containerName="istio-proxy"
Jul 06 19:46:35.353322 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.353277    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee8863c-77f0-4669-96fc-70d6bafc8a2f" containerName="istio-proxy"
Jul 06 19:46:35.353322 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.353286    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="442077db-ee68-4619-b8b7-28fb2d2e2a09" containerName="istio-proxy"
Jul 06 19:46:35.353322 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.353292    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="442077db-ee68-4619-b8b7-28fb2d2e2a09" containerName="istio-proxy"
Jul 06 19:46:35.353322 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.353304    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="442077db-ee68-4619-b8b7-28fb2d2e2a09" containerName="istio-proxy"
Jul 06 19:46:35.353322 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.353310    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="442077db-ee68-4619-b8b7-28fb2d2e2a09" containerName="istio-proxy"
Jul 06 19:46:35.353322 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.353316    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e21bb9d0-035b-47b1-8443-0a96f6d91477" containerName="maas-api"
Jul 06 19:46:35.353322 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.353321    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e21bb9d0-035b-47b1-8443-0a96f6d91477" containerName="maas-api"
Jul 06 19:46:35.353538 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.353328    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee8863c-77f0-4669-96fc-70d6bafc8a2f" containerName="istio-proxy"
Jul 06 19:46:35.353538 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.353334    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee8863c-77f0-4669-96fc-70d6bafc8a2f" containerName="istio-proxy"
Jul 06 19:46:35.353538 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.353391    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="442077db-ee68-4619-b8b7-28fb2d2e2a09" containerName="istio-proxy"
Jul 06 19:46:35.353538 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.353399    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e21bb9d0-035b-47b1-8443-0a96f6d91477" containerName="maas-api"
Jul 06 19:46:35.353538 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.353405    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee8863c-77f0-4669-96fc-70d6bafc8a2f" containerName="istio-proxy"
Jul 06 19:46:35.353538 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.353411    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="442077db-ee68-4619-b8b7-28fb2d2e2a09" containerName="istio-proxy"
Jul 06 19:46:35.356441 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.356418    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.358774 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.358748    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ts2hx\"/\"default-dockercfg-pfx6k\""
Jul 06 19:46:35.359572 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.359554    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ts2hx\"/\"kube-root-ca.crt\""
Jul 06 19:46:35.359656 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.359561    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ts2hx\"/\"openshift-service-ca.crt\""
Jul 06 19:46:35.371491 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.371462    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"]
Jul 06 19:46:35.446271 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.446230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-podres\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.446271 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.446274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-proc\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.446490 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.446324    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd4rt\" (UniqueName: \"kubernetes.io/projected/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-kube-api-access-pd4rt\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.446490 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.446376    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-lib-modules\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.446490 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.446421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-sys\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.546866 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.546830    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-sys\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.547052 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.546907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-podres\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.547052 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.546934    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-proc\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.547052 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.546953    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-sys\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.547052 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.546961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd4rt\" (UniqueName: \"kubernetes.io/projected/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-kube-api-access-pd4rt\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.547052 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.547038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-lib-modules\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.547251 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.547047    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-proc\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.547251 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.547086    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-podres\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.547251 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.547151    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-lib-modules\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.555877 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.555857    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd4rt\" (UniqueName: \"kubernetes.io/projected/d833415c-9b6b-4e17-9bf3-031e9bc56fe6-kube-api-access-pd4rt\") pod \"perf-node-gather-daemonset-hw5cw\" (UID: \"d833415c-9b6b-4e17-9bf3-031e9bc56fe6\") " pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.665874 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.665840    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.806290 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.806263    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"]
Jul 06 19:46:35.808880 ip-10-0-133-117 kubenswrapper[2580]: W0706 19:46:35.808847    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd833415c_9b6b_4e17_9bf3_031e9bc56fe6.slice/crio-bcd6cc2c03f113b4d08eead022235c33222264fecbfb43872ff2b73ea2c1cb73 WatchSource:0}: Error finding container bcd6cc2c03f113b4d08eead022235c33222264fecbfb43872ff2b73ea2c1cb73: Status 404 returned error can't find the container with id bcd6cc2c03f113b4d08eead022235c33222264fecbfb43872ff2b73ea2c1cb73
Jul 06 19:46:35.820475 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.820451    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/1.log"
Jul 06 19:46:35.825604 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.825572    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tbqgn_4c110e8e-faa6-4880-8239-3119fd4d7815/console-operator/2.log"
Jul 06 19:46:35.967904 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.967799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw" event={"ID":"d833415c-9b6b-4e17-9bf3-031e9bc56fe6","Type":"ContainerStarted","Data":"b54a0aa4431723b2f98575094d3494bec7178b18d3bf690fe85c7db7ba0a7588"}
Jul 06 19:46:35.967904 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.967864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw" event={"ID":"d833415c-9b6b-4e17-9bf3-031e9bc56fe6","Type":"ContainerStarted","Data":"bcd6cc2c03f113b4d08eead022235c33222264fecbfb43872ff2b73ea2c1cb73"}
Jul 06 19:46:35.968091 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.968003    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:35.985921 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:35.985869    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw" podStartSLOduration=0.985851289 podStartE2EDuration="985.851289ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:46:35.984431823 +0000 UTC m=+2469.594559178" watchObservedRunningTime="2026-07-06 19:46:35.985851289 +0000 UTC m=+2469.595978632"
Jul 06 19:46:36.354477 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:36.354390    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dd4f56c7d-mpw2h_647425a2-d2f1-42bd-859c-b8a4178440f9/console/0.log"
Jul 06 19:46:36.386496 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:36.386463    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-m6jrf_84d4bf4a-037c-4efe-857a-90978d7d4d27/download-server/0.log"
Jul 06 19:46:36.972241 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:36.972193    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-kvdh2_554b6496-0ca4-4164-89e5-d7b412f3a87f/volume-data-source-validator/0.log"
Jul 06 19:46:38.024818 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:38.024788    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k8kdm_9c66f5ab-d626-436c-8dc1-53201c728381/dns/0.log"
Jul 06 19:46:38.052963 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:38.052938    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k8kdm_9c66f5ab-d626-436c-8dc1-53201c728381/kube-rbac-proxy/0.log"
Jul 06 19:46:38.256930 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:38.256904    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j8549_f57113cb-3b9f-4d8e-b70e-8d04ba9bf414/dns-node-resolver/0.log"
Jul 06 19:46:38.899491 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:38.899451    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s5rb8_1df345a6-542e-4d6a-b96e-9b4d2e3ef7a5/node-ca/0.log"
Jul 06 19:46:40.215028 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:40.214993    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-bqxcb_3a6d9f4d-262d-4b38-85a1-96b3dfb8f419/istio-proxy/0.log"
Jul 06 19:46:40.239958 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:40.239928    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-bqxcb_3a6d9f4d-262d-4b38-85a1-96b3dfb8f419/istio-proxy/1.log"
Jul 06 19:46:40.271480 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:40.271449    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-4ksqd_8dfc89c4-396a-4718-9897-b2557c39c4a0/payload-pre-processing/0.log"
Jul 06 19:46:40.317450 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:40.317412    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-b7xzq_68ffa339-302b-44c8-bb21-76eea323787a/payload-processing/0.log"
Jul 06 19:46:40.340493 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:40.340471    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cd66fb969-l6b4g_47cefdd7-3087-4e22-b0cd-569e3862dd1b/router/0.log"
Jul 06 19:46:41.055480 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:41.055452    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gm5ph_2806f7af-59f9-4717-b25a-4bb8d81eccf5/serve-healthcheck-canary/0.log"
Jul 06 19:46:41.576674 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:41.576645    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-jrn5b_db1034da-81bf-4b9b-a83d-cda34d16176b/insights-operator/0.log"
Jul 06 19:46:41.578147 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:41.578129    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-jrn5b_db1034da-81bf-4b9b-a83d-cda34d16176b/insights-operator/1.log"
Jul 06 19:46:41.753984 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:41.753953    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z874w_18c396c0-b0b0-41c2-bffc-7941a2358658/kube-rbac-proxy/0.log"
Jul 06 19:46:41.775779 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:41.775750    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z874w_18c396c0-b0b0-41c2-bffc-7941a2358658/exporter/0.log"
Jul 06 19:46:41.801077 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:41.801047    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z874w_18c396c0-b0b0-41c2-bffc-7941a2358658/extractor/0.log"
Jul 06 19:46:41.982590 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:41.982563    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ts2hx/perf-node-gather-daemonset-hw5cw"
Jul 06 19:46:44.300900 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:44.300864    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86c44fb47b-zhl2z_48b1484a-dea1-4511-84a1-c42b61c5a387/manager/0.log"
Jul 06 19:46:44.673078 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:44.673047    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7598fdd968-z8d6m_8f456dc1-980a-441d-a042-d60e52953bbd/manager/0.log"
Jul 06 19:46:44.703579 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:44.703552    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7598fdd968-z8d6m_8f456dc1-980a-441d-a042-d60e52953bbd/copy-manifests/0.log"
Jul 06 19:46:45.513368 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:45.513334    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-bqxcb_3a6d9f4d-262d-4b38-85a1-96b3dfb8f419/istio-proxy/0.log"
Jul 06 19:46:45.536998 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:45.536972    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-bqxcb_3a6d9f4d-262d-4b38-85a1-96b3dfb8f419/istio-proxy/1.log"
Jul 06 19:46:45.585978 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:45.585952    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-4ksqd_8dfc89c4-396a-4718-9897-b2557c39c4a0/payload-pre-processing/0.log"
Jul 06 19:46:45.624297 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:45.624270    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-b7xzq_68ffa339-302b-44c8-bb21-76eea323787a/payload-processing/0.log"
Jul 06 19:46:45.641273 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:45.641249    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cd66fb969-l6b4g_47cefdd7-3087-4e22-b0cd-569e3862dd1b/router/0.log"
Jul 06 19:46:46.131998 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:46.131890    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5d97cd6788-p2qqr_0797986c-3316-4a03-8c9b-fb6806f72d1a/manager/0.log"
Jul 06 19:46:46.978841 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:46.978812    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-bqxcb_3a6d9f4d-262d-4b38-85a1-96b3dfb8f419/istio-proxy/0.log"
Jul 06 19:46:47.008257 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:47.008232    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-bqxcb_3a6d9f4d-262d-4b38-85a1-96b3dfb8f419/istio-proxy/1.log"
Jul 06 19:46:47.031237 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:47.031208    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-4ksqd_8dfc89c4-396a-4718-9897-b2557c39c4a0/payload-pre-processing/0.log"
Jul 06 19:46:47.073010 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:47.072979    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-b7xzq_68ffa339-302b-44c8-bb21-76eea323787a/payload-processing/0.log"
Jul 06 19:46:47.091658 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:47.091629    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cd66fb969-l6b4g_47cefdd7-3087-4e22-b0cd-569e3862dd1b/router/0.log"
Jul 06 19:46:51.175097 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:51.175070    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-5j58b_3f38ba48-302b-4a50-b534-37c21e48c0f8/migrator/0.log"
Jul 06 19:46:51.198804 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:51.198764    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-5j58b_3f38ba48-302b-4a50-b534-37c21e48c0f8/graceful-termination/0.log"
Jul 06 19:46:51.572136 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:51.572055    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-trvzn_ea6c4d57-09e8-4016-9038-69c4d0bd541d/kube-storage-version-migrator-operator/1.log"
Jul 06 19:46:51.572845 ip-10-0-133-117 kubenswrapper[2580]: I0706 19:46:51.572827    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-trvzn_ea6c4d57-09e8-4016-9038-69c4d0bd541d/kube-storage-version-migrator-operator/0.log"