Jul 09 01:57:29.517969 ip-10-0-137-63 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 01:57:29.517978 ip-10-0-137-63 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 01:57:29.517985 ip-10-0-137-63 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 01:57:29.518208 ip-10-0-137-63 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 01:57:40.945915 ip-10-0-137-63 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 01:57:40.945936 ip-10-0-137-63 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d884406feeb644058180984c6f48670c --
Jul 09 01:59:34.605903 ip-10-0-137-63 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 01:59:35.098299 ip-10-0-137-63 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 01:59:35.098299 ip-10-0-137-63 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 01:59:35.098299 ip-10-0-137-63 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 01:59:35.098299 ip-10-0-137-63 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 01:59:35.098299 ip-10-0-137-63 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 01:59:35.098299 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:34.993769    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 01:59:35.098299 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.997974    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 01:59:35.098299 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.997988    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 01:59:35.098299 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.997991    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 01:59:35.098299 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.997994    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 01:59:35.098299 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.997997    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 01:59:35.098299 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998001    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 01:59:35.098299 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998003    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 01:59:35.098299 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998006    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 01:59:35.071573 ip-10-0-137-63 systemd[1]: Started Kubernetes Kubelet.
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998010    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998013    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998015    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998018    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998021    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998023    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998026    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998029    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998031    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998034    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998036    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998039    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998042    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998045    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998054    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998057    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998060    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998063    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998066    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 01:59:35.099722 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998069    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998072    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998074    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998078    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998083    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998087    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998091    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998094    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998096    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998100    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998102    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998105    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998108    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998111    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998114    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998117    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998119    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998123    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998127    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 01:59:35.100931 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998131    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998134    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998138    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998141    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998144    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998147    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998150    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998153    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998156    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998159    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998161    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998164    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998167    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998171    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998176    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998178    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998181    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998185    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998187    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 01:59:35.102005 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998190    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998192    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998195    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998197    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998200    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998202    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998205    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998208    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998211    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998213    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998215    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998218    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998221    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998223    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998226    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998228    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998231    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998233    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998236    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998239    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 01:59:35.102858 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998241    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998244    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998246    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998249    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998252    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998254    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998257    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998261    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998264    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998267    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998270    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998273    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998275    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:34.998278    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000832    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000846    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000849    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000852    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000855    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 01:59:35.103953 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000860    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000863    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000866    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000868    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000871    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000874    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000876    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000880    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000883    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000886    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000888    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000891    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000894    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000896    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000898    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000901    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000904    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000907    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000911    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 01:59:35.104602 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000915    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000919    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000922    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000925    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000928    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000931    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000933    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000936    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000939    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000942    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000945    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000948    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000951    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000954    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000957    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000959    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000962    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000966    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000969    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000972    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 01:59:35.238138 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000975    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000977    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000980    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000982    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000986    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000988    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000991    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000993    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000996    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.000998    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001002    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001005    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001009    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001012    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001015    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001017    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001020    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001022    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001025    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 01:59:35.239359 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001027    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001030    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001033    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001036    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001039    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001041    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001044    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001046    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001050    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001053    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001056    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001059    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001061    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001064    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001066    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001070    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001072    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001075    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001077    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001080    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 01:59:35.240192 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001082    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001085    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001087    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001090    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001092    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001094    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001097    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001100    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001102    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001105    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001107    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001110    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001112    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001115    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001117    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001119    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001510    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001515    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001518    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001520    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 01:59:35.240979 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001523    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001527    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001530    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001533    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001536    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001539    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001541    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001544    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001546    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001549    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001551    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001570    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001573    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001576    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001579    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001581    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001584    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001586    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001589    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001592    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 01:59:35.241601 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001596    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001600    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001603    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001606    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001609    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001611    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001614    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001617    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001620    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001623    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001625    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001628    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001631    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001634    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001636    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001639    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001642    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001644    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001647    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001650    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 01:59:35.242418 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001652    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001655    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001658    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001660    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001663    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001665    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001668    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001670    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001673    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001675    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001678    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001681    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001683    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001687    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001690    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001692    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001695    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001698    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001701    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 01:59:35.242987 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001705    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001709    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001713    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001716    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001718    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001721    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001724    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001726    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001729    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001731    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001734    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001737    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001739    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001742    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001745    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001748    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001751    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001753    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001756    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 01:59:35.243593 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001760    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001763    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001766    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001768    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001771    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001773    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001776    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001778    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001781    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001783    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001786    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001788    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001791    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001793    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001796    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001799    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.001802    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001879    2556 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001886    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001893    2556 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001898    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 01:59:35.244112 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001903    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001907    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001912    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001916    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001920    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001923    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001927    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001930    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001933    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001936    2556 flags.go:64] FLAG: --cgroup-root=""
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001940    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001943    2556 flags.go:64] FLAG: --client-ca-file=""
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001946    2556 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001949    2556 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001953    2556 flags.go:64] FLAG: --cluster-domain=""
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001956    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001959    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001962    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001966    2556 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001970    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001973    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001976    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001979    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001985    2556 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 01:59:35.244730 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001988    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001991    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001994    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.001997    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002005    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002008    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002011    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002014    2556 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002017    2556 flags.go:64] FLAG: --enable-server="true"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002020    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002025    2556 flags.go:64] FLAG: --event-burst="100"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002029    2556 flags.go:64] FLAG: --event-qps="50"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002032    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002035    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002038    2556 flags.go:64] FLAG: --eviction-hard=""
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002042    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002045    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002048    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002051    2556 flags.go:64] FLAG: --eviction-soft=""
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002054    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002057    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002060    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002063    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002065    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002068    2556 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 01:59:35.245400 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002071    2556 flags.go:64] FLAG: --feature-gates=""
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002078    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002081    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002083    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002087    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002090    2556 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002094    2556 flags.go:64] FLAG: --help="false"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002097    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002100    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002103    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002106    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002111    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002115    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002118    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002121    2556 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002124    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002127    2556 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002130    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002133    2556 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002136    2556 flags.go:64] FLAG: --kube-reserved=""
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002138    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002141    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002145    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002147    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 01:59:35.246171 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002150    2556 flags.go:64] FLAG: --lock-file=""
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002153    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002156    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002159    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002164    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002167    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002170    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002173    2556 flags.go:64] FLAG: --logging-format="text"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002175    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002179    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002181    2556 flags.go:64] FLAG: --manifest-url=""
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002184    2556 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002189    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002192    2556 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002197    2556 flags.go:64] FLAG: --max-pods="110"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002200    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002203    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002206    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002209    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002213    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002216    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002220    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002227    2556 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002230    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002233    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 01:59:35.246865 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002236    2556 flags.go:64] FLAG: --pod-cidr=""
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002239    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002245    2556 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002247    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002251    2556 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002253    2556 flags.go:64] FLAG: --port="10250"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002256    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002259    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06ae648d61b282ecc"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002262    2556 flags.go:64] FLAG: --qos-reserved=""
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002265    2556 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002268    2556 flags.go:64] FLAG: --register-node="true"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002271    2556 flags.go:64] FLAG: --register-with-taints=""
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002274    2556 flags.go:64] FLAG: --registry-burst="10"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002278    2556 flags.go:64] FLAG: --registry-qps="5"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002280    2556 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002283    2556 flags.go:64] FLAG: --reserved-memory=""
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002287    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002290    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002293    2556 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002296    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002299    2556 flags.go:64] FLAG: --runonce="false"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002303    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002306    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002309    2556 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002312    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 01:59:35.247616 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002315    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002318    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002323    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002326    2556 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002329    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002333    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002336    2556 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002338    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002342    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002344    2556 flags.go:64] FLAG: --system-cgroups=""
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002347    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002362    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002365    2556 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002368    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002372    2556 flags.go:64] FLAG: --tls-min-version=""
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002375    2556 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002378    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002381    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002384    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002387    2556 flags.go:64] FLAG: --v="2"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002391    2556 flags.go:64] FLAG: --version="false"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002395    2556 flags.go:64] FLAG: --vmodule=""
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002399    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.002403    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002536    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 01:59:35.248343 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002540    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002543    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002546    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002551    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002567    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002571    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002574    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002577    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002579    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002583    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002586    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002588    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002592    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002594    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002597    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002600    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002602    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002606    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002610    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 01:59:35.249139 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002613    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002616    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002618    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002621    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002623    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002626    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002629    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002631    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002634    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002636    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002639    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002641    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002644    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002647    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002649    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002651    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002656    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002658    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002661    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002664    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002666    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 01:59:35.249694 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002669    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002673    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002675    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002678    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002681    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002684    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002687    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002689    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002693    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002697    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002699    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002702    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002705    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002707    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002710    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002713    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002715    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002718    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002721    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 01:59:35.250314 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002723    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002726    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002728    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002731    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002734    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002736    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002739    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002741    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002746    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002749    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002751    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002754    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002756    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002759    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002762    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002765    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002767    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002771    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002774    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002778    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 01:59:35.250888 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002781    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002783    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002786    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002789    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002791    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002794    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002796    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002799    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002802    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002804    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002807    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002809    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002812    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002814    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002817    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002819    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002822    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002825    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 01:59:35.251477 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.002827    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.003307    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.010500    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.010519    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.010539    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.010548    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010629    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010636    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010639    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010642    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010645    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010648    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010652    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010655    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010657    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 01:59:35.252319 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010660    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010663    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010666    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010668    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010671    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010673    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010676    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010679    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010682    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010686    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010690    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010693    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010695    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010698    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010701    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010704    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010707    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010710    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010712    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 01:59:35.252832 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010715    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010718    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010720    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010723    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010726    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010728    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010733    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010736    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010738    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010741    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010745    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010749    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010752    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010755    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010757    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010760    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010762    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010765    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010767    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 01:59:35.375236 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010770    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010773    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010775    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010778    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010781    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010784    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010786    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010788    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010798    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010804    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010807    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010809    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010812    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010815    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010817    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010820    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010823    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010825    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010827    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010830    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 01:59:35.376361 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010834    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010837    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010840    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010843    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010845    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010848    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010851    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010853    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010856    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010858    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010861    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010863    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010866    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010869    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010871    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010873    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010876    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010879    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010881    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010884    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 01:59:35.377090 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010889    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 01:59:35.377784 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010893    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 01:59:35.377784 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010895    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 01:59:35.377784 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010898    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 01:59:35.377784 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010900    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 01:59:35.377784 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010903    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 01:59:35.377784 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010905    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 01:59:35.377784 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010908    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 01:59:35.377784 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010910    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 01:59:35.377784 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010913    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 01:59:35.377784 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010917    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 01:59:35.377784 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.010920    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 01:59:35.377784 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.010926    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 01:59:35.377784 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011043    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 01:59:35.377784 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011047    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011050    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011053    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011056    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011058    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011060    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011063    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011065    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011068    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011070    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011073    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011075    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011078    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011081    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011083    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011087    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011090    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011094    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011098    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011101    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 01:59:35.378247 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011105    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011108    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011111    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011114    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011117    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011119    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011122    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011125    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011128    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011130    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011133    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011135    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011138    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011141    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011143    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011146    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011148    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011151    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011153    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011156    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 01:59:35.378980 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011158    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011161    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011163    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011166    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011168    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011171    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011173    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011175    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011178    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011181    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011185    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011188    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011191    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011194    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011196    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011199    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011202    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011204    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011207    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011210    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 01:59:35.379935 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011212    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011215    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011217    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011220    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011222    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011225    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011228    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011230    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011233    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011235    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011238    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011240    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011243    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011246    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011250    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011253    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011256    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011258    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011261    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 01:59:35.380920 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011263    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011266    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011268    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011272    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011275    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011279    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011282    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011285    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011287    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011290    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011292    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011295    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011298    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011300    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011303    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011305    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011308    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011310    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 01:59:35.381928 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:35.011313    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 01:59:35.382566 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.011319    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 01:59:35.382566 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.011448    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 01:59:35.382566 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.013698    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 01:59:35.382566 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.014905    2556 server.go:1019] "Starting client certificate rotation"
Jul 09 01:59:35.382566 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.015022    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 01:59:35.382566 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.015063    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 01:59:35.382566 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.017582    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 01:59:35.382566 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.019478    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 01:59:35.382566 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.028054    2556 log.go:25] "Validated CRI v1 runtime API"
Jul 09 01:59:35.382566 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.030070    2556 log.go:25] "Validated CRI v1 image API"
Jul 09 01:59:35.382566 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.033801    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 01:59:35.382566 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.036930    2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a9d6c070-0ca1-4739-ad4b-d728ce9b62de:/dev/nvme0n1p3 c4ef86f8-99b3-4f97-ab1f-8e1bfc69d69a:/dev/nvme0n1p4]
Jul 09 01:59:35.383019 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.036953    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 01:59:35.383235 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.042697    2556 manager.go:216] Machine: {Timestamp:2026-07-09 01:59:35.040774126 +0000 UTC m=+0.322698253 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100546 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e16366ee7b23c4e15787657cc1e45 SystemUUID:ec2e1636-6ee7-b23c-4e15-787657cc1e45 BootID:d884406f-eeb6-4405-8180-984c6f48670c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1c:28:7c:8e:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1c:28:7c:8e:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:2c:94:76:29:99 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 01:59:35.383235 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.042809    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 01:59:35.383235 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.042900    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 01:59:35.383235 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.045459    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 01:59:35.383235 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.045489    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-63.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 01:59:35.383235 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.046120    2556 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 01:59:35.383235 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.046133    2556 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 01:59:35.383235 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.046142    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.046657    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.047961    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.048320    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.051164    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.051276    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.051300    2556 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.051310    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.051324    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.051336    2556 kubelet.go:398] "Adding apiserver pod source"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.051346    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.051686    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.051700    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.055207    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.056990    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.057020    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.057984    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.058003    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.058013    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.058020    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.058035    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.058044    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.058057    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.058064    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.058082    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.058088    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.058097    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.058102    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.058844    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.058851    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.062240    2556 server.go:1268] "Started kubelet"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.062359    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.063657    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.071212    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.071604    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-63.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.072038    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.072299    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.072486    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 01:59:35.383909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.073086    2556 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.074948    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-63.ec2.internal.18c07c87c855bce9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-63.ec2.internal,UID:ip-10-0-137-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-63.ec2.internal,},FirstTimestamp:2026-07-09 01:59:35.062207721 +0000 UTC m=+0.344131848,LastTimestamp:2026-07-09 01:59:35.062207721 +0000 UTC m=+0.344131848,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-63.ec2.internal,}"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.076875    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.077904    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.077917    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.078033    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.078393    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.078676    2556 factory.go:55] Registering systemd factory
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.078690    2556 factory.go:223] Registration of the systemd container factory successfully
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.078985    2556 factory.go:153] Registering CRI-O factory
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.078999    2556 factory.go:223] Registration of the crio container factory successfully
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.079053    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.079073    2556 factory.go:103] Registering Raw factory
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.079089    2556 manager.go:1196] Started watching for new ooms in manager
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.078394    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.085332    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.085466    2556 manager.go:349] Starting recovery of all containers
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.085505    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.085634    2556 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.085641    2556 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.085647    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.096194    2556 manager.go:354] Recovery completed
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.103027    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s4f5v"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.103360    2556 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.106443    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.108617    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.108653    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.108668    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.109048    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s4f5v"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.109312    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.109321    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.109337    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 01:59:35.385277 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.109323    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.110598    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.110628    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.110641    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.111468    2556 policy_none.go:49] "None policy: Start"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.115922    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.115942    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.116842    2556 policy_none.go:47] "Start"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.178258    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.178368    2556 manager.go:337] "Starting Device Plugin manager"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.178502    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.178517    2556 server.go:87] "Starting device plugin registration server"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.178868    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.178883    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.178971    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.179063    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.179071    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.179483    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.179528    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.266217    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.267468    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.267515    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.267546    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.267605    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.270715    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.279373    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.280273    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.280300    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.280311    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.280334    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.291266    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.291287    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-63.ec2.internal\": node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.310917    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.369192    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"]
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.369293    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.370367    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.370406    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.370422    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID"
Jul 09 01:59:35.386463 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.371768    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.371874    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.371906    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.373026    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.373059    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.373070    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.373027    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.373137    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.373153    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.374436    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.374469    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.375232    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.375259    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.375272    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.387159    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44a0ff02708f1add4213dce3a52f0ee3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-63.ec2.internal\" (UID: \"44a0ff02708f1add4213dce3a52f0ee3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.387187    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40a951f151809df6c99c73af9f6eff51-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"40a951f151809df6c99c73af9f6eff51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.388080 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.387204    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a951f151809df6c99c73af9f6eff51-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"40a951f151809df6c99c73af9f6eff51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.574726 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.410725    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-63.ec2.internal\" not found" node="ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.574726 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.411670    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 09 01:59:35.574726 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.414498    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-63.ec2.internal\" not found" node="ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.574726 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.487298    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44a0ff02708f1add4213dce3a52f0ee3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-63.ec2.internal\" (UID: \"44a0ff02708f1add4213dce3a52f0ee3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.574726 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.487327    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40a951f151809df6c99c73af9f6eff51-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"40a951f151809df6c99c73af9f6eff51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.574726 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.487344    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a951f151809df6c99c73af9f6eff51-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"40a951f151809df6c99c73af9f6eff51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.574726 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.487396    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a951f151809df6c99c73af9f6eff51-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"40a951f151809df6c99c73af9f6eff51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.574726 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.487410    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44a0ff02708f1add4213dce3a52f0ee3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-63.ec2.internal\" (UID: \"44a0ff02708f1add4213dce3a52f0ee3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.574726 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.487421    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40a951f151809df6c99c73af9f6eff51-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"40a951f151809df6c99c73af9f6eff51\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.574726 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.511987    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 09 01:59:35.727112 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.613382    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 09 01:59:35.727112 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.714577    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 09 01:59:35.727112 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.714583    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.727112 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:35.716860    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:35.889215 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.816736    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 09 01:59:36.024250 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:35.917290    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found"
Jul 09 01:59:36.024250 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.007920    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 01:59:36.024250 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.014042    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 01:59:36.024250 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.014203    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 01:59:36.024250 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.014236    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.055506    2556 apiserver.go:52] "Watching apiserver"
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.078777    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.078792    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.080624    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.080989    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-n74tj","openshift-image-registry/node-ca-cdpsd","openshift-multus/multus-g9n5d","openshift-network-diagnostics/network-check-target-4dmzq","openshift-network-operator/iptables-alerter-9vrll","kube-system/global-pull-secret-syncer-kx7tj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987","openshift-multus/multus-additional-cni-plugins-kg24z","openshift-multus/network-metrics-daemon-wlfbh","openshift-ovn-kubernetes/ovnkube-node-zfstd","kube-system/konnectivity-agent-xfjj5","openshift-cluster-node-tuning-operator/tuned-x5c8j"]
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.082549    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n74tj"
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.083695    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cdpsd"
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.085369    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.086975    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.087067    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.087181    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fpc9q\""
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.087378    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.087400    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q6s9f\""
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.087415    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.087480    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.087539    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.087824    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.087962    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.088476    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.088661    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9vrll"
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.089063    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.089140    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tvzl4\""
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.089306    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.090114    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.091400    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.092630    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:36.135071 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.092690    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.093235    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.093313    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.093322    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.093829    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nrnww\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.094051    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xfjj5"
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.094465    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.094923    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.095410    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.095569    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8zsvj\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.095609    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.095753    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.095798    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.095821    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h8qrt\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.096242    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.096459    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.096504    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.098129    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"]
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.098217    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.098967    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xv9hb\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.099149    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.099401    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.099552    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.099646    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zht4s\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.099811    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.099984    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.100829    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.101008    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q4k4k\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.103594    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 01:59:36.136435 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.103655    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 01:59:36.137531 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.103831    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 01:59:36.137531 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.104873    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 01:59:36.137531 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.104875    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 01:59:36.137531 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.104986    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 01:59:36.137531 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.107238    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"]
Jul 09 01:59:36.137531 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.107446    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 01:59:36.137531 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.116171    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 01:54:35 +0000 UTC" deadline="2028-01-09 22:45:00.639413075 +0000 UTC"
Jul 09 01:59:36.137531 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.116215    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13196h45m24.523200563s"
Jul 09 01:59:36.137531 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.134465    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-54wgn"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.150596    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-54wgn"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.152857    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.179487    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192319    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40d9177f-2d6a-4990-b8ac-417ee517ff36-hosts-file\") pod \"node-resolver-n74tj\" (UID: \"40d9177f-2d6a-4990-b8ac-417ee517ff36\") " pod="openshift-dns/node-resolver-n74tj"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192344    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9de1d9a9-cefc-43b2-b797-5346946e4de9-env-overrides\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192367    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-var-lib-cni-multus\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192388    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2b29dd52-e1e1-49bc-afaa-18b386f78064-iptables-alerter-script\") pod \"iptables-alerter-9vrll\" (UID: \"2b29dd52-e1e1-49bc-afaa-18b386f78064\") " pod="openshift-network-operator/iptables-alerter-9vrll"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192405    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a067e2b9-6963-4744-92be-d8782714a2c6-tmp\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192422    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192441    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-run-k8s-cni-cncf-io\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192504    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-hostroot\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192619    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-lib-modules\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192650    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhb5p\" (UniqueName: \"kubernetes.io/projected/40d9177f-2d6a-4990-b8ac-417ee517ff36-kube-api-access-dhb5p\") pod \"node-resolver-n74tj\" (UID: \"40d9177f-2d6a-4990-b8ac-417ee517ff36\") " pod="openshift-dns/node-resolver-n74tj"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192674    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98774b45-19d2-428d-b024-489e2d14e26e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.271768 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192700    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwv7g\" (UniqueName: \"kubernetes.io/projected/a067e2b9-6963-4744-92be-d8782714a2c6-kube-api-access-bwv7g\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.273510 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192715    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-cni-bin\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.273510 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192733    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.273510 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192762    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64da29d7-e098-4a7e-ac29-f6e3ce5351ef-serviceca\") pod \"node-ca-cdpsd\" (UID: \"64da29d7-e098-4a7e-ac29-f6e3ce5351ef\") " pod="openshift-image-registry/node-ca-cdpsd"
Jul 09 01:59:36.273510 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192787    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvhts\" (UniqueName: \"kubernetes.io/projected/64da29d7-e098-4a7e-ac29-f6e3ce5351ef-kube-api-access-cvhts\") pod \"node-ca-cdpsd\" (UID: \"64da29d7-e098-4a7e-ac29-f6e3ce5351ef\") " pod="openshift-image-registry/node-ca-cdpsd"
Jul 09 01:59:36.273510 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192804    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a83d32a-3904-42c2-80da-1d858105cf17-cni-binary-copy\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.273510 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192821    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbtwt\" (UniqueName: \"kubernetes.io/projected/98774b45-19d2-428d-b024-489e2d14e26e-kube-api-access-zbtwt\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.273510 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192848    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-run-ovn\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.273510 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192863    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9de1d9a9-cefc-43b2-b797-5346946e4de9-ovnkube-script-lib\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.273510 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192877    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-sysconfig\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.273510 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192901    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-kubernetes\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.273510 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192918    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-dbus\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:36.273510 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192933    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40d9177f-2d6a-4990-b8ac-417ee517ff36-tmp-dir\") pod \"node-resolver-n74tj\" (UID: \"40d9177f-2d6a-4990-b8ac-417ee517ff36\") " pod="openshift-dns/node-resolver-n74tj"
Jul 09 01:59:36.273510 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192947    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-run-systemd\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.273510 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192962    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-var-lib-cni-bin\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.274458 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192981    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-systemd\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.274458 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.192997    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a067e2b9-6963-4744-92be-d8782714a2c6-etc-tuned\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.274458 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193012    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:36.274458 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193033    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.274458 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193063    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-socket-dir\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.274458 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193079    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-sys-fs\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.274458 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193095    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60d831a1-0634-4162-b4b6-1d46fcfda618-agent-certs\") pod \"konnectivity-agent-xfjj5\" (UID: \"60d831a1-0634-4162-b4b6-1d46fcfda618\") " pod="kube-system/konnectivity-agent-xfjj5"
Jul 09 01:59:36.274458 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193110    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-multus-cni-dir\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.274458 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193139    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-var-lib-openvswitch\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.274458 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193166    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-system-cni-dir\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.274458 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193182    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb8r9\" (UniqueName: \"kubernetes.io/projected/2b29dd52-e1e1-49bc-afaa-18b386f78064-kube-api-access-fb8r9\") pod \"iptables-alerter-9vrll\" (UID: \"2b29dd52-e1e1-49bc-afaa-18b386f78064\") " pod="openshift-network-operator/iptables-alerter-9vrll"
Jul 09 01:59:36.274458 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193200    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98774b45-19d2-428d-b024-489e2d14e26e-cnibin\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.274458 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193216    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-device-dir\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.275270 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193261    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfnbv\" (UniqueName: \"kubernetes.io/projected/caf1c4cb-d217-4e5b-b5db-915323e9dbee-kube-api-access-vfnbv\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.275270 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193305    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-systemd-units\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.275270 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193340    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-cni-netd\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.275270 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193385    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-etc-kubernetes\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.275270 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193416    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-modprobe-d\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.275270 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193448    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60d831a1-0634-4162-b4b6-1d46fcfda618-konnectivity-ca\") pod \"konnectivity-agent-xfjj5\" (UID: \"60d831a1-0634-4162-b4b6-1d46fcfda618\") " pod="kube-system/konnectivity-agent-xfjj5"
Jul 09 01:59:36.275270 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193483    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-kubelet\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.275270 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193507    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-log-socket\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.275270 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193533    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-cnibin\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.275270 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193557    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-run-netns\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.275270 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193599    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98774b45-19d2-428d-b024-489e2d14e26e-system-cni-dir\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.275270 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193624    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xncwl\" (UniqueName: \"kubernetes.io/projected/104dfc74-924d-4b73-8bd5-8e0302fd9650-kube-api-access-xncwl\") pod \"network-metrics-daemon-wlfbh\" (UID: \"104dfc74-924d-4b73-8bd5-8e0302fd9650\") " pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:36.275270 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193647    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-sysctl-d\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.275270 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193674    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcvw6\" (UniqueName: \"kubernetes.io/projected/9de1d9a9-cefc-43b2-b797-5346946e4de9-kube-api-access-xcvw6\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.276153 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193700    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-var-lib-kubelet\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.276153 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193724    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs\") pod \"network-metrics-daemon-wlfbh\" (UID: \"104dfc74-924d-4b73-8bd5-8e0302fd9650\") " pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:36.276153 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193747    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-host\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.276153 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193778    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-node-log\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.276153 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193800    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-os-release\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.276153 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193823    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-kubelet-config\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:36.276153 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193849    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-registration-dir\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.276153 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193870    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9de1d9a9-cefc-43b2-b797-5346946e4de9-ovn-node-metrics-cert\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.276153 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193886    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64da29d7-e098-4a7e-ac29-f6e3ce5351ef-host\") pod \"node-ca-cdpsd\" (UID: \"64da29d7-e098-4a7e-ac29-f6e3ce5351ef\") " pod="openshift-image-registry/node-ca-cdpsd"
Jul 09 01:59:36.276153 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193900    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-multus-socket-dir-parent\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.276153 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193958    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-multus-conf-dir\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.276153 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193974    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98774b45-19d2-428d-b024-489e2d14e26e-os-release\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.276153 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.193990    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-sysctl-conf\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.276153 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194025    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-run-netns\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.277079 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194055    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-run-openvswitch\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.277079 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194099    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98774b45-19d2-428d-b024-489e2d14e26e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.277079 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194123    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvlfz\" (UniqueName: \"kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz\") pod \"network-check-target-4dmzq\" (UID: \"b135662d-b8d8-4b4b-ae4f-c810a098793c\") " pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:36.277079 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194148    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-run-ovn-kubernetes\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.277079 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194181    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9de1d9a9-cefc-43b2-b797-5346946e4de9-ovnkube-config\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.277079 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194215    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b29dd52-e1e1-49bc-afaa-18b386f78064-host-slash\") pod \"iptables-alerter-9vrll\" (UID: \"2b29dd52-e1e1-49bc-afaa-18b386f78064\") " pod="openshift-network-operator/iptables-alerter-9vrll"
Jul 09 01:59:36.277079 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194241    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98774b45-19d2-428d-b024-489e2d14e26e-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.277079 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194268    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-var-lib-kubelet\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.277079 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194306    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-etc-openvswitch\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.277079 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194334    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a83d32a-3904-42c2-80da-1d858105cf17-multus-daemon-config\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.277079 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194359    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-run-multus-certs\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.277079 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194385    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrvsl\" (UniqueName: \"kubernetes.io/projected/1a83d32a-3904-42c2-80da-1d858105cf17-kube-api-access-hrvsl\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.277079 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194411    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98774b45-19d2-428d-b024-489e2d14e26e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.277973 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194435    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-run\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.277973 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194451    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-sys\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.277973 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.194470    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-slash\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.296100 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294669    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-kubelet-config\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:36.296100 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294701    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-registration-dir\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.296100 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294719    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9de1d9a9-cefc-43b2-b797-5346946e4de9-ovn-node-metrics-cert\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.296100 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294735    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64da29d7-e098-4a7e-ac29-f6e3ce5351ef-host\") pod \"node-ca-cdpsd\" (UID: \"64da29d7-e098-4a7e-ac29-f6e3ce5351ef\") " pod="openshift-image-registry/node-ca-cdpsd"
Jul 09 01:59:36.296100 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294754    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-multus-socket-dir-parent\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.296100 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294771    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-multus-conf-dir\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.296100 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294796    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98774b45-19d2-428d-b024-489e2d14e26e-os-release\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.296100 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294812    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-sysctl-conf\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.296100 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294830    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-run-netns\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.296100 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294852    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-run-openvswitch\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.296100 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294869    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98774b45-19d2-428d-b024-489e2d14e26e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.296100 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294886    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvlfz\" (UniqueName: \"kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz\") pod \"network-check-target-4dmzq\" (UID: \"b135662d-b8d8-4b4b-ae4f-c810a098793c\") " pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:36.296100 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294904    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-run-ovn-kubernetes\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.296100 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294928    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9de1d9a9-cefc-43b2-b797-5346946e4de9-ovnkube-config\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.297445 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294943    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b29dd52-e1e1-49bc-afaa-18b386f78064-host-slash\") pod \"iptables-alerter-9vrll\" (UID: \"2b29dd52-e1e1-49bc-afaa-18b386f78064\") " pod="openshift-network-operator/iptables-alerter-9vrll"
Jul 09 01:59:36.297445 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294958    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98774b45-19d2-428d-b024-489e2d14e26e-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.297445 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.294975    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-var-lib-kubelet\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.297445 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295000    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-etc-openvswitch\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.297445 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295017    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a83d32a-3904-42c2-80da-1d858105cf17-multus-daemon-config\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.297445 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295038    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-run-multus-certs\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.297445 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295054    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrvsl\" (UniqueName: \"kubernetes.io/projected/1a83d32a-3904-42c2-80da-1d858105cf17-kube-api-access-hrvsl\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.297445 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295069    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98774b45-19d2-428d-b024-489e2d14e26e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.297445 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295084    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-run\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.297445 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295099    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-sys\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.297445 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295114    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-slash\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.297445 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295133    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40d9177f-2d6a-4990-b8ac-417ee517ff36-hosts-file\") pod \"node-resolver-n74tj\" (UID: \"40d9177f-2d6a-4990-b8ac-417ee517ff36\") " pod="openshift-dns/node-resolver-n74tj"
Jul 09 01:59:36.297445 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295148    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9de1d9a9-cefc-43b2-b797-5346946e4de9-env-overrides\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.297445 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295165    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-var-lib-cni-multus\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.298333 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295180    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2b29dd52-e1e1-49bc-afaa-18b386f78064-iptables-alerter-script\") pod \"iptables-alerter-9vrll\" (UID: \"2b29dd52-e1e1-49bc-afaa-18b386f78064\") " pod="openshift-network-operator/iptables-alerter-9vrll"
Jul 09 01:59:36.298333 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295196    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a067e2b9-6963-4744-92be-d8782714a2c6-tmp\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.298333 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295211    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.298333 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295227    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-run-k8s-cni-cncf-io\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.298333 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295247    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-hostroot\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.298333 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295262    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-lib-modules\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.298333 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295303    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhb5p\" (UniqueName: \"kubernetes.io/projected/40d9177f-2d6a-4990-b8ac-417ee517ff36-kube-api-access-dhb5p\") pod \"node-resolver-n74tj\" (UID: \"40d9177f-2d6a-4990-b8ac-417ee517ff36\") " pod="openshift-dns/node-resolver-n74tj"
Jul 09 01:59:36.298333 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295321    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98774b45-19d2-428d-b024-489e2d14e26e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.298333 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295341    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwv7g\" (UniqueName: \"kubernetes.io/projected/a067e2b9-6963-4744-92be-d8782714a2c6-kube-api-access-bwv7g\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.298333 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295358    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-cni-bin\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.298333 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295375    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.298333 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295398    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64da29d7-e098-4a7e-ac29-f6e3ce5351ef-serviceca\") pod \"node-ca-cdpsd\" (UID: \"64da29d7-e098-4a7e-ac29-f6e3ce5351ef\") " pod="openshift-image-registry/node-ca-cdpsd"
Jul 09 01:59:36.298333 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295414    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvhts\" (UniqueName: \"kubernetes.io/projected/64da29d7-e098-4a7e-ac29-f6e3ce5351ef-kube-api-access-cvhts\") pod \"node-ca-cdpsd\" (UID: \"64da29d7-e098-4a7e-ac29-f6e3ce5351ef\") " pod="openshift-image-registry/node-ca-cdpsd"
Jul 09 01:59:36.298333 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295431    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a83d32a-3904-42c2-80da-1d858105cf17-cni-binary-copy\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.300131 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295449    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbtwt\" (UniqueName: \"kubernetes.io/projected/98774b45-19d2-428d-b024-489e2d14e26e-kube-api-access-zbtwt\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.300131 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295465    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-run-ovn\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.300131 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295487    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9de1d9a9-cefc-43b2-b797-5346946e4de9-ovnkube-script-lib\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.300131 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295505    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-sysconfig\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.300131 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295521    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-kubernetes\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.300131 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295537    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-dbus\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:36.300131 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295556    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40d9177f-2d6a-4990-b8ac-417ee517ff36-tmp-dir\") pod \"node-resolver-n74tj\" (UID: \"40d9177f-2d6a-4990-b8ac-417ee517ff36\") " pod="openshift-dns/node-resolver-n74tj"
Jul 09 01:59:36.300131 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295572    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-run-systemd\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.300131 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295589    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-var-lib-cni-bin\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.300131 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295607    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-systemd\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.300131 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295645    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a067e2b9-6963-4744-92be-d8782714a2c6-etc-tuned\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.300131 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295664    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:36.300131 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295685    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.300131 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295702    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-socket-dir\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.301037 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295718    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-sys-fs\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.301037 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295734    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60d831a1-0634-4162-b4b6-1d46fcfda618-agent-certs\") pod \"konnectivity-agent-xfjj5\" (UID: \"60d831a1-0634-4162-b4b6-1d46fcfda618\") " pod="kube-system/konnectivity-agent-xfjj5"
Jul 09 01:59:36.301037 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295751    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-multus-cni-dir\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.301037 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295767    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-var-lib-openvswitch\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.301037 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295784    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-system-cni-dir\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.301037 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295801    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb8r9\" (UniqueName: \"kubernetes.io/projected/2b29dd52-e1e1-49bc-afaa-18b386f78064-kube-api-access-fb8r9\") pod \"iptables-alerter-9vrll\" (UID: \"2b29dd52-e1e1-49bc-afaa-18b386f78064\") " pod="openshift-network-operator/iptables-alerter-9vrll"
Jul 09 01:59:36.301037 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295818    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98774b45-19d2-428d-b024-489e2d14e26e-cnibin\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.301037 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295835    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-device-dir\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.301037 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295854    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfnbv\" (UniqueName: \"kubernetes.io/projected/caf1c4cb-d217-4e5b-b5db-915323e9dbee-kube-api-access-vfnbv\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.301037 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295871    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-systemd-units\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.301037 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295889    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-cni-netd\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.301037 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295906    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-etc-kubernetes\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.301037 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295932    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-modprobe-d\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.301037 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295951    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60d831a1-0634-4162-b4b6-1d46fcfda618-konnectivity-ca\") pod \"konnectivity-agent-xfjj5\" (UID: \"60d831a1-0634-4162-b4b6-1d46fcfda618\") " pod="kube-system/konnectivity-agent-xfjj5"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295967    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-kubelet\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.295984    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-log-socket\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296000    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-cnibin\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296017    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-run-netns\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296034    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98774b45-19d2-428d-b024-489e2d14e26e-system-cni-dir\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296052    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xncwl\" (UniqueName: \"kubernetes.io/projected/104dfc74-924d-4b73-8bd5-8e0302fd9650-kube-api-access-xncwl\") pod \"network-metrics-daemon-wlfbh\" (UID: \"104dfc74-924d-4b73-8bd5-8e0302fd9650\") " pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296069    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-sysctl-d\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296086    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcvw6\" (UniqueName: \"kubernetes.io/projected/9de1d9a9-cefc-43b2-b797-5346946e4de9-kube-api-access-xcvw6\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296104    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-var-lib-kubelet\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296121    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs\") pod \"network-metrics-daemon-wlfbh\" (UID: \"104dfc74-924d-4b73-8bd5-8e0302fd9650\") " pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296137    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-host\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296155    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-node-log\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296173    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-os-release\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296286    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-os-release\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.416168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296428    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-kubelet-config\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296470    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-registration-dir\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.296844    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.300166    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9de1d9a9-cefc-43b2-b797-5346946e4de9-ovn-node-metrics-cert\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.300236    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64da29d7-e098-4a7e-ac29-f6e3ce5351ef-host\") pod \"node-ca-cdpsd\" (UID: \"64da29d7-e098-4a7e-ac29-f6e3ce5351ef\") " pod="openshift-image-registry/node-ca-cdpsd"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.300305    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-multus-socket-dir-parent\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.300338    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-multus-conf-dir\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.300378    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98774b45-19d2-428d-b024-489e2d14e26e-os-release\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.300448    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-sysctl-conf\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.300474    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-run-netns\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.300502    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-run-openvswitch\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.300968    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98774b45-19d2-428d-b024-489e2d14e26e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.301231    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-run-ovn-kubernetes\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.301650    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9de1d9a9-cefc-43b2-b797-5346946e4de9-ovnkube-config\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.301696    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2b29dd52-e1e1-49bc-afaa-18b386f78064-host-slash\") pod \"iptables-alerter-9vrll\" (UID: \"2b29dd52-e1e1-49bc-afaa-18b386f78064\") " pod="openshift-network-operator/iptables-alerter-9vrll"
Jul 09 01:59:36.417411 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.302431    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98774b45-19d2-428d-b024-489e2d14e26e-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.302483    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-var-lib-kubelet\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.302514    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-etc-openvswitch\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.302870    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a83d32a-3904-42c2-80da-1d858105cf17-multus-daemon-config\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.302909    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-run-multus-certs\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.303176    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98774b45-19d2-428d-b024-489e2d14e26e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.303220    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-run\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.303252    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-sys\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.303282    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-slash\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.303316    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/40d9177f-2d6a-4990-b8ac-417ee517ff36-hosts-file\") pod \"node-resolver-n74tj\" (UID: \"40d9177f-2d6a-4990-b8ac-417ee517ff36\") " pod="openshift-dns/node-resolver-n74tj"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.303558    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9de1d9a9-cefc-43b2-b797-5346946e4de9-env-overrides\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.303594    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-var-lib-cni-multus\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.303941    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2b29dd52-e1e1-49bc-afaa-18b386f78064-iptables-alerter-script\") pod \"iptables-alerter-9vrll\" (UID: \"2b29dd52-e1e1-49bc-afaa-18b386f78064\") " pod="openshift-network-operator/iptables-alerter-9vrll"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.305949    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a067e2b9-6963-4744-92be-d8782714a2c6-tmp\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.306048    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-etc-selinux\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.419255 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.306079    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-run-k8s-cni-cncf-io\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.306106    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-hostroot\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.306164    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-lib-modules\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.306671    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98774b45-19d2-428d-b024-489e2d14e26e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.306871    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-cni-bin\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.306908    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.307205    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64da29d7-e098-4a7e-ac29-f6e3ce5351ef-serviceca\") pod \"node-ca-cdpsd\" (UID: \"64da29d7-e098-4a7e-ac29-f6e3ce5351ef\") " pod="openshift-image-registry/node-ca-cdpsd"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.307682    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a83d32a-3904-42c2-80da-1d858105cf17-cni-binary-copy\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.307866    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-run-ovn\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.308206    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9de1d9a9-cefc-43b2-b797-5346946e4de9-ovnkube-script-lib\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.308253    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-sysconfig\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.308289    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-kubernetes\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.308369    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-dbus\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.308538    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40d9177f-2d6a-4990-b8ac-417ee517ff36-tmp-dir\") pod \"node-resolver-n74tj\" (UID: \"40d9177f-2d6a-4990-b8ac-417ee517ff36\") " pod="openshift-dns/node-resolver-n74tj"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.308570    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-run-systemd\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.420199 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.308596    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-var-lib-cni-bin\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.421115 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.308650    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-systemd\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.421115 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.310419    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a067e2b9-6963-4744-92be-d8782714a2c6-etc-tuned\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.421115 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.310494    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 01:59:36.421115 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.310542    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret podName:3049ceb1-0ae0-4e5f-8d1d-45ac6f563386 nodeName:}" failed. No retries permitted until 2026-07-09 01:59:36.810527086 +0000 UTC m=+2.092451202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret") pod "global-pull-secret-syncer-kx7tj" (UID: "3049ceb1-0ae0-4e5f-8d1d-45ac6f563386") : object "kube-system"/"original-pull-secret" not registered
Jul 09 01:59:36.421115 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.310735    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.421115 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.310817    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-socket-dir\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.421115 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.310854    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-sys-fs\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.421115 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.312876    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/60d831a1-0634-4162-b4b6-1d46fcfda618-agent-certs\") pod \"konnectivity-agent-xfjj5\" (UID: \"60d831a1-0634-4162-b4b6-1d46fcfda618\") " pod="kube-system/konnectivity-agent-xfjj5"
Jul 09 01:59:36.421115 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.312934    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-multus-cni-dir\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.421115 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.312966    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-var-lib-openvswitch\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.421115 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.313000    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-system-cni-dir\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.421115 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.313172    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98774b45-19d2-428d-b024-489e2d14e26e-cnibin\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.421115 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.313214    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/caf1c4cb-d217-4e5b-b5db-915323e9dbee-device-dir\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.421115 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.313365    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-systemd-units\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.313394    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-cni-netd\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.313428    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-etc-kubernetes\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.313497    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-modprobe-d\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.313862    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/60d831a1-0634-4162-b4b6-1d46fcfda618-konnectivity-ca\") pod \"konnectivity-agent-xfjj5\" (UID: \"60d831a1-0634-4162-b4b6-1d46fcfda618\") " pod="kube-system/konnectivity-agent-xfjj5"
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.313904    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-host-kubelet\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.313933    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-log-socket\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.313965    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-cnibin\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.313990    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-run-netns\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.314018    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98774b45-19d2-428d-b024-489e2d14e26e-system-cni-dir\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.314253    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-etc-sysctl-d\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.314402    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a83d32a-3904-42c2-80da-1d858105cf17-host-var-lib-kubelet\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.314466    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.314503    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs podName:104dfc74-924d-4b73-8bd5-8e0302fd9650 nodeName:}" failed. No retries permitted until 2026-07-09 01:59:36.814491 +0000 UTC m=+2.096415115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs") pod "network-metrics-daemon-wlfbh" (UID: "104dfc74-924d-4b73-8bd5-8e0302fd9650") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.314534    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a067e2b9-6963-4744-92be-d8782714a2c6-host\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.422056 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.314564    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9de1d9a9-cefc-43b2-b797-5346946e4de9-node-log\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.425810 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.323248    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrvsl\" (UniqueName: \"kubernetes.io/projected/1a83d32a-3904-42c2-80da-1d858105cf17-kube-api-access-hrvsl\") pod \"multus-g9n5d\" (UID: \"1a83d32a-3904-42c2-80da-1d858105cf17\") " pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.425810 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.325468    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhb5p\" (UniqueName: \"kubernetes.io/projected/40d9177f-2d6a-4990-b8ac-417ee517ff36-kube-api-access-dhb5p\") pod \"node-resolver-n74tj\" (UID: \"40d9177f-2d6a-4990-b8ac-417ee517ff36\") " pod="openshift-dns/node-resolver-n74tj"
Jul 09 01:59:36.425810 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.327546    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwv7g\" (UniqueName: \"kubernetes.io/projected/a067e2b9-6963-4744-92be-d8782714a2c6-kube-api-access-bwv7g\") pod \"tuned-x5c8j\" (UID: \"a067e2b9-6963-4744-92be-d8782714a2c6\") " pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:36.425810 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.327616    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 01:59:36.425810 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.327645    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 01:59:36.425810 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.327657    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zvlfz for pod openshift-network-diagnostics/network-check-target-4dmzq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:59:36.425810 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.327701    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz podName:b135662d-b8d8-4b4b-ae4f-c810a098793c nodeName:}" failed. No retries permitted until 2026-07-09 01:59:36.82768783 +0000 UTC m=+2.109611947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zvlfz" (UniqueName: "kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz") pod "network-check-target-4dmzq" (UID: "b135662d-b8d8-4b4b-ae4f-c810a098793c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:59:36.425810 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.331062    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcvw6\" (UniqueName: \"kubernetes.io/projected/9de1d9a9-cefc-43b2-b797-5346946e4de9-kube-api-access-xcvw6\") pod \"ovnkube-node-zfstd\" (UID: \"9de1d9a9-cefc-43b2-b797-5346946e4de9\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:36.425810 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.333120    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb8r9\" (UniqueName: \"kubernetes.io/projected/2b29dd52-e1e1-49bc-afaa-18b386f78064-kube-api-access-fb8r9\") pod \"iptables-alerter-9vrll\" (UID: \"2b29dd52-e1e1-49bc-afaa-18b386f78064\") " pod="openshift-network-operator/iptables-alerter-9vrll"
Jul 09 01:59:36.425810 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.333393    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xncwl\" (UniqueName: \"kubernetes.io/projected/104dfc74-924d-4b73-8bd5-8e0302fd9650-kube-api-access-xncwl\") pod \"network-metrics-daemon-wlfbh\" (UID: \"104dfc74-924d-4b73-8bd5-8e0302fd9650\") " pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:36.425810 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.335245    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfnbv\" (UniqueName: \"kubernetes.io/projected/caf1c4cb-d217-4e5b-b5db-915323e9dbee-kube-api-access-vfnbv\") pod \"aws-ebs-csi-driver-node-d9987\" (UID: \"caf1c4cb-d217-4e5b-b5db-915323e9dbee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.425810 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.335441    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbtwt\" (UniqueName: \"kubernetes.io/projected/98774b45-19d2-428d-b024-489e2d14e26e-kube-api-access-zbtwt\") pod \"multus-additional-cni-plugins-kg24z\" (UID: \"98774b45-19d2-428d-b024-489e2d14e26e\") " pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:36.425810 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.335448    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvhts\" (UniqueName: \"kubernetes.io/projected/64da29d7-e098-4a7e-ac29-f6e3ce5351ef-kube-api-access-cvhts\") pod \"node-ca-cdpsd\" (UID: \"64da29d7-e098-4a7e-ac29-f6e3ce5351ef\") " pod="openshift-image-registry/node-ca-cdpsd"
Jul 09 01:59:36.448567 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.446816    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cdpsd"
Jul 09 01:59:36.448567 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.446856    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n74tj"
Jul 09 01:59:36.567378 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.461827    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g9n5d"
Jul 09 01:59:36.567378 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.470945    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9vrll"
Jul 09 01:59:36.567378 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.494675    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987"
Jul 09 01:59:36.567378 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.543554    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 01:59:36.854250 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.850330    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:36.854250 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.850373    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs\") pod \"network-metrics-daemon-wlfbh\" (UID: \"104dfc74-924d-4b73-8bd5-8e0302fd9650\") " pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:36.854250 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.850472    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 01:59:36.854250 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.850530    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:59:36.854250 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.850534    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret podName:3049ceb1-0ae0-4e5f-8d1d-45ac6f563386 nodeName:}" failed. No retries permitted until 2026-07-09 01:59:37.850517712 +0000 UTC m=+3.132441828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret") pod "global-pull-secret-syncer-kx7tj" (UID: "3049ceb1-0ae0-4e5f-8d1d-45ac6f563386") : object "kube-system"/"original-pull-secret" not registered
Jul 09 01:59:36.854250 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.850602    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvlfz\" (UniqueName: \"kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz\") pod \"network-check-target-4dmzq\" (UID: \"b135662d-b8d8-4b4b-ae4f-c810a098793c\") " pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:36.854250 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.850673    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs podName:104dfc74-924d-4b73-8bd5-8e0302fd9650 nodeName:}" failed. No retries permitted until 2026-07-09 01:59:37.85064556 +0000 UTC m=+3.132569689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs") pod "network-metrics-daemon-wlfbh" (UID: "104dfc74-924d-4b73-8bd5-8e0302fd9650") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:59:36.854250 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.850729    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 01:59:36.854250 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.850749    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 01:59:36.854250 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.850762    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zvlfz for pod openshift-network-diagnostics/network-check-target-4dmzq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:59:36.854250 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:36.850821    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz podName:b135662d-b8d8-4b4b-ae4f-c810a098793c nodeName:}" failed. No retries permitted until 2026-07-09 01:59:37.850808699 +0000 UTC m=+3.132732822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvlfz" (UniqueName: "kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz") pod "network-check-target-4dmzq" (UID: "b135662d-b8d8-4b4b-ae4f-c810a098793c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:59:36.975433 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:36.895944    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 01:59:37.106922 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:37.106841    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kg24z"
Jul 09 01:59:37.124775 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:37.124750    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xfjj5"
Jul 09 01:59:37.140688 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:37.140661    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x5c8j"
Jul 09 01:59:37.146833 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:37.146814    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 01:59:37.152947 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:37.152908    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 01:54:36 +0000 UTC" deadline="2027-12-18 03:49:58.798460338 +0000 UTC"
Jul 09 01:59:37.152947 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:37.152938    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12649h50m21.645525422s"
Jul 09 01:59:37.244058 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:37.243998    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a951f151809df6c99c73af9f6eff51.slice/crio-adfb3466884cb0a1dde7fd3bbdb1339f1a7bb5f56bb86d1dfec64d999e133e1e WatchSource:0}: Error finding container adfb3466884cb0a1dde7fd3bbdb1339f1a7bb5f56bb86d1dfec64d999e133e1e: Status 404 returned error can't find the container with id adfb3466884cb0a1dde7fd3bbdb1339f1a7bb5f56bb86d1dfec64d999e133e1e
Jul 09 01:59:37.244454 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:37.244426    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a0ff02708f1add4213dce3a52f0ee3.slice/crio-5919d65021006208534ae47d3e4c888d1e45e16f76b1fa0eaf5effb67fe0ef03 WatchSource:0}: Error finding container 5919d65021006208534ae47d3e4c888d1e45e16f76b1fa0eaf5effb67fe0ef03: Status 404 returned error can't find the container with id 5919d65021006208534ae47d3e4c888d1e45e16f76b1fa0eaf5effb67fe0ef03
Jul 09 01:59:37.248630 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:37.248610    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 01:59:37.268876 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:37.268848    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:37.269035 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:37.268988    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 01:59:37.333779 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:37.333721    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" event={"ID":"44a0ff02708f1add4213dce3a52f0ee3","Type":"ContainerStarted","Data":"5919d65021006208534ae47d3e4c888d1e45e16f76b1fa0eaf5effb67fe0ef03"}
Jul 09 01:59:37.334801 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:37.334774    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" event={"ID":"40a951f151809df6c99c73af9f6eff51","Type":"ContainerStarted","Data":"adfb3466884cb0a1dde7fd3bbdb1339f1a7bb5f56bb86d1dfec64d999e133e1e"}
Jul 09 01:59:37.404468 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:37.404432    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d9177f_2d6a_4990_b8ac_417ee517ff36.slice/crio-1251b16d9288ba65e50a9fae917aa21bff36459b5352ffdc6d9f35f4daa240bc WatchSource:0}: Error finding container 1251b16d9288ba65e50a9fae917aa21bff36459b5352ffdc6d9f35f4daa240bc: Status 404 returned error can't find the container with id 1251b16d9288ba65e50a9fae917aa21bff36459b5352ffdc6d9f35f4daa240bc
Jul 09 01:59:37.486881 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:37.486841    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b29dd52_e1e1_49bc_afaa_18b386f78064.slice/crio-65359c67c017657475301b5b2a552ce19f2d5949929269a474ac71fd8a1a9533 WatchSource:0}: Error finding container 65359c67c017657475301b5b2a552ce19f2d5949929269a474ac71fd8a1a9533: Status 404 returned error can't find the container with id 65359c67c017657475301b5b2a552ce19f2d5949929269a474ac71fd8a1a9533
Jul 09 01:59:37.494568 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:37.494539    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64da29d7_e098_4a7e_ac29_f6e3ce5351ef.slice/crio-26acecdb74c7db1599e03867af0c73d4042a752f143c81323eeba95fec47629e WatchSource:0}: Error finding container 26acecdb74c7db1599e03867af0c73d4042a752f143c81323eeba95fec47629e: Status 404 returned error can't find the container with id 26acecdb74c7db1599e03867af0c73d4042a752f143c81323eeba95fec47629e
Jul 09 01:59:37.537082 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:37.537050    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98774b45_19d2_428d_b024_489e2d14e26e.slice/crio-a7996229162e8cbe9f8984b7d3e08aeddef6db7ea35637672e3571f3290175d1 WatchSource:0}: Error finding container a7996229162e8cbe9f8984b7d3e08aeddef6db7ea35637672e3571f3290175d1: Status 404 returned error can't find the container with id a7996229162e8cbe9f8984b7d3e08aeddef6db7ea35637672e3571f3290175d1
Jul 09 01:59:37.573223 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:37.573192    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf1c4cb_d217_4e5b_b5db_915323e9dbee.slice/crio-8eb13824320cf92b41efde5f70ab9d8c782feb1c2402d8ba5f566556c4107abb WatchSource:0}: Error finding container 8eb13824320cf92b41efde5f70ab9d8c782feb1c2402d8ba5f566556c4107abb: Status 404 returned error can't find the container with id 8eb13824320cf92b41efde5f70ab9d8c782feb1c2402d8ba5f566556c4107abb
Jul 09 01:59:37.578394 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:37.578369    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d831a1_0634_4162_b4b6_1d46fcfda618.slice/crio-d8e28391be0871225fe9ec75847132db93f68c351b1cdf9fd6f278cd2cdd3362 WatchSource:0}: Error finding container d8e28391be0871225fe9ec75847132db93f68c351b1cdf9fd6f278cd2cdd3362: Status 404 returned error can't find the container with id d8e28391be0871225fe9ec75847132db93f68c351b1cdf9fd6f278cd2cdd3362
Jul 09 01:59:37.579063 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:37.579040    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a83d32a_3904_42c2_80da_1d858105cf17.slice/crio-d61d8116961869e46be135743d2fe60114b50fd1d9d117d70bd3f69cb78b4cb5 WatchSource:0}: Error finding container d61d8116961869e46be135743d2fe60114b50fd1d9d117d70bd3f69cb78b4cb5: Status 404 returned error can't find the container with id d61d8116961869e46be135743d2fe60114b50fd1d9d117d70bd3f69cb78b4cb5
Jul 09 01:59:37.774153 ip-10-0-137-63 kubenswrapper[2556]: W0709 01:59:37.774104    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda067e2b9_6963_4744_92be_d8782714a2c6.slice/crio-83bc7e07eafd7cd924d1babc53c5eb7fb1d39e7c49a6ca845fb4aac8b569f6bd WatchSource:0}: Error finding container 83bc7e07eafd7cd924d1babc53c5eb7fb1d39e7c49a6ca845fb4aac8b569f6bd: Status 404 returned error can't find the container with id 83bc7e07eafd7cd924d1babc53c5eb7fb1d39e7c49a6ca845fb4aac8b569f6bd
Jul 09 01:59:37.862296 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:37.862214    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:37.862296 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:37.862284    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs\") pod \"network-metrics-daemon-wlfbh\" (UID: \"104dfc74-924d-4b73-8bd5-8e0302fd9650\") " pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:37.862556 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:37.862319    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvlfz\" (UniqueName: \"kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz\") pod \"network-check-target-4dmzq\" (UID: \"b135662d-b8d8-4b4b-ae4f-c810a098793c\") " pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:37.862556 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:37.862494    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 01:59:37.862556 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:37.862514    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 01:59:37.862556 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:37.862528    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zvlfz for pod openshift-network-diagnostics/network-check-target-4dmzq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:59:37.862830 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:37.862591    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz podName:b135662d-b8d8-4b4b-ae4f-c810a098793c nodeName:}" failed. No retries permitted until 2026-07-09 01:59:39.862572773 +0000 UTC m=+5.144496901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvlfz" (UniqueName: "kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz") pod "network-check-target-4dmzq" (UID: "b135662d-b8d8-4b4b-ae4f-c810a098793c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:59:37.863168 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:37.863043    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 01:59:37.863168 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:37.863052    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:59:37.863168 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:37.863114    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret podName:3049ceb1-0ae0-4e5f-8d1d-45ac6f563386 nodeName:}" failed. No retries permitted until 2026-07-09 01:59:39.863094701 +0000 UTC m=+5.145018835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret") pod "global-pull-secret-syncer-kx7tj" (UID: "3049ceb1-0ae0-4e5f-8d1d-45ac6f563386") : object "kube-system"/"original-pull-secret" not registered
Jul 09 01:59:37.863168 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:37.863135    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs podName:104dfc74-924d-4b73-8bd5-8e0302fd9650 nodeName:}" failed. No retries permitted until 2026-07-09 01:59:39.863124513 +0000 UTC m=+5.145048631 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs") pod "network-metrics-daemon-wlfbh" (UID: "104dfc74-924d-4b73-8bd5-8e0302fd9650") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:59:38.153514 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:38.153357    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 01:54:36 +0000 UTC" deadline="2028-04-12 03:00:01.69638103 +0000 UTC"
Jul 09 01:59:38.153514 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:38.153425    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15433h0m23.542961264s"
Jul 09 01:59:38.268685 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:38.268646    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:38.269015 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:38.268793    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 01:59:38.269283 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:38.269252    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:38.269400 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:38.269376    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 01:59:38.376520 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:38.376473    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd" event={"ID":"9de1d9a9-cefc-43b2-b797-5346946e4de9","Type":"ContainerStarted","Data":"bf9c24fbec8b36128d08927fb96f18a5ccb24a902d80f1fe141fd2756d044a02"}
Jul 09 01:59:38.385746 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:38.385507    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg24z" event={"ID":"98774b45-19d2-428d-b024-489e2d14e26e","Type":"ContainerStarted","Data":"a7996229162e8cbe9f8984b7d3e08aeddef6db7ea35637672e3571f3290175d1"}
Jul 09 01:59:38.398728 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:38.398675    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9vrll" event={"ID":"2b29dd52-e1e1-49bc-afaa-18b386f78064","Type":"ContainerStarted","Data":"65359c67c017657475301b5b2a552ce19f2d5949929269a474ac71fd8a1a9533"}
Jul 09 01:59:38.414078 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:38.413969    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xfjj5" event={"ID":"60d831a1-0634-4162-b4b6-1d46fcfda618","Type":"ContainerStarted","Data":"d8e28391be0871225fe9ec75847132db93f68c351b1cdf9fd6f278cd2cdd3362"}
Jul 09 01:59:38.426777 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:38.426735    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cdpsd" event={"ID":"64da29d7-e098-4a7e-ac29-f6e3ce5351ef","Type":"ContainerStarted","Data":"26acecdb74c7db1599e03867af0c73d4042a752f143c81323eeba95fec47629e"}
Jul 09 01:59:38.451909 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:38.451861    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n74tj" event={"ID":"40d9177f-2d6a-4990-b8ac-417ee517ff36","Type":"ContainerStarted","Data":"1251b16d9288ba65e50a9fae917aa21bff36459b5352ffdc6d9f35f4daa240bc"}
Jul 09 01:59:38.470825 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:38.470777    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x5c8j" event={"ID":"a067e2b9-6963-4744-92be-d8782714a2c6","Type":"ContainerStarted","Data":"83bc7e07eafd7cd924d1babc53c5eb7fb1d39e7c49a6ca845fb4aac8b569f6bd"}
Jul 09 01:59:38.485303 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:38.485229    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g9n5d" event={"ID":"1a83d32a-3904-42c2-80da-1d858105cf17","Type":"ContainerStarted","Data":"d61d8116961869e46be135743d2fe60114b50fd1d9d117d70bd3f69cb78b4cb5"}
Jul 09 01:59:38.505024 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:38.504982    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987" event={"ID":"caf1c4cb-d217-4e5b-b5db-915323e9dbee","Type":"ContainerStarted","Data":"8eb13824320cf92b41efde5f70ab9d8c782feb1c2402d8ba5f566556c4107abb"}
Jul 09 01:59:38.657495 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:38.657464    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 01:59:39.273903 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:39.273160    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:39.273903 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:39.273358    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 01:59:39.883174 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:39.883076    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs\") pod \"network-metrics-daemon-wlfbh\" (UID: \"104dfc74-924d-4b73-8bd5-8e0302fd9650\") " pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:39.883174 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:39.883143    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvlfz\" (UniqueName: \"kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz\") pod \"network-check-target-4dmzq\" (UID: \"b135662d-b8d8-4b4b-ae4f-c810a098793c\") " pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:39.883434 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:39.883203    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:39.883434 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:39.883347    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 01:59:39.883434 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:39.883425    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret podName:3049ceb1-0ae0-4e5f-8d1d-45ac6f563386 nodeName:}" failed. No retries permitted until 2026-07-09 01:59:43.883406793 +0000 UTC m=+9.165330923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret") pod "global-pull-secret-syncer-kx7tj" (UID: "3049ceb1-0ae0-4e5f-8d1d-45ac6f563386") : object "kube-system"/"original-pull-secret" not registered
Jul 09 01:59:39.884332 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:39.883878    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:59:39.884332 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:39.883936    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs podName:104dfc74-924d-4b73-8bd5-8e0302fd9650 nodeName:}" failed. No retries permitted until 2026-07-09 01:59:43.883921099 +0000 UTC m=+9.165845220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs") pod "network-metrics-daemon-wlfbh" (UID: "104dfc74-924d-4b73-8bd5-8e0302fd9650") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:59:39.884332 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:39.884025    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 01:59:39.884332 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:39.884040    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 01:59:39.884332 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:39.884053    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zvlfz for pod openshift-network-diagnostics/network-check-target-4dmzq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:59:39.884332 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:39.884089    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz podName:b135662d-b8d8-4b4b-ae4f-c810a098793c nodeName:}" failed. No retries permitted until 2026-07-09 01:59:43.884076979 +0000 UTC m=+9.166001095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvlfz" (UniqueName: "kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz") pod "network-check-target-4dmzq" (UID: "b135662d-b8d8-4b4b-ae4f-c810a098793c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:59:40.268168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:40.268076    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:40.268168 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:40.268126    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:40.268422 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:40.268243    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 01:59:40.268422 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:40.268387    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 01:59:41.269433 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:41.269389    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:41.269989 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:41.269541    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 01:59:42.268875 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:42.268831    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:42.269078 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:42.268877    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:42.269078 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:42.268991    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 01:59:42.269230 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:42.269130    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 01:59:43.268667 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:43.268637    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:43.269107 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:43.268769    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 01:59:43.917196 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:43.917142    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:43.917404 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:43.917226    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs\") pod \"network-metrics-daemon-wlfbh\" (UID: \"104dfc74-924d-4b73-8bd5-8e0302fd9650\") " pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:43.917404 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:43.917264    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvlfz\" (UniqueName: \"kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz\") pod \"network-check-target-4dmzq\" (UID: \"b135662d-b8d8-4b4b-ae4f-c810a098793c\") " pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:43.917525 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:43.917465    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 01:59:43.917525 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:43.917487    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 01:59:43.917525 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:43.917500    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zvlfz for pod openshift-network-diagnostics/network-check-target-4dmzq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:59:43.917703 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:43.917576    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz podName:b135662d-b8d8-4b4b-ae4f-c810a098793c nodeName:}" failed. No retries permitted until 2026-07-09 01:59:51.917541139 +0000 UTC m=+17.199465273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvlfz" (UniqueName: "kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz") pod "network-check-target-4dmzq" (UID: "b135662d-b8d8-4b4b-ae4f-c810a098793c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:59:43.917703 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:43.917657    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 01:59:43.917703 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:43.917694    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret podName:3049ceb1-0ae0-4e5f-8d1d-45ac6f563386 nodeName:}" failed. No retries permitted until 2026-07-09 01:59:51.917680918 +0000 UTC m=+17.199605039 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret") pod "global-pull-secret-syncer-kx7tj" (UID: "3049ceb1-0ae0-4e5f-8d1d-45ac6f563386") : object "kube-system"/"original-pull-secret" not registered
Jul 09 01:59:43.917864 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:43.917804    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:59:43.917864 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:43.917842    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs podName:104dfc74-924d-4b73-8bd5-8e0302fd9650 nodeName:}" failed. No retries permitted until 2026-07-09 01:59:51.917830781 +0000 UTC m=+17.199754907 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs") pod "network-metrics-daemon-wlfbh" (UID: "104dfc74-924d-4b73-8bd5-8e0302fd9650") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:59:44.268421 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:44.268335    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:44.268612 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:44.268345    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:44.268612 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:44.268482    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 01:59:44.269054 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:44.268605    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 01:59:45.271833 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:45.271796    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:45.272287 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:45.271919    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 01:59:46.269083 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:46.268608    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:46.269083 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:46.268741    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 01:59:46.269332 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:46.269092    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:46.269332 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:46.269196    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 01:59:47.268785 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:47.268747    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:47.269261 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:47.268889    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 01:59:48.268196 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:48.268167    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:48.268354 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:48.268169    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:48.268354 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:48.268266    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 01:59:48.268354 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:48.268339    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 01:59:49.268662 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:49.268627    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:49.269058 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:49.268757    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 01:59:50.268105 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:50.268065    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:50.268297 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:50.268186    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 01:59:50.268297 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:50.268228    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:50.268396 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:50.268300    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 01:59:51.268675 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:51.268639    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:51.269107 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:51.268776    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 01:59:51.978085 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:51.978042    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs\") pod \"network-metrics-daemon-wlfbh\" (UID: \"104dfc74-924d-4b73-8bd5-8e0302fd9650\") " pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:51.978085 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:51.978095    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvlfz\" (UniqueName: \"kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz\") pod \"network-check-target-4dmzq\" (UID: \"b135662d-b8d8-4b4b-ae4f-c810a098793c\") " pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:51.978347 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:51.978144    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:51.978347 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:51.978217    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:59:51.978347 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:51.978227    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 01:59:51.978347 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:51.978290    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs podName:104dfc74-924d-4b73-8bd5-8e0302fd9650 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:07.97827326 +0000 UTC m=+33.260197379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs") pod "network-metrics-daemon-wlfbh" (UID: "104dfc74-924d-4b73-8bd5-8e0302fd9650") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 01:59:51.978347 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:51.978295    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 01:59:51.978347 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:51.978322    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 01:59:51.978347 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:51.978335    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zvlfz for pod openshift-network-diagnostics/network-check-target-4dmzq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:59:51.978697 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:51.978305    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret podName:3049ceb1-0ae0-4e5f-8d1d-45ac6f563386 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:07.978299373 +0000 UTC m=+33.260223492 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret") pod "global-pull-secret-syncer-kx7tj" (UID: "3049ceb1-0ae0-4e5f-8d1d-45ac6f563386") : object "kube-system"/"original-pull-secret" not registered
Jul 09 01:59:51.978697 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:51.978384    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz podName:b135662d-b8d8-4b4b-ae4f-c810a098793c nodeName:}" failed. No retries permitted until 2026-07-09 02:00:07.97837204 +0000 UTC m=+33.260296156 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvlfz" (UniqueName: "kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz") pod "network-check-target-4dmzq" (UID: "b135662d-b8d8-4b4b-ae4f-c810a098793c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 01:59:52.268477 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:52.268383    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:52.268672 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:52.268383    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:52.268672 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:52.268531    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 01:59:52.268672 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:52.268637    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 01:59:53.268856 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:53.268820    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:53.269321 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:53.268954    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 01:59:54.268576 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:54.268064    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:54.268576 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:54.268250    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 01:59:54.268826 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:54.268703    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:54.270824 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:54.268885    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 01:59:55.268665 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:55.268630    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:55.268862 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:55.268735    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 01:59:56.267999 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:56.267928    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:56.267999 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:56.267968    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:56.268495 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:56.268064    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 01:59:56.268495 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:56.268196    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 01:59:57.268332 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:57.268296    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:57.268799 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:57.268419    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 01:59:58.269061 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:58.268747    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 01:59:58.269507 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:58.268805    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 01:59:58.269507 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:58.269186    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 01:59:58.269507 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:58.269207    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 01:59:58.559413 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:58.559381    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" event={"ID":"44a0ff02708f1add4213dce3a52f0ee3","Type":"ContainerStarted","Data":"7e747fea3b1ed6aad9eff0856df0a2b30b662c9cc451e202022830714a224b59"}
Jul 09 01:59:58.560871 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:58.560846    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x5c8j" event={"ID":"a067e2b9-6963-4744-92be-d8782714a2c6","Type":"ContainerStarted","Data":"5aea2c3a2dbf4c387bd4ca7815bf1ec43ae0c7b5d34fe9cd63981db9eda1ab47"}
Jul 09 01:59:58.562999 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:58.562975    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g9n5d" event={"ID":"1a83d32a-3904-42c2-80da-1d858105cf17","Type":"ContainerStarted","Data":"97a0fee5af8076e2a6d85bd564c4814f5d9111fc2e137b2df6ff6de1cec76423"}
Jul 09 01:59:58.565423 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:58.565396    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd" event={"ID":"9de1d9a9-cefc-43b2-b797-5346946e4de9","Type":"ContainerStarted","Data":"835eabd44536fef5e94b99aae9284f89905f9570b7bebbf2e976cb719c65f073"}
Jul 09 01:59:58.565525 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:58.565477    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd" event={"ID":"9de1d9a9-cefc-43b2-b797-5346946e4de9","Type":"ContainerStarted","Data":"1600465b1014a71e5133667ae54e53be78b5655f2fdbe15bd8a509fabd207e30"}
Jul 09 01:59:58.565609 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:58.565528    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd" event={"ID":"9de1d9a9-cefc-43b2-b797-5346946e4de9","Type":"ContainerStarted","Data":"d0000eca89df2b659078eb0f1b064f0c4e6ca8e0da5886d00a4e88fcaa8a4f12"}
Jul 09 01:59:58.565665 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:58.565615    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd" event={"ID":"9de1d9a9-cefc-43b2-b797-5346946e4de9","Type":"ContainerStarted","Data":"c5111cbe4a84c639d4768a1ec6dc118cbadccb293f4bd5d0068a805132868c9e"}
Jul 09 01:59:58.565665 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:58.565662    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd" event={"ID":"9de1d9a9-cefc-43b2-b797-5346946e4de9","Type":"ContainerStarted","Data":"f2e7fdf85d954fecd0ae352cd3cc41ab8c6d1fe153d7993251bc803c55b65442"}
Jul 09 01:59:58.577479 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:58.577432    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" podStartSLOduration=22.577417934 podStartE2EDuration="22.577417934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:59:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:59:58.577054591 +0000 UTC m=+23.858978772" watchObservedRunningTime="2026-07-09 01:59:58.577417934 +0000 UTC m=+23.859342070"
Jul 09 01:59:58.602150 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:58.602101    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x5c8j" podStartSLOduration=3.645554031 podStartE2EDuration="23.602083247s" totalImagesPullingTime="19.956529216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:59:58.601926692 +0000 UTC m=+23.883850828" watchObservedRunningTime="2026-07-09 01:59:58.602083247 +0000 UTC m=+23.884007383"
Jul 09 01:59:58.628585 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:58.628521    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g9n5d" podStartSLOduration=3.261155996 podStartE2EDuration="23.628506299s" totalImagesPullingTime="20.367350303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:59:58.628213365 +0000 UTC m=+23.910137502" watchObservedRunningTime="2026-07-09 01:59:58.628506299 +0000 UTC m=+23.910430457"
Jul 09 01:59:59.268671 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.268635    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 01:59:59.268839 ip-10-0-137-63 kubenswrapper[2556]: E0709 01:59:59.268761    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 01:59:59.569415 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.569336    2556 generic.go:356] "Generic (PLEG): container finished" podID="40a951f151809df6c99c73af9f6eff51" containerID="5a4976caf8ea9df90d97c321b18207496f4fd1e1c5c6897a4dc3655a0df0e129" exitCode=0
Jul 09 01:59:59.569994 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.569420    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" event={"ID":"40a951f151809df6c99c73af9f6eff51","Type":"ContainerDied","Data":"5a4976caf8ea9df90d97c321b18207496f4fd1e1c5c6897a4dc3655a0df0e129"}
Jul 09 01:59:59.570947 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.570917    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987" event={"ID":"caf1c4cb-d217-4e5b-b5db-915323e9dbee","Type":"ContainerStarted","Data":"e98d3a97a352d980cea288d50e338e09bac1b77df29b4739c12b9112bee8b882"}
Jul 09 01:59:59.573722 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.573693    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd" event={"ID":"9de1d9a9-cefc-43b2-b797-5346946e4de9","Type":"ContainerStarted","Data":"b0fd8079b37551b27434b3a9743dc1a4d6daab0236838c2724f68bdee7a03692"}
Jul 09 01:59:59.575135 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.575110    2556 generic.go:356] "Generic (PLEG): container finished" podID="98774b45-19d2-428d-b024-489e2d14e26e" containerID="4462dc241767d289fcfe2f448c5e125d19c1f4198b06813a1e97737be502d680" exitCode=0
Jul 09 01:59:59.575230 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.575178    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg24z" event={"ID":"98774b45-19d2-428d-b024-489e2d14e26e","Type":"ContainerDied","Data":"4462dc241767d289fcfe2f448c5e125d19c1f4198b06813a1e97737be502d680"}
Jul 09 01:59:59.576660 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.576639    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9vrll" event={"ID":"2b29dd52-e1e1-49bc-afaa-18b386f78064","Type":"ContainerStarted","Data":"6cf27e08e7474df5b6a21f168f34bf0de44673090d4664b211fc1dc929bb4787"}
Jul 09 01:59:59.578010 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.577993    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xfjj5" event={"ID":"60d831a1-0634-4162-b4b6-1d46fcfda618","Type":"ContainerStarted","Data":"b17c8976b864236d4ef2a1bff9ae593de42c8f18b4e156911537f5c80525408b"}
Jul 09 01:59:59.579396 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.579361    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cdpsd" event={"ID":"64da29d7-e098-4a7e-ac29-f6e3ce5351ef","Type":"ContainerStarted","Data":"38f91599d241a59ccad3e639e0b08b93dc73220d86b10931b01781416e1a8a36"}
Jul 09 01:59:59.580512 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.580488    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n74tj" event={"ID":"40d9177f-2d6a-4990-b8ac-417ee517ff36","Type":"ContainerStarted","Data":"54b7327602480d1c43b7acffe72a7e9b1665e4022dc79a714d4bef023d5ca2f0"}
Jul 09 01:59:59.636913 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.636607    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cdpsd" podStartSLOduration=4.193746887 podStartE2EDuration="24.636583175s" totalImagesPullingTime="20.442836288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:59:59.613597618 +0000 UTC m=+24.895521755" watchObservedRunningTime="2026-07-09 01:59:59.636583175 +0000 UTC m=+24.918507313"
Jul 09 01:59:59.637191 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.637150    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9vrll" podStartSLOduration=4.394133056 podStartE2EDuration="24.637133136s" totalImagesPullingTime="20.24300008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:59:59.63486443 +0000 UTC m=+24.916788602" watchObservedRunningTime="2026-07-09 01:59:59.637133136 +0000 UTC m=+24.919057273"
Jul 09 01:59:59.697881 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.697818    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xfjj5" podStartSLOduration=4.543010568 podStartE2EDuration="24.697784161s" totalImagesPullingTime="20.154773593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:59:59.69764428 +0000 UTC m=+24.979568417" watchObservedRunningTime="2026-07-09 01:59:59.697784161 +0000 UTC m=+24.979708298"
Jul 09 01:59:59.715239 ip-10-0-137-63 kubenswrapper[2556]: I0709 01:59:59.715175    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n74tj" podStartSLOduration=4.1744092 podStartE2EDuration="24.715152961s" totalImagesPullingTime="20.540743761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 01:59:59.714725994 +0000 UTC m=+24.996650131" watchObservedRunningTime="2026-07-09 01:59:59.715152961 +0000 UTC m=+24.997077099"
Jul 09 02:00:00.268087 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:00.268050    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 02:00:00.268087 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:00.268079    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 02:00:00.268288 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:00.268188    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 02:00:00.268352 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:00.268301    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 02:00:00.376384 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:00.376346    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 02:00:00.584950 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:00.584866    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" event={"ID":"40a951f151809df6c99c73af9f6eff51","Type":"ContainerStarted","Data":"05e16be5600d3a1c7a2f77da3c03700e7446a1e0675604c450cfe5b2c673ae9d"}
Jul 09 02:00:00.586915 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:00.586882    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987" event={"ID":"caf1c4cb-d217-4e5b-b5db-915323e9dbee","Type":"ContainerStarted","Data":"1ffdb7865b89cd7c0ba9abbc34c170215d85583ef6ed915a68692025a1a26829"}
Jul 09 02:00:00.607274 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:00.607219    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" podStartSLOduration=24.607203617 podStartE2EDuration="24.607203617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:59:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:00.605464476 +0000 UTC m=+25.887388625" watchObservedRunningTime="2026-07-09 02:00:00.607203617 +0000 UTC m=+25.889127752"
Jul 09 02:00:01.195046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:01.194922    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T02:00:00.376376249Z","UUID":"93f6cc49-b227-49df-8687-759da1395e8e","Handler":null,"Name":"","Endpoint":""}
Jul 09 02:00:01.196720 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:01.196697    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 02:00:01.196869 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:01.196743    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 02:00:01.268385 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:01.268348    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 02:00:01.268540 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:01.268492    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 02:00:01.591038 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:01.590989    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987" event={"ID":"caf1c4cb-d217-4e5b-b5db-915323e9dbee","Type":"ContainerStarted","Data":"ac28b93f36c30f6da3c1cbfe454fcd7bd8029ace601662699963b8747b4ff18d"}
Jul 09 02:00:01.593903 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:01.593870    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd" event={"ID":"9de1d9a9-cefc-43b2-b797-5346946e4de9","Type":"ContainerStarted","Data":"9ef5e9398ff9154f07561ecdd23f276d6a59609bf02e04b6bcd7b563037cf61d"}
Jul 09 02:00:01.609119 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:01.609064    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d9987" podStartSLOduration=3.708714745 podStartE2EDuration="26.609049188s" totalImagesPullingTime="22.900334443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:59:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:01.60887188 +0000 UTC m=+26.890796016" watchObservedRunningTime="2026-07-09 02:00:01.609049188 +0000 UTC m=+26.890973324"
Jul 09 02:00:02.268464 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:02.268418    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 02:00:02.268693 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:02.268418    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 02:00:02.268693 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:02.268590    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 02:00:02.268693 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:02.268646    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 02:00:03.268541 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:03.268360    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 02:00:03.268541 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:03.268489    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 02:00:03.891998 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:03.891957    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xfjj5"
Jul 09 02:00:03.892660 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:03.892642    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xfjj5"
Jul 09 02:00:04.268119 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:04.267929    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 02:00:04.268242 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:04.267970    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 02:00:04.268242 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:04.268205    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 02:00:04.268359 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:04.268309    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 02:00:04.605110 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:04.605077    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd" event={"ID":"9de1d9a9-cefc-43b2-b797-5346946e4de9","Type":"ContainerStarted","Data":"f23567d756a64dfe7d5d351f1c466135edbcc23e2bfe44c62ceec3259c9e2758"}
Jul 09 02:00:04.605904 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:04.605337    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 02:00:04.606997 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:04.606973    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg24z" event={"ID":"98774b45-19d2-428d-b024-489e2d14e26e","Type":"ContainerStarted","Data":"6654af06957de21bd6d48f15172a83167c40002520d47f2e7b1a9fa586b19401"}
Jul 09 02:00:04.607313 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:04.607266    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xfjj5"
Jul 09 02:00:04.607658 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:04.607641    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xfjj5"
Jul 09 02:00:04.620989 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:04.620964    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 02:00:04.639452 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:04.639401    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd" podStartSLOduration=8.199968204 podStartE2EDuration="28.639384577s" totalImagesPullingTime="20.439416373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:04.638005127 +0000 UTC m=+29.919929263" watchObservedRunningTime="2026-07-09 02:00:04.639384577 +0000 UTC m=+29.921308713"
Jul 09 02:00:05.269071 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:05.269039    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 02:00:05.269256 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:05.269122    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 02:00:05.610739 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:05.610703    2556 generic.go:356] "Generic (PLEG): container finished" podID="98774b45-19d2-428d-b024-489e2d14e26e" containerID="6654af06957de21bd6d48f15172a83167c40002520d47f2e7b1a9fa586b19401" exitCode=0
Jul 09 02:00:05.611322 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:05.610797    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg24z" event={"ID":"98774b45-19d2-428d-b024-489e2d14e26e","Type":"ContainerDied","Data":"6654af06957de21bd6d48f15172a83167c40002520d47f2e7b1a9fa586b19401"}
Jul 09 02:00:05.611888 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:05.611590    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 02:00:05.611888 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:05.611648    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 02:00:05.627100 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:05.627074    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 02:00:06.268677 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:06.268630    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 02:00:06.268677 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:06.268662    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 02:00:06.268957 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:06.268755    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 02:00:06.268957 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:06.268878    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 02:00:06.527916 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:06.527615    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kx7tj"]
Jul 09 02:00:06.528449 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:06.528425    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4dmzq"]
Jul 09 02:00:06.528546 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:06.528538    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 02:00:06.529153 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:06.528845    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 02:00:06.530178 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:06.530153    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wlfbh"]
Jul 09 02:00:06.615386 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:06.615352    2556 generic.go:356] "Generic (PLEG): container finished" podID="98774b45-19d2-428d-b024-489e2d14e26e" containerID="82f8392c19c546cbe74e04c4c46c1935900d8a63ab08f4003259312b5ff8bde3" exitCode=0
Jul 09 02:00:06.615879 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:06.615455    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg24z" event={"ID":"98774b45-19d2-428d-b024-489e2d14e26e","Type":"ContainerDied","Data":"82f8392c19c546cbe74e04c4c46c1935900d8a63ab08f4003259312b5ff8bde3"}
Jul 09 02:00:06.615879 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:06.615486    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 02:00:06.615879 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:06.615676    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 02:00:06.616516 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:06.616062    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 02:00:06.616516 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:06.616169    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 02:00:07.620303 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:07.620269    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg24z" event={"ID":"98774b45-19d2-428d-b024-489e2d14e26e","Type":"ContainerStarted","Data":"d1f9c13d34455dfe3f934c61460cc140d42f371d8d92706e7f38543e16a202ba"}
Jul 09 02:00:07.998144 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:07.998106    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvlfz\" (UniqueName: \"kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz\") pod \"network-check-target-4dmzq\" (UID: \"b135662d-b8d8-4b4b-ae4f-c810a098793c\") " pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 02:00:07.998328 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:07.998159    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 02:00:07.998328 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:07.998183    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs\") pod \"network-metrics-daemon-wlfbh\" (UID: \"104dfc74-924d-4b73-8bd5-8e0302fd9650\") " pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 02:00:07.998328 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:07.998272    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 02:00:07.998328 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:07.998277    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 02:00:07.998328 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:07.998297    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 02:00:07.998328 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:07.998304    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 02:00:07.998515 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:07.998335    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs podName:104dfc74-924d-4b73-8bd5-8e0302fd9650 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:39.998311777 +0000 UTC m=+65.280235895 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs") pod "network-metrics-daemon-wlfbh" (UID: "104dfc74-924d-4b73-8bd5-8e0302fd9650") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 02:00:07.998515 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:07.998307    2556 projected.go:196] Error preparing data for projected volume kube-api-access-zvlfz for pod openshift-network-diagnostics/network-check-target-4dmzq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 02:00:07.998515 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:07.998347    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret podName:3049ceb1-0ae0-4e5f-8d1d-45ac6f563386 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:39.998341803 +0000 UTC m=+65.280265916 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret") pod "global-pull-secret-syncer-kx7tj" (UID: "3049ceb1-0ae0-4e5f-8d1d-45ac6f563386") : object "kube-system"/"original-pull-secret" not registered
Jul 09 02:00:07.998515 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:07.998371    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz podName:b135662d-b8d8-4b4b-ae4f-c810a098793c nodeName:}" failed. No retries permitted until 2026-07-09 02:00:39.998356307 +0000 UTC m=+65.280280420 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zvlfz" (UniqueName: "kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz") pod "network-check-target-4dmzq" (UID: "b135662d-b8d8-4b4b-ae4f-c810a098793c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 02:00:08.267976 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:08.267941    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 02:00:08.268154 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:08.267951    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 02:00:08.268154 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:08.268069    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 02:00:08.268154 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:08.268111    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 02:00:08.268313 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:08.268182    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 02:00:08.268313 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:08.268232    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 02:00:08.624876 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:08.624836    2556 generic.go:356] "Generic (PLEG): container finished" podID="98774b45-19d2-428d-b024-489e2d14e26e" containerID="d1f9c13d34455dfe3f934c61460cc140d42f371d8d92706e7f38543e16a202ba" exitCode=0
Jul 09 02:00:08.625239 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:08.624892    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg24z" event={"ID":"98774b45-19d2-428d-b024-489e2d14e26e","Type":"ContainerDied","Data":"d1f9c13d34455dfe3f934c61460cc140d42f371d8d92706e7f38543e16a202ba"}
Jul 09 02:00:10.268110 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.268075    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 02:00:10.268589 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.268078    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 02:00:10.268589 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.268207    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 02:00:10.268589 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:10.268185    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlfbh" podUID="104dfc74-924d-4b73-8bd5-8e0302fd9650"
Jul 09 02:00:10.268589 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:10.268294    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dmzq" podUID="b135662d-b8d8-4b4b-ae4f-c810a098793c"
Jul 09 02:00:10.268589 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:10.268387    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kx7tj" podUID="3049ceb1-0ae0-4e5f-8d1d-45ac6f563386"
Jul 09 02:00:10.515203 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.515172    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeReady"
Jul 09 02:00:10.515362 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.515325    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 02:00:10.568992 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.568911    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-78qpz"]
Jul 09 02:00:10.570724 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.570703    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:10.573420 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.573383    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 02:00:10.573530 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.573428    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 02:00:10.573530 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.573451    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8nxtt\""
Jul 09 02:00:10.574785 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.574762    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c2zmt"]
Jul 09 02:00:10.576917 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.576872    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c2zmt"
Jul 09 02:00:10.579650 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.579628    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 02:00:10.580186 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.579789    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 02:00:10.580186 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.579839    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dnxq9\""
Jul 09 02:00:10.580186 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.579997    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 02:00:10.592961 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.592940    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-78qpz"]
Jul 09 02:00:10.599979 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.599955    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c2zmt"]
Jul 09 02:00:10.717533 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.717493    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae01695f-2f46-422a-b1e4-f37db3b443a4-tmp-dir\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:10.717726 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.717543    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ae01695f-2f46-422a-b1e4-f37db3b443a4-config-volume\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:10.717726 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.717644    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:10.717726 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.717672    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pb85\" (UniqueName: \"kubernetes.io/projected/ae01695f-2f46-422a-b1e4-f37db3b443a4-kube-api-access-8pb85\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:10.717726 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.717692    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e9eb0f3-26c6-4d68-83ab-7995d58ca644-cert\") pod \"ingress-canary-c2zmt\" (UID: \"4e9eb0f3-26c6-4d68-83ab-7995d58ca644\") " pod="openshift-ingress-canary/ingress-canary-c2zmt"
Jul 09 02:00:10.717726 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.717712    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v26vn\" (UniqueName: \"kubernetes.io/projected/4e9eb0f3-26c6-4d68-83ab-7995d58ca644-kube-api-access-v26vn\") pod \"ingress-canary-c2zmt\" (UID: \"4e9eb0f3-26c6-4d68-83ab-7995d58ca644\") " pod="openshift-ingress-canary/ingress-canary-c2zmt"
Jul 09 02:00:10.818814 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.818773    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae01695f-2f46-422a-b1e4-f37db3b443a4-tmp-dir\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:10.818814 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.818816    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ae01695f-2f46-422a-b1e4-f37db3b443a4-config-volume\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:10.819095 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.818991    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:10.819095 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.819025    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pb85\" (UniqueName: \"kubernetes.io/projected/ae01695f-2f46-422a-b1e4-f37db3b443a4-kube-api-access-8pb85\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:10.819095 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.819050    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e9eb0f3-26c6-4d68-83ab-7995d58ca644-cert\") pod \"ingress-canary-c2zmt\" (UID: \"4e9eb0f3-26c6-4d68-83ab-7995d58ca644\") " pod="openshift-ingress-canary/ingress-canary-c2zmt"
Jul 09 02:00:10.819095 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.819075    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v26vn\" (UniqueName: \"kubernetes.io/projected/4e9eb0f3-26c6-4d68-83ab-7995d58ca644-kube-api-access-v26vn\") pod \"ingress-canary-c2zmt\" (UID: \"4e9eb0f3-26c6-4d68-83ab-7995d58ca644\") " pod="openshift-ingress-canary/ingress-canary-c2zmt"
Jul 09 02:00:10.819308 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:10.819122    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 02:00:10.819308 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:10.819190    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls podName:ae01695f-2f46-422a-b1e4-f37db3b443a4 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:11.319165587 +0000 UTC m=+36.601089714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls") pod "dns-default-78qpz" (UID: "ae01695f-2f46-422a-b1e4-f37db3b443a4") : secret "dns-default-metrics-tls" not found
Jul 09 02:00:10.819308 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.819270    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae01695f-2f46-422a-b1e4-f37db3b443a4-tmp-dir\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:10.819527 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.819509    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ae01695f-2f46-422a-b1e4-f37db3b443a4-config-volume\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:10.823870 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.823848    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e9eb0f3-26c6-4d68-83ab-7995d58ca644-cert\") pod \"ingress-canary-c2zmt\" (UID: \"4e9eb0f3-26c6-4d68-83ab-7995d58ca644\") " pod="openshift-ingress-canary/ingress-canary-c2zmt"
Jul 09 02:00:10.831238 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.831211    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pb85\" (UniqueName: \"kubernetes.io/projected/ae01695f-2f46-422a-b1e4-f37db3b443a4-kube-api-access-8pb85\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:10.831372 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.831315    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v26vn\" (UniqueName: \"kubernetes.io/projected/4e9eb0f3-26c6-4d68-83ab-7995d58ca644-kube-api-access-v26vn\") pod \"ingress-canary-c2zmt\" (UID: \"4e9eb0f3-26c6-4d68-83ab-7995d58ca644\") " pod="openshift-ingress-canary/ingress-canary-c2zmt"
Jul 09 02:00:10.890469 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:10.890430    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c2zmt"
Jul 09 02:00:11.064506 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:11.064469    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c2zmt"]
Jul 09 02:00:11.069168 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:00:11.069114    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e9eb0f3_26c6_4d68_83ab_7995d58ca644.slice/crio-59f6e9a61ea2ab731587a093fd068f0a987eb892af9ac4e6dd22a0be7ef52a03 WatchSource:0}: Error finding container 59f6e9a61ea2ab731587a093fd068f0a987eb892af9ac4e6dd22a0be7ef52a03: Status 404 returned error can't find the container with id 59f6e9a61ea2ab731587a093fd068f0a987eb892af9ac4e6dd22a0be7ef52a03
Jul 09 02:00:11.323444 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:11.323356    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:11.324047 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:11.323528    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 02:00:11.324047 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:11.323616    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls podName:ae01695f-2f46-422a-b1e4-f37db3b443a4 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:12.323595966 +0000 UTC m=+37.605520081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls") pod "dns-default-78qpz" (UID: "ae01695f-2f46-422a-b1e4-f37db3b443a4") : secret "dns-default-metrics-tls" not found
Jul 09 02:00:11.633153 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:11.633122    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c2zmt" event={"ID":"4e9eb0f3-26c6-4d68-83ab-7995d58ca644","Type":"ContainerStarted","Data":"59f6e9a61ea2ab731587a093fd068f0a987eb892af9ac4e6dd22a0be7ef52a03"}
Jul 09 02:00:12.268158 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.268126    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 02:00:12.268350 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.268126    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 02:00:12.268422 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.268132    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 02:00:12.273049 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.272980    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 02:00:12.273049 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.273025    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 02:00:12.273049 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.273044    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pmqn4\""
Jul 09 02:00:12.273297 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.272980    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j65lj\""
Jul 09 02:00:12.273355 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.273331    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 02:00:12.273404 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.273331    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 02:00:12.331339 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.331307    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:12.331954 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:12.331446    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 02:00:12.331954 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:12.331512    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls podName:ae01695f-2f46-422a-b1e4-f37db3b443a4 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:14.331496992 +0000 UTC m=+39.613421106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls") pod "dns-default-78qpz" (UID: "ae01695f-2f46-422a-b1e4-f37db3b443a4") : secret "dns-default-metrics-tls" not found
Jul 09 02:00:12.676520 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.676023    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gkckl"]
Jul 09 02:00:12.678287 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.678263    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:12.681946 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.681636    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 02:00:12.681946 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.681722    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 02:00:12.681946 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.681782    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 02:00:12.681946 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.681852    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 02:00:12.682861 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.682841    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vfnrl\""
Jul 09 02:00:12.690965 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.690939    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gkckl"]
Jul 09 02:00:12.835837 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.835803    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/317fcb0a-ceea-4776-946e-e49985272b65-crio-socket\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:12.835837 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.835838    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/317fcb0a-ceea-4776-946e-e49985272b65-data-volume\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:12.836064 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.835919    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsx9m\" (UniqueName: \"kubernetes.io/projected/317fcb0a-ceea-4776-946e-e49985272b65-kube-api-access-nsx9m\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:12.836064 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.835956    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:12.836064 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.835980    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:12.936601 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.936493    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/317fcb0a-ceea-4776-946e-e49985272b65-crio-socket\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:12.936601 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.936547    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/317fcb0a-ceea-4776-946e-e49985272b65-data-volume\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:12.936812 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.936718    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsx9m\" (UniqueName: \"kubernetes.io/projected/317fcb0a-ceea-4776-946e-e49985272b65-kube-api-access-nsx9m\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:12.936812 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.936768    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:12.936812 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.936803    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:12.936948 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.936814    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/317fcb0a-ceea-4776-946e-e49985272b65-crio-socket\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:12.936948 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:12.936890    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 02:00:12.936948 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:12.936929    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 02:00:12.937081 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:12.936958    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm podName:317fcb0a-ceea-4776-946e-e49985272b65 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:13.436939474 +0000 UTC m=+38.718863592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gkckl" (UID: "317fcb0a-ceea-4776-946e-e49985272b65") : configmap "kube-rbac-proxy" not found
Jul 09 02:00:12.937081 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:12.936982    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls podName:317fcb0a-ceea-4776-946e-e49985272b65 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:13.436965124 +0000 UTC m=+38.718889257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkckl" (UID: "317fcb0a-ceea-4776-946e-e49985272b65") : secret "insights-runtime-extractor-tls" not found
Jul 09 02:00:12.937081 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.936987    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/317fcb0a-ceea-4776-946e-e49985272b65-data-volume\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:12.948175 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:12.948151    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsx9m\" (UniqueName: \"kubernetes.io/projected/317fcb0a-ceea-4776-946e-e49985272b65-kube-api-access-nsx9m\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:13.441217 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:13.441176    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:13.441752 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:13.441315    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 02:00:13.441752 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:13.441328    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:13.441752 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:13.441389    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm podName:317fcb0a-ceea-4776-946e-e49985272b65 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:14.441368641 +0000 UTC m=+39.723292759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gkckl" (UID: "317fcb0a-ceea-4776-946e-e49985272b65") : configmap "kube-rbac-proxy" not found
Jul 09 02:00:13.441752 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:13.441440    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 02:00:13.441752 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:13.441492    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls podName:317fcb0a-ceea-4776-946e-e49985272b65 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:14.441478571 +0000 UTC m=+39.723402710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkckl" (UID: "317fcb0a-ceea-4776-946e-e49985272b65") : secret "insights-runtime-extractor-tls" not found
Jul 09 02:00:14.349170 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:14.348992    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:14.349318 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:14.349143    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 02:00:14.349318 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:14.349298    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls podName:ae01695f-2f46-422a-b1e4-f37db3b443a4 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:18.349277672 +0000 UTC m=+43.631201791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls") pod "dns-default-78qpz" (UID: "ae01695f-2f46-422a-b1e4-f37db3b443a4") : secret "dns-default-metrics-tls" not found
Jul 09 02:00:14.450102 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:14.450069    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:14.450433 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:14.450116    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:14.450433 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:14.450190    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 02:00:14.450433 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:14.450213    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 02:00:14.450433 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:14.450262    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm podName:317fcb0a-ceea-4776-946e-e49985272b65 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:16.450236714 +0000 UTC m=+41.732160853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gkckl" (UID: "317fcb0a-ceea-4776-946e-e49985272b65") : configmap "kube-rbac-proxy" not found
Jul 09 02:00:14.450433 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:14.450276    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls podName:317fcb0a-ceea-4776-946e-e49985272b65 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:16.450269934 +0000 UTC m=+41.732194048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkckl" (UID: "317fcb0a-ceea-4776-946e-e49985272b65") : secret "insights-runtime-extractor-tls" not found
Jul 09 02:00:14.467652 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:14.467530    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n74tj_40d9177f-2d6a-4990-b8ac-417ee517ff36/dns-node-resolver/0.log"
Jul 09 02:00:14.641224 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:14.641188    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c2zmt" event={"ID":"4e9eb0f3-26c6-4d68-83ab-7995d58ca644","Type":"ContainerStarted","Data":"35afc045f6bcf7d505ea0a340df8898675e26f547fa68de0dab2f22ff245b033"}
Jul 09 02:00:14.643958 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:14.643931    2556 generic.go:356] "Generic (PLEG): container finished" podID="98774b45-19d2-428d-b024-489e2d14e26e" containerID="13850679f6a29a22b5c6ebd78e12f39b696f2a77bbb919d17f58a7ebfee4ee21" exitCode=0
Jul 09 02:00:14.644109 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:14.643968    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg24z" event={"ID":"98774b45-19d2-428d-b024-489e2d14e26e","Type":"ContainerDied","Data":"13850679f6a29a22b5c6ebd78e12f39b696f2a77bbb919d17f58a7ebfee4ee21"}
Jul 09 02:00:14.697504 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:14.697438    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c2zmt" podStartSLOduration=1.5510820939999999 podStartE2EDuration="4.697420183s" totalImagesPullingTime="3.146338089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:00:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:14.661299285 +0000 UTC m=+39.943223421" watchObservedRunningTime="2026-07-09 02:00:14.697420183 +0000 UTC m=+39.979344318"
Jul 09 02:00:14.863111 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:14.863086    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cdpsd_64da29d7-e098-4a7e-ac29-f6e3ce5351ef/node-ca/0.log"
Jul 09 02:00:15.649151 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:15.649122    2556 generic.go:356] "Generic (PLEG): container finished" podID="98774b45-19d2-428d-b024-489e2d14e26e" containerID="9a3a2ac5c55431a5c0c507f41e715a6e272710f5e75d43d1cf647bdac237405a" exitCode=0
Jul 09 02:00:15.649508 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:15.649200    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg24z" event={"ID":"98774b45-19d2-428d-b024-489e2d14e26e","Type":"ContainerDied","Data":"9a3a2ac5c55431a5c0c507f41e715a6e272710f5e75d43d1cf647bdac237405a"}
Jul 09 02:00:15.865378 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:15.865348    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c2zmt_4e9eb0f3-26c6-4d68-83ab-7995d58ca644/serve-healthcheck-canary/0.log"
Jul 09 02:00:16.465542 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:16.465503    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:16.465542 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:16.465545    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:16.465757 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:16.465627    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 02:00:16.465757 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:16.465679    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm podName:317fcb0a-ceea-4776-946e-e49985272b65 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:20.465665111 +0000 UTC m=+45.747589226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gkckl" (UID: "317fcb0a-ceea-4776-946e-e49985272b65") : configmap "kube-rbac-proxy" not found
Jul 09 02:00:16.465828 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:16.465763    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 02:00:16.465828 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:16.465817    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls podName:317fcb0a-ceea-4776-946e-e49985272b65 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:20.465804008 +0000 UTC m=+45.747728140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkckl" (UID: "317fcb0a-ceea-4776-946e-e49985272b65") : secret "insights-runtime-extractor-tls" not found
Jul 09 02:00:16.654989 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:16.654951    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg24z" event={"ID":"98774b45-19d2-428d-b024-489e2d14e26e","Type":"ContainerStarted","Data":"994001ddea8c4095a5e5668045188bbc5d076aea19bac1fa5d66baa9ab8c8d0e"}
Jul 09 02:00:16.685599 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:16.685529    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kg24z" podStartSLOduration=9.249078064 podStartE2EDuration="41.685510651s" totalImagesPullingTime="32.436432587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:59:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:16.68007706 +0000 UTC m=+41.962001193" watchObservedRunningTime="2026-07-09 02:00:16.685510651 +0000 UTC m=+41.967434825"
Jul 09 02:00:18.380931 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:18.380894    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:18.381262 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:18.381034    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 02:00:18.381262 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:18.381092    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls podName:ae01695f-2f46-422a-b1e4-f37db3b443a4 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:26.381075039 +0000 UTC m=+51.662999161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls") pod "dns-default-78qpz" (UID: "ae01695f-2f46-422a-b1e4-f37db3b443a4") : secret "dns-default-metrics-tls" not found
Jul 09 02:00:19.888935 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:19.888900    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-x67nt"]
Jul 09 02:00:19.914042 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:19.914013    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-x67nt"]
Jul 09 02:00:19.914178 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:19.914109    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-x67nt"
Jul 09 02:00:19.917568 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:19.917532    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 09 02:00:19.917568 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:19.917532    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 09 02:00:19.918452 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:19.918437    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bc4wt\""
Jul 09 02:00:19.918517 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:19.918498    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 09 02:00:19.918592 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:19.918527    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 09 02:00:19.993957 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:19.993923    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6b69997-8585-452a-8d46-912c8bb2b4ef-signing-cabundle\") pod \"service-ca-758f599c5-x67nt\" (UID: \"c6b69997-8585-452a-8d46-912c8bb2b4ef\") " pod="openshift-service-ca/service-ca-758f599c5-x67nt"
Jul 09 02:00:19.993957 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:19.993966    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6b69997-8585-452a-8d46-912c8bb2b4ef-signing-key\") pod \"service-ca-758f599c5-x67nt\" (UID: \"c6b69997-8585-452a-8d46-912c8bb2b4ef\") " pod="openshift-service-ca/service-ca-758f599c5-x67nt"
Jul 09 02:00:19.994213 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:19.994048    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qd77\" (UniqueName: \"kubernetes.io/projected/c6b69997-8585-452a-8d46-912c8bb2b4ef-kube-api-access-5qd77\") pod \"service-ca-758f599c5-x67nt\" (UID: \"c6b69997-8585-452a-8d46-912c8bb2b4ef\") " pod="openshift-service-ca/service-ca-758f599c5-x67nt"
Jul 09 02:00:20.094997 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:20.094953    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qd77\" (UniqueName: \"kubernetes.io/projected/c6b69997-8585-452a-8d46-912c8bb2b4ef-kube-api-access-5qd77\") pod \"service-ca-758f599c5-x67nt\" (UID: \"c6b69997-8585-452a-8d46-912c8bb2b4ef\") " pod="openshift-service-ca/service-ca-758f599c5-x67nt"
Jul 09 02:00:20.095191 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:20.095162    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6b69997-8585-452a-8d46-912c8bb2b4ef-signing-cabundle\") pod \"service-ca-758f599c5-x67nt\" (UID: \"c6b69997-8585-452a-8d46-912c8bb2b4ef\") " pod="openshift-service-ca/service-ca-758f599c5-x67nt"
Jul 09 02:00:20.095260 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:20.095215    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6b69997-8585-452a-8d46-912c8bb2b4ef-signing-key\") pod \"service-ca-758f599c5-x67nt\" (UID: \"c6b69997-8585-452a-8d46-912c8bb2b4ef\") " pod="openshift-service-ca/service-ca-758f599c5-x67nt"
Jul 09 02:00:20.095954 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:20.095932    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6b69997-8585-452a-8d46-912c8bb2b4ef-signing-cabundle\") pod \"service-ca-758f599c5-x67nt\" (UID: \"c6b69997-8585-452a-8d46-912c8bb2b4ef\") " pod="openshift-service-ca/service-ca-758f599c5-x67nt"
Jul 09 02:00:20.098586 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:20.098551    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6b69997-8585-452a-8d46-912c8bb2b4ef-signing-key\") pod \"service-ca-758f599c5-x67nt\" (UID: \"c6b69997-8585-452a-8d46-912c8bb2b4ef\") " pod="openshift-service-ca/service-ca-758f599c5-x67nt"
Jul 09 02:00:20.106233 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:20.106206    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qd77\" (UniqueName: \"kubernetes.io/projected/c6b69997-8585-452a-8d46-912c8bb2b4ef-kube-api-access-5qd77\") pod \"service-ca-758f599c5-x67nt\" (UID: \"c6b69997-8585-452a-8d46-912c8bb2b4ef\") " pod="openshift-service-ca/service-ca-758f599c5-x67nt"
Jul 09 02:00:20.223668 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:20.223582    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-x67nt"
Jul 09 02:00:20.368196 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:20.368166    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-x67nt"]
Jul 09 02:00:20.371345 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:00:20.371318    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b69997_8585_452a_8d46_912c8bb2b4ef.slice/crio-697707230dc7943aadf659c635e67783896fabc8c9be5ae3ed8c216b388de0c0 WatchSource:0}: Error finding container 697707230dc7943aadf659c635e67783896fabc8c9be5ae3ed8c216b388de0c0: Status 404 returned error can't find the container with id 697707230dc7943aadf659c635e67783896fabc8c9be5ae3ed8c216b388de0c0
Jul 09 02:00:20.498449 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:20.498354    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:20.498449 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:20.498398    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:20.498663 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:20.498524    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 02:00:20.498663 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:20.498597    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 02:00:20.498663 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:20.498625    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls podName:317fcb0a-ceea-4776-946e-e49985272b65 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:28.498603142 +0000 UTC m=+53.780527260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkckl" (UID: "317fcb0a-ceea-4776-946e-e49985272b65") : secret "insights-runtime-extractor-tls" not found
Jul 09 02:00:20.498663 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:20.498641    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm podName:317fcb0a-ceea-4776-946e-e49985272b65 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:28.498634165 +0000 UTC m=+53.780558279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gkckl" (UID: "317fcb0a-ceea-4776-946e-e49985272b65") : configmap "kube-rbac-proxy" not found
Jul 09 02:00:20.664593 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:20.664543    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-x67nt" event={"ID":"c6b69997-8585-452a-8d46-912c8bb2b4ef","Type":"ContainerStarted","Data":"697707230dc7943aadf659c635e67783896fabc8c9be5ae3ed8c216b388de0c0"}
Jul 09 02:00:23.673484 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:23.673444    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-x67nt" event={"ID":"c6b69997-8585-452a-8d46-912c8bb2b4ef","Type":"ContainerStarted","Data":"eaf0144702eed10f7696cdd536771c4775e77153e34034504079f13704a9fe34"}
Jul 09 02:00:23.691741 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:23.691682    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-x67nt" podStartSLOduration=1.952436038 podStartE2EDuration="4.691664987s" totalImagesPullingTime="2.739228949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:23.690899512 +0000 UTC m=+48.972823648" watchObservedRunningTime="2026-07-09 02:00:23.691664987 +0000 UTC m=+48.973589164"
Jul 09 02:00:26.449262 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:26.449226    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:26.449664 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:26.449375    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 02:00:26.449664 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:26.449440    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls podName:ae01695f-2f46-422a-b1e4-f37db3b443a4 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:42.449422887 +0000 UTC m=+67.731347005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls") pod "dns-default-78qpz" (UID: "ae01695f-2f46-422a-b1e4-f37db3b443a4") : secret "dns-default-metrics-tls" not found
Jul 09 02:00:28.565902 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:28.565858    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:28.566467 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:28.565993    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:28.566467 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:28.566121    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 02:00:28.566467 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:28.566240    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls podName:317fcb0a-ceea-4776-946e-e49985272b65 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:44.566220623 +0000 UTC m=+69.848144736 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkckl" (UID: "317fcb0a-ceea-4776-946e-e49985272b65") : secret "insights-runtime-extractor-tls" not found
Jul 09 02:00:28.566467 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:28.566381    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317fcb0a-ceea-4776-946e-e49985272b65-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:37.631399 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:37.631368    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfstd"
Jul 09 02:00:40.048008 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.047978    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 02:00:40.048463 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.048022    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs\") pod \"network-metrics-daemon-wlfbh\" (UID: \"104dfc74-924d-4b73-8bd5-8e0302fd9650\") " pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 02:00:40.048463 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.048052    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvlfz\" (UniqueName: \"kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz\") pod \"network-check-target-4dmzq\" (UID: \"b135662d-b8d8-4b4b-ae4f-c810a098793c\") " pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 02:00:40.050670 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.050638    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 02:00:40.051726 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.051710    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 02:00:40.051792 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.051715    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 02:00:40.061213 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.061190    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3049ceb1-0ae0-4e5f-8d1d-45ac6f563386-original-pull-secret\") pod \"global-pull-secret-syncer-kx7tj\" (UID: \"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386\") " pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 02:00:40.061213 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.061207    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104dfc74-924d-4b73-8bd5-8e0302fd9650-metrics-certs\") pod \"network-metrics-daemon-wlfbh\" (UID: \"104dfc74-924d-4b73-8bd5-8e0302fd9650\") " pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 02:00:40.061814 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.061796    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 02:00:40.071515 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.071478    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvlfz\" (UniqueName: \"kubernetes.io/projected/b135662d-b8d8-4b4b-ae4f-c810a098793c-kube-api-access-zvlfz\") pod \"network-check-target-4dmzq\" (UID: \"b135662d-b8d8-4b4b-ae4f-c810a098793c\") " pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 02:00:40.182074 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.182045    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kx7tj"
Jul 09 02:00:40.193279 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.193258    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pmqn4\""
Jul 09 02:00:40.199399 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.199378    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j65lj\""
Jul 09 02:00:40.200405 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.200390    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlfbh"
Jul 09 02:00:40.207264 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.207202    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 02:00:40.327812 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.327776    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kx7tj"]
Jul 09 02:00:40.331964 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:00:40.331939    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3049ceb1_0ae0_4e5f_8d1d_45ac6f563386.slice/crio-a970009e694797b2946e1071c3ee1028c1ace604ec3bd0f1f8f7cca14a948c96 WatchSource:0}: Error finding container a970009e694797b2946e1071c3ee1028c1ace604ec3bd0f1f8f7cca14a948c96: Status 404 returned error can't find the container with id a970009e694797b2946e1071c3ee1028c1ace604ec3bd0f1f8f7cca14a948c96
Jul 09 02:00:40.345490 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.345465    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wlfbh"]
Jul 09 02:00:40.348354 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:00:40.348321    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod104dfc74_924d_4b73_8bd5_8e0302fd9650.slice/crio-f1776f6301f7adff171dc9bc9f51a4a79b8184f2ed25320655a9a5c119f1dea4 WatchSource:0}: Error finding container f1776f6301f7adff171dc9bc9f51a4a79b8184f2ed25320655a9a5c119f1dea4: Status 404 returned error can't find the container with id f1776f6301f7adff171dc9bc9f51a4a79b8184f2ed25320655a9a5c119f1dea4
Jul 09 02:00:40.364278 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.364250    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4dmzq"]
Jul 09 02:00:40.367893 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:00:40.367866    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb135662d_b8d8_4b4b_ae4f_c810a098793c.slice/crio-c446df2ee7b898c7164b2e2b90f02a3c790a6c875b3190cbe33c49cfd3a3f960 WatchSource:0}: Error finding container c446df2ee7b898c7164b2e2b90f02a3c790a6c875b3190cbe33c49cfd3a3f960: Status 404 returned error can't find the container with id c446df2ee7b898c7164b2e2b90f02a3c790a6c875b3190cbe33c49cfd3a3f960
Jul 09 02:00:40.714849 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.714811    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kx7tj" event={"ID":"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386","Type":"ContainerStarted","Data":"a970009e694797b2946e1071c3ee1028c1ace604ec3bd0f1f8f7cca14a948c96"}
Jul 09 02:00:40.715866 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.715836    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4dmzq" event={"ID":"b135662d-b8d8-4b4b-ae4f-c810a098793c","Type":"ContainerStarted","Data":"c446df2ee7b898c7164b2e2b90f02a3c790a6c875b3190cbe33c49cfd3a3f960"}
Jul 09 02:00:40.716923 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:40.716900    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wlfbh" event={"ID":"104dfc74-924d-4b73-8bd5-8e0302fd9650","Type":"ContainerStarted","Data":"f1776f6301f7adff171dc9bc9f51a4a79b8184f2ed25320655a9a5c119f1dea4"}
Jul 09 02:00:42.467596 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:42.467539    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:42.470287 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:42.470261    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae01695f-2f46-422a-b1e4-f37db3b443a4-metrics-tls\") pod \"dns-default-78qpz\" (UID: \"ae01695f-2f46-422a-b1e4-f37db3b443a4\") " pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:42.686785 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:42.686755    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8nxtt\""
Jul 09 02:00:42.694278 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:42.694247    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:42.724918 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:42.724707    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wlfbh" event={"ID":"104dfc74-924d-4b73-8bd5-8e0302fd9650","Type":"ContainerStarted","Data":"12b92b9e68758a66deda6f32abffebab3fafd399d046a38b0274466218aee691"}
Jul 09 02:00:42.724918 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:42.724777    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wlfbh" event={"ID":"104dfc74-924d-4b73-8bd5-8e0302fd9650","Type":"ContainerStarted","Data":"5c75971cc2d2ed8010e557ad3d68c10c102ec89315460c697c75f888b74d5849"}
Jul 09 02:00:42.745212 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:42.745150    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wlfbh" podStartSLOduration=66.444680837 podStartE2EDuration="1m7.745131182s" totalImagesPullingTime="1.300450345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:42.74426487 +0000 UTC m=+68.026189012" watchObservedRunningTime="2026-07-09 02:00:42.745131182 +0000 UTC m=+68.027055317"
Jul 09 02:00:44.215641 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.215599    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-684444465d-tbvst"]
Jul 09 02:00:44.237934 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.237664    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"]
Jul 09 02:00:44.238126 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.238022    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.240630 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.240592    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 02:00:44.241133 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.241101    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 02:00:44.241536 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.241517    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hmfxw\""
Jul 09 02:00:44.244478 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.244449    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 02:00:44.248700 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.248678    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 02:00:44.253820 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.253794    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8fbfc87b-smv55"]
Jul 09 02:00:44.253989 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.253965    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"
Jul 09 02:00:44.258199 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.258170    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 02:00:44.258199 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.258196    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 02:00:44.258402 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.258303    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 02:00:44.258402 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.258355    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 09 02:00:44.275886 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.275854    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"]
Jul 09 02:00:44.276048 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.275905    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-684444465d-tbvst"]
Jul 09 02:00:44.276048 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.275929    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8fbfc87b-smv55"]
Jul 09 02:00:44.276048 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.276004    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8fbfc87b-smv55"
Jul 09 02:00:44.279916 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.279884    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 09 02:00:44.280058 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.279929    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mpshv\""
Jul 09 02:00:44.281674 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.281649    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-registry-tls\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.281796 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.281705    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1503d545-ff12-4a16-819f-96e817e379f8-installation-pull-secrets\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.281796 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.281733    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh8rc\" (UniqueName: \"kubernetes.io/projected/b8a726bd-af48-480e-bdf6-3cfa164e2e84-kube-api-access-xh8rc\") pod \"klusterlet-addon-workmgr-76bb6c6459-8c85m\" (UID: \"b8a726bd-af48-480e-bdf6-3cfa164e2e84\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"
Jul 09 02:00:44.281796 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.281761    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1503d545-ff12-4a16-819f-96e817e379f8-registry-certificates\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.281956 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.281796    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbwt4\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-kube-api-access-dbwt4\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.281956 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.281861    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b8a726bd-af48-480e-bdf6-3cfa164e2e84-klusterlet-config\") pod \"klusterlet-addon-workmgr-76bb6c6459-8c85m\" (UID: \"b8a726bd-af48-480e-bdf6-3cfa164e2e84\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"
Jul 09 02:00:44.281956 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.281894    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1503d545-ff12-4a16-819f-96e817e379f8-ca-trust-extracted\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.281956 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.281936    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-bound-sa-token\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.282215 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.281967    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8a726bd-af48-480e-bdf6-3cfa164e2e84-tmp\") pod \"klusterlet-addon-workmgr-76bb6c6459-8c85m\" (UID: \"b8a726bd-af48-480e-bdf6-3cfa164e2e84\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"
Jul 09 02:00:44.282215 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.282110    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1503d545-ff12-4a16-819f-96e817e379f8-trusted-ca\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.282215 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.282188    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1503d545-ff12-4a16-819f-96e817e379f8-image-registry-private-configuration\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.327572 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.327536    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-684444465d-tbvst"]
Jul 09 02:00:44.327859 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:44.327823    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-dbwt4 registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-684444465d-tbvst" podUID="1503d545-ff12-4a16-819f-96e817e379f8"
Jul 09 02:00:44.383515 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.383472    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szzj8\" (UniqueName: \"kubernetes.io/projected/46b7784d-5992-450e-a37d-abf8f9fabc77-kube-api-access-szzj8\") pod \"managed-serviceaccount-addon-agent-7b8fbfc87b-smv55\" (UID: \"46b7784d-5992-450e-a37d-abf8f9fabc77\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8fbfc87b-smv55"
Jul 09 02:00:44.383739 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.383540    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b8a726bd-af48-480e-bdf6-3cfa164e2e84-klusterlet-config\") pod \"klusterlet-addon-workmgr-76bb6c6459-8c85m\" (UID: \"b8a726bd-af48-480e-bdf6-3cfa164e2e84\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"
Jul 09 02:00:44.383739 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.383644    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-bound-sa-token\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.383739 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.383691    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8a726bd-af48-480e-bdf6-3cfa164e2e84-tmp\") pod \"klusterlet-addon-workmgr-76bb6c6459-8c85m\" (UID: \"b8a726bd-af48-480e-bdf6-3cfa164e2e84\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"
Jul 09 02:00:44.383739 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.383720    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1503d545-ff12-4a16-819f-96e817e379f8-trusted-ca\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.383943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.383748    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-registry-tls\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.383943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.383778    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1503d545-ff12-4a16-819f-96e817e379f8-installation-pull-secrets\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.383943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.383819    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh8rc\" (UniqueName: \"kubernetes.io/projected/b8a726bd-af48-480e-bdf6-3cfa164e2e84-kube-api-access-xh8rc\") pod \"klusterlet-addon-workmgr-76bb6c6459-8c85m\" (UID: \"b8a726bd-af48-480e-bdf6-3cfa164e2e84\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"
Jul 09 02:00:44.383943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.383842    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1503d545-ff12-4a16-819f-96e817e379f8-registry-certificates\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.383943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.383869    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbwt4\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-kube-api-access-dbwt4\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.383943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.383897    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1503d545-ff12-4a16-819f-96e817e379f8-ca-trust-extracted\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.383943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.383927    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46b7784d-5992-450e-a37d-abf8f9fabc77-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b8fbfc87b-smv55\" (UID: \"46b7784d-5992-450e-a37d-abf8f9fabc77\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8fbfc87b-smv55"
Jul 09 02:00:44.384273 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.383984    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1503d545-ff12-4a16-819f-96e817e379f8-image-registry-private-configuration\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.384328 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.384293    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8a726bd-af48-480e-bdf6-3cfa164e2e84-tmp\") pod \"klusterlet-addon-workmgr-76bb6c6459-8c85m\" (UID: \"b8a726bd-af48-480e-bdf6-3cfa164e2e84\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"
Jul 09 02:00:44.385013 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.384986    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1503d545-ff12-4a16-819f-96e817e379f8-registry-certificates\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.385128 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.385054    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1503d545-ff12-4a16-819f-96e817e379f8-trusted-ca\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.385499 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.385472    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1503d545-ff12-4a16-819f-96e817e379f8-ca-trust-extracted\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.387234 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.387184    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-registry-tls\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.387325 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.387249    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1503d545-ff12-4a16-819f-96e817e379f8-installation-pull-secrets\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.387325 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.387307    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b8a726bd-af48-480e-bdf6-3cfa164e2e84-klusterlet-config\") pod \"klusterlet-addon-workmgr-76bb6c6459-8c85m\" (UID: \"b8a726bd-af48-480e-bdf6-3cfa164e2e84\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"
Jul 09 02:00:44.387634 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.387609    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1503d545-ff12-4a16-819f-96e817e379f8-image-registry-private-configuration\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.397950 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.397927    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbwt4\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-kube-api-access-dbwt4\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.398058 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.398022    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh8rc\" (UniqueName: \"kubernetes.io/projected/b8a726bd-af48-480e-bdf6-3cfa164e2e84-kube-api-access-xh8rc\") pod \"klusterlet-addon-workmgr-76bb6c6459-8c85m\" (UID: \"b8a726bd-af48-480e-bdf6-3cfa164e2e84\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"
Jul 09 02:00:44.398098 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.398074    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-bound-sa-token\") pod \"image-registry-684444465d-tbvst\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") " pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.484715 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.484622    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szzj8\" (UniqueName: \"kubernetes.io/projected/46b7784d-5992-450e-a37d-abf8f9fabc77-kube-api-access-szzj8\") pod \"managed-serviceaccount-addon-agent-7b8fbfc87b-smv55\" (UID: \"46b7784d-5992-450e-a37d-abf8f9fabc77\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8fbfc87b-smv55"
Jul 09 02:00:44.484715 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.484711    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46b7784d-5992-450e-a37d-abf8f9fabc77-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b8fbfc87b-smv55\" (UID: \"46b7784d-5992-450e-a37d-abf8f9fabc77\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8fbfc87b-smv55"
Jul 09 02:00:44.487521 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.487496    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46b7784d-5992-450e-a37d-abf8f9fabc77-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b8fbfc87b-smv55\" (UID: \"46b7784d-5992-450e-a37d-abf8f9fabc77\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8fbfc87b-smv55"
Jul 09 02:00:44.523383 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.523348    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szzj8\" (UniqueName: \"kubernetes.io/projected/46b7784d-5992-450e-a37d-abf8f9fabc77-kube-api-access-szzj8\") pod \"managed-serviceaccount-addon-agent-7b8fbfc87b-smv55\" (UID: \"46b7784d-5992-450e-a37d-abf8f9fabc77\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8fbfc87b-smv55"
Jul 09 02:00:44.565766 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.565727    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"
Jul 09 02:00:44.585120 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.585083    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:44.587694 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.587668    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317fcb0a-ceea-4776-946e-e49985272b65-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkckl\" (UID: \"317fcb0a-ceea-4776-946e-e49985272b65\") " pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:44.596652 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.596625    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8fbfc87b-smv55"
Jul 09 02:00:44.730370 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.730334    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.752169 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.752063    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:44.786686 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.786653    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-registry-tls\") pod \"1503d545-ff12-4a16-819f-96e817e379f8\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") "
Jul 09 02:00:44.786842 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.786712    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1503d545-ff12-4a16-819f-96e817e379f8-registry-certificates\") pod \"1503d545-ff12-4a16-819f-96e817e379f8\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") "
Jul 09 02:00:44.786842 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.786748    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1503d545-ff12-4a16-819f-96e817e379f8-ca-trust-extracted\") pod \"1503d545-ff12-4a16-819f-96e817e379f8\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") "
Jul 09 02:00:44.786842 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.786778    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbwt4\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-kube-api-access-dbwt4\") pod \"1503d545-ff12-4a16-819f-96e817e379f8\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") "
Jul 09 02:00:44.787028 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.786841    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1503d545-ff12-4a16-819f-96e817e379f8-image-registry-private-configuration\") pod \"1503d545-ff12-4a16-819f-96e817e379f8\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") "
Jul 09 02:00:44.787028 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.786887    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-bound-sa-token\") pod \"1503d545-ff12-4a16-819f-96e817e379f8\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") "
Jul 09 02:00:44.787028 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.786927    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1503d545-ff12-4a16-819f-96e817e379f8-trusted-ca\") pod \"1503d545-ff12-4a16-819f-96e817e379f8\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") "
Jul 09 02:00:44.787028 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.786958    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1503d545-ff12-4a16-819f-96e817e379f8-installation-pull-secrets\") pod \"1503d545-ff12-4a16-819f-96e817e379f8\" (UID: \"1503d545-ff12-4a16-819f-96e817e379f8\") "
Jul 09 02:00:44.787222 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.787199    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1503d545-ff12-4a16-819f-96e817e379f8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1503d545-ff12-4a16-819f-96e817e379f8" (UID: "1503d545-ff12-4a16-819f-96e817e379f8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:00:44.787734 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.787683    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1503d545-ff12-4a16-819f-96e817e379f8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1503d545-ff12-4a16-819f-96e817e379f8" (UID: "1503d545-ff12-4a16-819f-96e817e379f8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:00:44.788062 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.788020    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1503d545-ff12-4a16-819f-96e817e379f8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1503d545-ff12-4a16-819f-96e817e379f8" (UID: "1503d545-ff12-4a16-819f-96e817e379f8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:00:44.789741 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.789634    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1503d545-ff12-4a16-819f-96e817e379f8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1503d545-ff12-4a16-819f-96e817e379f8" (UID: "1503d545-ff12-4a16-819f-96e817e379f8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:00:44.789859 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.789766    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-kube-api-access-dbwt4" (OuterVolumeSpecName: "kube-api-access-dbwt4") pod "1503d545-ff12-4a16-819f-96e817e379f8" (UID: "1503d545-ff12-4a16-819f-96e817e379f8"). InnerVolumeSpecName "kube-api-access-dbwt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:00:44.789934 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.789872    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1503d545-ff12-4a16-819f-96e817e379f8" (UID: "1503d545-ff12-4a16-819f-96e817e379f8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:00:44.789934 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.789886    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1503d545-ff12-4a16-819f-96e817e379f8" (UID: "1503d545-ff12-4a16-819f-96e817e379f8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:00:44.790231 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.790208    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1503d545-ff12-4a16-819f-96e817e379f8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1503d545-ff12-4a16-819f-96e817e379f8" (UID: "1503d545-ff12-4a16-819f-96e817e379f8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:00:44.793071 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.793046    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vfnrl\""
Jul 09 02:00:44.799853 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.799833    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gkckl"
Jul 09 02:00:44.887718 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.887683    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-registry-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:00:44.887718 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.887718    2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1503d545-ff12-4a16-819f-96e817e379f8-registry-certificates\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:00:44.888027 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.887734    2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1503d545-ff12-4a16-819f-96e817e379f8-ca-trust-extracted\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:00:44.888027 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.887749    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbwt4\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-kube-api-access-dbwt4\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:00:44.888027 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.887760    2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1503d545-ff12-4a16-819f-96e817e379f8-image-registry-private-configuration\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:00:44.888027 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.887773    2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1503d545-ff12-4a16-819f-96e817e379f8-bound-sa-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:00:44.888027 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.887786    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1503d545-ff12-4a16-819f-96e817e379f8-trusted-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:00:44.888027 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:44.887799    2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1503d545-ff12-4a16-819f-96e817e379f8-installation-pull-secrets\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:00:45.537023 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.536932    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8fbfc87b-smv55"]
Jul 09 02:00:45.551680 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:00:45.551648    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46b7784d_5992_450e_a37d_abf8f9fabc77.slice/crio-2ecf4cde7a6aebcfb1dec60785a6c6b53f4a0a6f6ea4cb93fa74f40f3c4cae9b WatchSource:0}: Error finding container 2ecf4cde7a6aebcfb1dec60785a6c6b53f4a0a6f6ea4cb93fa74f40f3c4cae9b: Status 404 returned error can't find the container with id 2ecf4cde7a6aebcfb1dec60785a6c6b53f4a0a6f6ea4cb93fa74f40f3c4cae9b
Jul 09 02:00:45.555096 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.555071    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"]
Jul 09 02:00:45.557437 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.557414    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gkckl"]
Jul 09 02:00:45.558610 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:00:45.558523    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a726bd_af48_480e_bdf6_3cfa164e2e84.slice/crio-f5eb7b1119bd43aa20b09c55f725fe489eae4ff6ffb511fac4c7ebf2d8638d30 WatchSource:0}: Error finding container f5eb7b1119bd43aa20b09c55f725fe489eae4ff6ffb511fac4c7ebf2d8638d30: Status 404 returned error can't find the container with id f5eb7b1119bd43aa20b09c55f725fe489eae4ff6ffb511fac4c7ebf2d8638d30
Jul 09 02:00:45.561028 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:00:45.560998    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317fcb0a_ceea_4776_946e_e49985272b65.slice/crio-81f2838100b71e582d464c22fcc53680e765d09e383fbb1a6ccb7bc24092ed0b WatchSource:0}: Error finding container 81f2838100b71e582d464c22fcc53680e765d09e383fbb1a6ccb7bc24092ed0b: Status 404 returned error can't find the container with id 81f2838100b71e582d464c22fcc53680e765d09e383fbb1a6ccb7bc24092ed0b
Jul 09 02:00:45.596825 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.596767    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-78qpz"]
Jul 09 02:00:45.599786 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:00:45.599756    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae01695f_2f46_422a_b1e4_f37db3b443a4.slice/crio-1be355048337bf38029b09ed4d47fee5d143ded2ddb05979193b70406aed24d7 WatchSource:0}: Error finding container 1be355048337bf38029b09ed4d47fee5d143ded2ddb05979193b70406aed24d7: Status 404 returned error can't find the container with id 1be355048337bf38029b09ed4d47fee5d143ded2ddb05979193b70406aed24d7
Jul 09 02:00:45.740679 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.739651    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m" event={"ID":"b8a726bd-af48-480e-bdf6-3cfa164e2e84","Type":"ContainerStarted","Data":"f5eb7b1119bd43aa20b09c55f725fe489eae4ff6ffb511fac4c7ebf2d8638d30"}
Jul 09 02:00:45.741516 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.741486    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kx7tj" event={"ID":"3049ceb1-0ae0-4e5f-8d1d-45ac6f563386","Type":"ContainerStarted","Data":"4803d0b9a1f394d6af1ba911cff03d02ced8eee82b7071e051ef55173f442a1c"}
Jul 09 02:00:45.742612 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.742586    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkckl" event={"ID":"317fcb0a-ceea-4776-946e-e49985272b65","Type":"ContainerStarted","Data":"81f2838100b71e582d464c22fcc53680e765d09e383fbb1a6ccb7bc24092ed0b"}
Jul 09 02:00:45.743576 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.743542    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-78qpz" event={"ID":"ae01695f-2f46-422a-b1e4-f37db3b443a4","Type":"ContainerStarted","Data":"1be355048337bf38029b09ed4d47fee5d143ded2ddb05979193b70406aed24d7"}
Jul 09 02:00:45.744796 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.744776    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4dmzq" event={"ID":"b135662d-b8d8-4b4b-ae4f-c810a098793c","Type":"ContainerStarted","Data":"a50f3895912bef409b3a7f896211937881862ba48c0636cd72818552c57f9985"}
Jul 09 02:00:45.744885 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.744870    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 02:00:45.746028 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.746009    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684444465d-tbvst"
Jul 09 02:00:45.746116 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.746020    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8fbfc87b-smv55" event={"ID":"46b7784d-5992-450e-a37d-abf8f9fabc77","Type":"ContainerStarted","Data":"2ecf4cde7a6aebcfb1dec60785a6c6b53f4a0a6f6ea4cb93fa74f40f3c4cae9b"}
Jul 09 02:00:45.761964 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.761913    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kx7tj" podStartSLOduration=64.71734446 podStartE2EDuration="1m9.761899105s" totalImagesPullingTime="5.044554645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 01:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:45.761733733 +0000 UTC m=+71.043657871" watchObservedRunningTime="2026-07-09 02:00:45.761899105 +0000 UTC m=+71.043823230"
Jul 09 02:00:45.797509 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.797435    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-684444465d-tbvst"]
Jul 09 02:00:45.801592 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.801552    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-684444465d-tbvst"]
Jul 09 02:00:45.816315 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:45.816253    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4dmzq" podStartSLOduration=65.819737446 podStartE2EDuration="1m10.816233182s" totalImagesPullingTime="4.996495736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 01:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:45.816035596 +0000 UTC m=+71.097959734" watchObservedRunningTime="2026-07-09 02:00:45.816233182 +0000 UTC m=+71.098157321"
Jul 09 02:00:47.274950 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:47.274648    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1503d545-ff12-4a16-819f-96e817e379f8" path="/var/lib/kubelet/pods/1503d545-ff12-4a16-819f-96e817e379f8/volumes"
Jul 09 02:00:48.593257 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.593222    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"]
Jul 09 02:00:48.597882 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.597856    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"
Jul 09 02:00:48.603036 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.602655    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 02:00:48.603036 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.602692    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 02:00:48.603036 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.602846    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 09 02:00:48.603036 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.602874    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 02:00:48.603036 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.602928    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 09 02:00:48.603036 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.602965    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fnb98\""
Jul 09 02:00:48.605486 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.605424    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"]
Jul 09 02:00:48.617108 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.617071    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61248a7f-8cb6-45ab-b423-4e09afcc0243-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-x6p6j\" (UID: \"61248a7f-8cb6-45ab-b423-4e09afcc0243\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"
Jul 09 02:00:48.617243 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.617131    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvm8b\" (UniqueName: \"kubernetes.io/projected/61248a7f-8cb6-45ab-b423-4e09afcc0243-kube-api-access-fvm8b\") pod \"prometheus-operator-567f7b8b7c-x6p6j\" (UID: \"61248a7f-8cb6-45ab-b423-4e09afcc0243\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"
Jul 09 02:00:48.617243 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.617182    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61248a7f-8cb6-45ab-b423-4e09afcc0243-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-x6p6j\" (UID: \"61248a7f-8cb6-45ab-b423-4e09afcc0243\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"
Jul 09 02:00:48.617243 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.617240    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/61248a7f-8cb6-45ab-b423-4e09afcc0243-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-x6p6j\" (UID: \"61248a7f-8cb6-45ab-b423-4e09afcc0243\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"
Jul 09 02:00:48.718430 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.718388    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/61248a7f-8cb6-45ab-b423-4e09afcc0243-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-x6p6j\" (UID: \"61248a7f-8cb6-45ab-b423-4e09afcc0243\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"
Jul 09 02:00:48.718651 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.718439    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61248a7f-8cb6-45ab-b423-4e09afcc0243-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-x6p6j\" (UID: \"61248a7f-8cb6-45ab-b423-4e09afcc0243\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"
Jul 09 02:00:48.718651 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.718480    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvm8b\" (UniqueName: \"kubernetes.io/projected/61248a7f-8cb6-45ab-b423-4e09afcc0243-kube-api-access-fvm8b\") pod \"prometheus-operator-567f7b8b7c-x6p6j\" (UID: \"61248a7f-8cb6-45ab-b423-4e09afcc0243\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"
Jul 09 02:00:48.718651 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.718511    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61248a7f-8cb6-45ab-b423-4e09afcc0243-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-x6p6j\" (UID: \"61248a7f-8cb6-45ab-b423-4e09afcc0243\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"
Jul 09 02:00:48.720124 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.720073    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61248a7f-8cb6-45ab-b423-4e09afcc0243-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-x6p6j\" (UID: \"61248a7f-8cb6-45ab-b423-4e09afcc0243\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"
Jul 09 02:00:48.721489 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.721443    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61248a7f-8cb6-45ab-b423-4e09afcc0243-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-x6p6j\" (UID: \"61248a7f-8cb6-45ab-b423-4e09afcc0243\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"
Jul 09 02:00:48.721630 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.721590    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/61248a7f-8cb6-45ab-b423-4e09afcc0243-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-x6p6j\" (UID: \"61248a7f-8cb6-45ab-b423-4e09afcc0243\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"
Jul 09 02:00:48.728645 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.728616    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvm8b\" (UniqueName: \"kubernetes.io/projected/61248a7f-8cb6-45ab-b423-4e09afcc0243-kube-api-access-fvm8b\") pod \"prometheus-operator-567f7b8b7c-x6p6j\" (UID: \"61248a7f-8cb6-45ab-b423-4e09afcc0243\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"
Jul 09 02:00:48.912088 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:48.912001    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"
Jul 09 02:00:52.791422 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:52.791143    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m" event={"ID":"b8a726bd-af48-480e-bdf6-3cfa164e2e84","Type":"ContainerStarted","Data":"5d10cbc2e5d35199b3fea2c91ab8e7f6bd733e0b2fb8c0ed88ad3f66c0f5c08e"}
Jul 09 02:00:52.791893 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:52.791481    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"
Jul 09 02:00:52.792989 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:52.792850    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m" podUID="b8a726bd-af48-480e-bdf6-3cfa164e2e84" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.11:8000/readyz\": dial tcp 10.133.0.11:8000: connect: connection refused"
Jul 09 02:00:52.792989 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:52.792959    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkckl" event={"ID":"317fcb0a-ceea-4776-946e-e49985272b65","Type":"ContainerStarted","Data":"ac7b420b22891f96d84d8bd9206f8008805deb26229eb93e17f4c28c4d569cbc"}
Jul 09 02:00:52.794798 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:52.794765    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8fbfc87b-smv55" event={"ID":"46b7784d-5992-450e-a37d-abf8f9fabc77","Type":"ContainerStarted","Data":"fa239e41fb99698c417780fd9e336f940826a0293e513d4039dd4f1ed18a3ec3"}
Jul 09 02:00:52.800202 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:52.800094    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j"]
Jul 09 02:00:52.803877 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:00:52.803846    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61248a7f_8cb6_45ab_b423_4e09afcc0243.slice/crio-7752399a273439551a5520ef626121b69fe2bd1e6d15b2d4db5ce25093b44495 WatchSource:0}: Error finding container 7752399a273439551a5520ef626121b69fe2bd1e6d15b2d4db5ce25093b44495: Status 404 returned error can't find the container with id 7752399a273439551a5520ef626121b69fe2bd1e6d15b2d4db5ce25093b44495
Jul 09 02:00:52.811180 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:52.810273    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m" podStartSLOduration=1.718415701 podStartE2EDuration="8.810252081s" totalImagesPullingTime="7.09183638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:52.809703406 +0000 UTC m=+78.091627542" watchObservedRunningTime="2026-07-09 02:00:52.810252081 +0000 UTC m=+78.092176218"
Jul 09 02:00:52.826608 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:52.826045    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8fbfc87b-smv55" podStartSLOduration=1.729095873 podStartE2EDuration="8.826022064s" totalImagesPullingTime="7.096926191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:52.825271092 +0000 UTC m=+78.107195231" watchObservedRunningTime="2026-07-09 02:00:52.826022064 +0000 UTC m=+78.107946201"
Jul 09 02:00:53.083264 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.083231    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b9cb85569-52zcr"]
Jul 09 02:00:53.085183 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.085152    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.089508 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.089483    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 02:00:53.089692 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.089625    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ldhq7\""
Jul 09 02:00:53.089692 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.089643    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 02:00:53.089692 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.089658    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 02:00:53.090132 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.090112    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 02:00:53.090261 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.090240    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 02:00:53.090339 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.090245    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 02:00:53.090900 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.090878    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 02:00:53.099641 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.099328    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 02:00:53.101800 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.101776    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b9cb85569-52zcr"]
Jul 09 02:00:53.161177 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.161090    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-serving-cert\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.161177 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.161130    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-oauth-config\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.161177 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.161162    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-config\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.161408 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.161184    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5rxd\" (UniqueName: \"kubernetes.io/projected/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-kube-api-access-h5rxd\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.161408 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.161200    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-trusted-ca-bundle\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.161408 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.161225    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-service-ca\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.161408 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.161299    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-oauth-serving-cert\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.262260 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.262222    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-oauth-serving-cert\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.262260 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.262261    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-serving-cert\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.262528 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.262287    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-oauth-config\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.262528 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.262310    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-config\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.262528 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.262375    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5rxd\" (UniqueName: \"kubernetes.io/projected/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-kube-api-access-h5rxd\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.262715 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.262539    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-trusted-ca-bundle\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.262715 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.262600    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-service-ca\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.263142 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.263115    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-oauth-serving-cert\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.263142 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.263133    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-config\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.263291 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.263269    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-service-ca\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.263434 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.263410    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-trusted-ca-bundle\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.264919 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.264887    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-oauth-config\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.265040 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.265024    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-serving-cert\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.275355 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.275325    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5rxd\" (UniqueName: \"kubernetes.io/projected/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-kube-api-access-h5rxd\") pod \"console-b9cb85569-52zcr\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") " pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.396720 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.396682    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:00:53.547701 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.547669    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b9cb85569-52zcr"]
Jul 09 02:00:53.551072 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:00:53.551047    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f67fc1a_ccd6_4cfd_babd_f82ed697d589.slice/crio-b784b44d5cc6c6411d0f32cfaf82079f1b73b2ddc44b125fff290bef8808a601 WatchSource:0}: Error finding container b784b44d5cc6c6411d0f32cfaf82079f1b73b2ddc44b125fff290bef8808a601: Status 404 returned error can't find the container with id b784b44d5cc6c6411d0f32cfaf82079f1b73b2ddc44b125fff290bef8808a601
Jul 09 02:00:53.799879 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.799784    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkckl" event={"ID":"317fcb0a-ceea-4776-946e-e49985272b65","Type":"ContainerStarted","Data":"f1682418411f97c3e429a186a42d24f674fc4c7e676ba820efe72f3ef90acf79"}
Jul 09 02:00:53.801511 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.801487    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-78qpz" event={"ID":"ae01695f-2f46-422a-b1e4-f37db3b443a4","Type":"ContainerStarted","Data":"49f11afd8eee9228879f1e4b3398342e815ce7234b334b31c4ef1b9149f1f7d6"}
Jul 09 02:00:53.801581 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.801536    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-78qpz" event={"ID":"ae01695f-2f46-422a-b1e4-f37db3b443a4","Type":"ContainerStarted","Data":"68b872a0f3223c551cd0abe77ef51c5c8a546fdd81e6c5128f684de0a018127a"}
Jul 09 02:00:53.801749 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.801689    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-78qpz"
Jul 09 02:00:53.802764 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.802741    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9cb85569-52zcr" event={"ID":"2f67fc1a-ccd6-4cfd-babd-f82ed697d589","Type":"ContainerStarted","Data":"b784b44d5cc6c6411d0f32cfaf82079f1b73b2ddc44b125fff290bef8808a601"}
Jul 09 02:00:53.803760 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.803740    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j" event={"ID":"61248a7f-8cb6-45ab-b423-4e09afcc0243","Type":"ContainerStarted","Data":"7752399a273439551a5520ef626121b69fe2bd1e6d15b2d4db5ce25093b44495"}
Jul 09 02:00:53.804995 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.804977    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76bb6c6459-8c85m"
Jul 09 02:00:53.821187 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:53.821137    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-78qpz" podStartSLOduration=36.769825054 podStartE2EDuration="43.821120072s" totalImagesPullingTime="7.051295018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:00:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:53.820210933 +0000 UTC m=+79.102135069" watchObservedRunningTime="2026-07-09 02:00:53.821120072 +0000 UTC m=+79.103044208"
Jul 09 02:00:55.813728 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:55.813690    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j" event={"ID":"61248a7f-8cb6-45ab-b423-4e09afcc0243","Type":"ContainerStarted","Data":"42ebb98a8db15c0282c57b2653e01e390acd5bce568634db057fe73a730aaf8b"}
Jul 09 02:00:55.814211 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:55.813797    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j" event={"ID":"61248a7f-8cb6-45ab-b423-4e09afcc0243","Type":"ContainerStarted","Data":"8a1d5abe192d2dd08435c19011447f7fd4642924926f3a337ab213a4162a48e8"}
Jul 09 02:00:55.836742 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:55.836684    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-x6p6j" podStartSLOduration=5.6620359780000005 podStartE2EDuration="7.836667206s" totalImagesPullingTime="2.174631228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:55.835665619 +0000 UTC m=+81.117589756" watchObservedRunningTime="2026-07-09 02:00:55.836667206 +0000 UTC m=+81.118591342"
Jul 09 02:00:57.822948 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:57.822846    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkckl" event={"ID":"317fcb0a-ceea-4776-946e-e49985272b65","Type":"ContainerStarted","Data":"ce1bd4ed61eba9df9b96547c9f2af293be68cd123a8ce02abd1520deeeda63ff"}
Jul 09 02:00:57.824465 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:57.824441    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9cb85569-52zcr" event={"ID":"2f67fc1a-ccd6-4cfd-babd-f82ed697d589","Type":"ContainerStarted","Data":"523957c7c3baf0ad16d688c49ba8ee3081baad6ee8a2da2f555d104818967fd7"}
Jul 09 02:00:57.848740 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:57.848682    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gkckl" podStartSLOduration=34.09249195 podStartE2EDuration="45.848664326s" totalImagesPullingTime="11.756172376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:00:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:57.847128332 +0000 UTC m=+83.129052469" watchObservedRunningTime="2026-07-09 02:00:57.848664326 +0000 UTC m=+83.130588458"
Jul 09 02:00:57.874083 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:57.874030    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b9cb85569-52zcr" podStartSLOduration=0.962007729 podStartE2EDuration="4.874012812s" totalImagesPullingTime="3.912005083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:00:57.872929714 +0000 UTC m=+83.154853862" watchObservedRunningTime="2026-07-09 02:00:57.874012812 +0000 UTC m=+83.155936947"
Jul 09 02:00:58.060882 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.060848    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"]
Jul 09 02:00:58.065045 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.065025    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:58.080964 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.080878    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 09 02:00:58.081356 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.080891    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4kvn5\""
Jul 09 02:00:58.081615 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.080892    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 09 02:00:58.082593 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.082531    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"]
Jul 09 02:00:58.093514 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.093484    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"]
Jul 09 02:00:58.096649 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.096626    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.100384 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.100362    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32112530-ebb1-435c-924e-e865950db0b3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4nrn9\" (UID: \"32112530-ebb1-435c-924e-e865950db0b3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:58.100490 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.100412    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/32112530-ebb1-435c-924e-e865950db0b3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4nrn9\" (UID: \"32112530-ebb1-435c-924e-e865950db0b3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:58.100490 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.100440    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfwxz\" (UniqueName: \"kubernetes.io/projected/32112530-ebb1-435c-924e-e865950db0b3-kube-api-access-wfwxz\") pod \"openshift-state-metrics-54cf96dfcf-4nrn9\" (UID: \"32112530-ebb1-435c-924e-e865950db0b3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:58.100615 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.100487    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32112530-ebb1-435c-924e-e865950db0b3-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4nrn9\" (UID: \"32112530-ebb1-435c-924e-e865950db0b3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:58.101231 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.101212    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 09 02:00:58.101426 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.101397    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-d7z6q\""
Jul 09 02:00:58.101585 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.101547    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 09 02:00:58.101672 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.101618    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 09 02:00:58.114855 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.114827    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"]
Jul 09 02:00:58.138814 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.138779    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jrllw"]
Jul 09 02:00:58.142176 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.142157    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.151638 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.151619    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 02:00:58.151842 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.151829    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zz76p\""
Jul 09 02:00:58.151948 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.151927    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 02:00:58.153445 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.153431    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 02:00:58.201093 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201056    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-tls\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.201093 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201100    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-metrics-client-ca\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.201298 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201160    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwrj2\" (UniqueName: \"kubernetes.io/projected/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-kube-api-access-cwrj2\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.201298 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201199    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32112530-ebb1-435c-924e-e865950db0b3-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4nrn9\" (UID: \"32112530-ebb1-435c-924e-e865950db0b3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:58.201298 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201222    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/11575dbe-9ff5-4271-bd76-561d2db6f387-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.201298 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201241    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-sys\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.201298 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201289    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgtrd\" (UniqueName: \"kubernetes.io/projected/11575dbe-9ff5-4271-bd76-561d2db6f387-kube-api-access-kgtrd\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.201494 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201311    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-accelerators-collector-config\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.201494 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-textfile\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.201494 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201413    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-wtmp\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.201494 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201444    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32112530-ebb1-435c-924e-e865950db0b3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4nrn9\" (UID: \"32112530-ebb1-435c-924e-e865950db0b3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:58.201494 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201462    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.201738 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201498    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-root\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.201738 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201523    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11575dbe-9ff5-4271-bd76-561d2db6f387-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.201738 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201548    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11575dbe-9ff5-4271-bd76-561d2db6f387-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.201738 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201648    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/11575dbe-9ff5-4271-bd76-561d2db6f387-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.201738 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201693    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/32112530-ebb1-435c-924e-e865950db0b3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4nrn9\" (UID: \"32112530-ebb1-435c-924e-e865950db0b3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:58.201978 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201781    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfwxz\" (UniqueName: \"kubernetes.io/projected/32112530-ebb1-435c-924e-e865950db0b3-kube-api-access-wfwxz\") pod \"openshift-state-metrics-54cf96dfcf-4nrn9\" (UID: \"32112530-ebb1-435c-924e-e865950db0b3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:58.201978 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201818    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11575dbe-9ff5-4271-bd76-561d2db6f387-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.201978 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:58.201875    2556 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 09 02:00:58.201978 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:58.201944    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32112530-ebb1-435c-924e-e865950db0b3-openshift-state-metrics-tls podName:32112530-ebb1-435c-924e-e865950db0b3 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:58.701928727 +0000 UTC m=+83.983852847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/32112530-ebb1-435c-924e-e865950db0b3-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-4nrn9" (UID: "32112530-ebb1-435c-924e-e865950db0b3") : secret "openshift-state-metrics-tls" not found
Jul 09 02:00:58.202157 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.201979    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32112530-ebb1-435c-924e-e865950db0b3-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4nrn9\" (UID: \"32112530-ebb1-435c-924e-e865950db0b3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:58.203987 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.203963    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32112530-ebb1-435c-924e-e865950db0b3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4nrn9\" (UID: \"32112530-ebb1-435c-924e-e865950db0b3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:58.220264 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.220239    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfwxz\" (UniqueName: \"kubernetes.io/projected/32112530-ebb1-435c-924e-e865950db0b3-kube-api-access-wfwxz\") pod \"openshift-state-metrics-54cf96dfcf-4nrn9\" (UID: \"32112530-ebb1-435c-924e-e865950db0b3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:58.302906 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.302852    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgtrd\" (UniqueName: \"kubernetes.io/projected/11575dbe-9ff5-4271-bd76-561d2db6f387-kube-api-access-kgtrd\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.302906 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.302904    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-accelerators-collector-config\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.303162 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.302950    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-textfile\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.303162 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.302977    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-wtmp\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.303162 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.303133    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-wtmp\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.303314 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.303218    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.303314 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.303275    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-root\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.303314 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.303304    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11575dbe-9ff5-4271-bd76-561d2db6f387-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.303470 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.303333    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11575dbe-9ff5-4271-bd76-561d2db6f387-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.303470 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.303371    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/11575dbe-9ff5-4271-bd76-561d2db6f387-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.303470 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.303399    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-root\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.303470 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.303417    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11575dbe-9ff5-4271-bd76-561d2db6f387-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.303688 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.303478    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-tls\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.303688 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.303513    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-metrics-client-ca\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.303688 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.303547    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwrj2\" (UniqueName: \"kubernetes.io/projected/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-kube-api-access-cwrj2\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.303688 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.303596    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/11575dbe-9ff5-4271-bd76-561d2db6f387-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.303688 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.303623    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-sys\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.303915 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.303729    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-sys\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.303915 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:58.303822    2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 09 02:00:58.303915 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:58.303886    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-tls podName:f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d nodeName:}" failed. No retries permitted until 2026-07-09 02:00:58.803868484 +0000 UTC m=+84.085792601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-tls") pod "node-exporter-jrllw" (UID: "f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d") : secret "node-exporter-tls" not found
Jul 09 02:00:58.304176 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.304153    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11575dbe-9ff5-4271-bd76-561d2db6f387-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.304851 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.304325    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-textfile\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.304851 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.304405    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/11575dbe-9ff5-4271-bd76-561d2db6f387-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.304851 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.304789    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/11575dbe-9ff5-4271-bd76-561d2db6f387-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.305069 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.304981    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-accelerators-collector-config\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.305069 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.304997    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-metrics-client-ca\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.306801 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.306780    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/11575dbe-9ff5-4271-bd76-561d2db6f387-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.306938 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.306917    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11575dbe-9ff5-4271-bd76-561d2db6f387-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.307358 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.307336    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.317334 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.317315    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwrj2\" (UniqueName: \"kubernetes.io/projected/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-kube-api-access-cwrj2\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.317334 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.317328    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgtrd\" (UniqueName: \"kubernetes.io/projected/11575dbe-9ff5-4271-bd76-561d2db6f387-kube-api-access-kgtrd\") pod \"kube-state-metrics-7c9dbb8b7d-7dxm8\" (UID: \"11575dbe-9ff5-4271-bd76-561d2db6f387\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.406368 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.406323    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"
Jul 09 02:00:58.548903 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.548865    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8"]
Jul 09 02:00:58.553768 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:00:58.553730    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11575dbe_9ff5_4271_bd76_561d2db6f387.slice/crio-4129026c3c32ae7c6d53e078343f52f1c706f3cea738efbfd97f6d290ff781f1 WatchSource:0}: Error finding container 4129026c3c32ae7c6d53e078343f52f1c706f3cea738efbfd97f6d290ff781f1: Status 404 returned error can't find the container with id 4129026c3c32ae7c6d53e078343f52f1c706f3cea738efbfd97f6d290ff781f1
Jul 09 02:00:58.707762 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.707666    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/32112530-ebb1-435c-924e-e865950db0b3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4nrn9\" (UID: \"32112530-ebb1-435c-924e-e865950db0b3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:58.710108 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.710074    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/32112530-ebb1-435c-924e-e865950db0b3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4nrn9\" (UID: \"32112530-ebb1-435c-924e-e865950db0b3\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:58.808493 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.808456    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-tls\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.810798 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.810775    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d-node-exporter-tls\") pod \"node-exporter-jrllw\" (UID: \"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d\") " pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:58.828921 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.828885    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8" event={"ID":"11575dbe-9ff5-4271-bd76-561d2db6f387","Type":"ContainerStarted","Data":"4129026c3c32ae7c6d53e078343f52f1c706f3cea738efbfd97f6d290ff781f1"}
Jul 09 02:00:58.974456 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:58.974367    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"
Jul 09 02:00:59.051406 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.051373    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jrllw"
Jul 09 02:00:59.065899 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:00:59.065851    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0c52d6d_d4b9_412c_8dfd_8e98bc62c57d.slice/crio-bf8a674268a91a985006b7dcece15af159bd2d8ab4f79dc065bc4694ef2e48c3 WatchSource:0}: Error finding container bf8a674268a91a985006b7dcece15af159bd2d8ab4f79dc065bc4694ef2e48c3: Status 404 returned error can't find the container with id bf8a674268a91a985006b7dcece15af159bd2d8ab4f79dc065bc4694ef2e48c3
Jul 09 02:00:59.124152 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.124128    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9"]
Jul 09 02:00:59.126646 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:00:59.126614    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32112530_ebb1_435c_924e_e865950db0b3.slice/crio-b708c91119546226b664429550c5b3a4e5f6fad585a262aae032950fa56aa700 WatchSource:0}: Error finding container b708c91119546226b664429550c5b3a4e5f6fad585a262aae032950fa56aa700: Status 404 returned error can't find the container with id b708c91119546226b664429550c5b3a4e5f6fad585a262aae032950fa56aa700
Jul 09 02:00:59.184703 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.184667    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 02:00:59.189507 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.189485    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.192507 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.192484    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 02:00:59.192990 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.192484    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 02:00:59.193762 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.193691    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 02:00:59.194067 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.194033    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 02:00:59.194272 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.194247    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 02:00:59.194351 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.194296    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 02:00:59.194417 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.194247    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 02:00:59.194779 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.194465    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 02:00:59.194779 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.194659    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 02:00:59.194779 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.194665    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-k5gnr\""
Jul 09 02:00:59.208095 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.208071    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 02:00:59.313258 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.313049    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.313258 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.313093    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pxwz\" (UniqueName: \"kubernetes.io/projected/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-kube-api-access-4pxwz\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.313258 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.313131    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-web-config\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.313258 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.313159    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.313258 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.313188    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.313258 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.313244    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.313258 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.313267    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.313777 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.313295    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.313777 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.313326    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-config-out\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.313777 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.313353    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.313777 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.313386    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.313777 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.313411    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.313777 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.313457    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.414301 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.414268    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-config-out\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.414301 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.414308    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.414597 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.414330    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.414597 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.414512    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.414715 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.414596    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.414715 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.414641    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.414715 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.414666    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pxwz\" (UniqueName: \"kubernetes.io/projected/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-kube-api-access-4pxwz\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.414715 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.414688    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.414715 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.414703    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-web-config\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.414948 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.414730    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.414948 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.414757    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.414948 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:59.414847    2556 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 09 02:00:59.414948 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:00:59.414909    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-main-tls podName:9af0c3b8-7173-46f9-8857-d1e1bad3e4f7 nodeName:}" failed. No retries permitted until 2026-07-09 02:00:59.914889046 +0000 UTC m=+85.196813162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7") : secret "alertmanager-main-tls" not found
Jul 09 02:00:59.415151 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.414845    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.415208 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.415168    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.415208 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.415204    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.416848 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.415934    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.416848 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.416788    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.417304 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.417281    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-config-out\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.417777 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.417733    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.419072 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.419008    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-web-config\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.419703 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.419604    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.419703 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.419658    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.419857 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.419779    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.420085 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.420059    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.420439 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.420415    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.427665 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.427637    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pxwz\" (UniqueName: \"kubernetes.io/projected/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-kube-api-access-4pxwz\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.833301 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.833255    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrllw" event={"ID":"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d","Type":"ContainerStarted","Data":"bf8a674268a91a985006b7dcece15af159bd2d8ab4f79dc065bc4694ef2e48c3"}
Jul 09 02:00:59.835068 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.835042    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9" event={"ID":"32112530-ebb1-435c-924e-e865950db0b3","Type":"ContainerStarted","Data":"40f355a5fd64cd0e503d8ca8e8e44a9cb949c94c22b2e4a03cb5db7efa97cd39"}
Jul 09 02:00:59.835175 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.835101    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9" event={"ID":"32112530-ebb1-435c-924e-e865950db0b3","Type":"ContainerStarted","Data":"94b9ff25b61bd7ae08caa37c762a5c5cee9f46a5e53d937470524e6d809a36d0"}
Jul 09 02:00:59.835175 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.835128    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9" event={"ID":"32112530-ebb1-435c-924e-e865950db0b3","Type":"ContainerStarted","Data":"b708c91119546226b664429550c5b3a4e5f6fad585a262aae032950fa56aa700"}
Jul 09 02:00:59.918602 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.918534    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:00:59.921694 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:00:59.921666    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:01:00.092079 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.091285    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"]
Jul 09 02:01:00.096154 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.096130    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.100132 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.100101    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 02:01:00.100132 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.100115    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 02:01:00.100347 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.100296    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 02:01:00.100583 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.100545    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-53j4v508ph1ec\""
Jul 09 02:01:00.100692 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.100633    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hjxwh\""
Jul 09 02:01:00.100987 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.100965    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:01:00.101939 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.101888    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 02:01:00.101939 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.101928    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 02:01:00.115697 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.115668    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"]
Jul 09 02:01:00.221531 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.221495    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.221726 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.221566    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.221726 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.221601    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv2gc\" (UniqueName: \"kubernetes.io/projected/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-kube-api-access-lv2gc\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.221726 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.221654    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.221726 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.221684    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-tls\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.221943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.221764    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.221943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.221789    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-metrics-client-ca\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.221943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.221811    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-grpc-tls\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.322987 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.322948    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.323179 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.322996    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-tls\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.323179 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.323039    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.323179 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.323064    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-metrics-client-ca\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.323179 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.323087    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-grpc-tls\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.323179 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.323150    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.323419 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.323184    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.323419 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.323210    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv2gc\" (UniqueName: \"kubernetes.io/projected/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-kube-api-access-lv2gc\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.324214 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.324181    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-metrics-client-ca\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.326256 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.326174    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.326256 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.326222    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-tls\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.326441 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.326338    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.326441 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.326358    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-grpc-tls\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.326623 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.326598    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.326930 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.326911    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.339358 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.339331    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv2gc\" (UniqueName: \"kubernetes.io/projected/78ae7b93-903d-4eaa-89e6-42fce22ff8cb-kube-api-access-lv2gc\") pod \"thanos-querier-54b8b56c8c-dfswm\" (UID: \"78ae7b93-903d-4eaa-89e6-42fce22ff8cb\") " pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:00.414129 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:00.414024    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:01.005018 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:01.004973    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 02:01:01.017910 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:01.017815    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"]
Jul 09 02:01:01.845144 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:01.845104    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8" event={"ID":"11575dbe-9ff5-4271-bd76-561d2db6f387","Type":"ContainerStarted","Data":"d8d517a008217d31fcf7825b2b6619ef75f863852123d4253e90b4e626aa77d4"}
Jul 09 02:01:01.845318 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:01.845177    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8" event={"ID":"11575dbe-9ff5-4271-bd76-561d2db6f387","Type":"ContainerStarted","Data":"c25d6a4c3636cc6b427dd8abcef9b9aee7f8e14d0377e7092903c9d66d9ea0c9"}
Jul 09 02:01:01.845318 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:01.845206    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8" event={"ID":"11575dbe-9ff5-4271-bd76-561d2db6f387","Type":"ContainerStarted","Data":"53742ba9fcc3bbe452e68dbd38e93d09eb58e5b850fd0cf3ced4ae51d53a1fd2"}
Jul 09 02:01:01.846253 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:01.846231    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm" event={"ID":"78ae7b93-903d-4eaa-89e6-42fce22ff8cb","Type":"ContainerStarted","Data":"072215fc918b9253784cea924d6b48db67f34cdb9f2ba3bc5f935ebe133f308f"}
Jul 09 02:01:01.847416 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:01.847394    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerStarted","Data":"c38755d02f3656469db342736a45bb93399617e5ae0bd47fda0fa6c991247788"}
Jul 09 02:01:01.849000 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:01.848975    2556 generic.go:356] "Generic (PLEG): container finished" podID="f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d" containerID="c501b1bfd30e737477a93f1cd9473177c923904c6a8a90406fd2d8d6434b62d3" exitCode=0
Jul 09 02:01:01.849073 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:01.849049    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrllw" event={"ID":"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d","Type":"ContainerDied","Data":"c501b1bfd30e737477a93f1cd9473177c923904c6a8a90406fd2d8d6434b62d3"}
Jul 09 02:01:01.851194 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:01.851172    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9" event={"ID":"32112530-ebb1-435c-924e-e865950db0b3","Type":"ContainerStarted","Data":"7e0cfd6fa88493f36283c5b30b02868734eef672e112a21d99f4d3f032210fb7"}
Jul 09 02:01:01.865943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:01.865884    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7dxm8" podStartSLOduration=1.595936586 podStartE2EDuration="3.865866191s" totalImagesPullingTime="2.269929605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:01:01.865024564 +0000 UTC m=+87.146948724" watchObservedRunningTime="2026-07-09 02:01:01.865866191 +0000 UTC m=+87.147790326"
Jul 09 02:01:01.891513 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:01.891462    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4nrn9" podStartSLOduration=2.322971883 podStartE2EDuration="3.891444837s" totalImagesPullingTime="1.568472954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:01:01.891211926 +0000 UTC m=+87.173136059" watchObservedRunningTime="2026-07-09 02:01:01.891444837 +0000 UTC m=+87.173368973"
Jul 09 02:01:02.761913 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.761883    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg"]
Jul 09 02:01:02.765837 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.765816    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg"
Jul 09 02:01:02.768823 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.768796    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hgjss\""
Jul 09 02:01:02.768922 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.768835    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 09 02:01:02.775073 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.775008    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg"]
Jul 09 02:01:02.850166 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.850133    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/444cf910-f6a2-498e-9f57-b787add9e855-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7m8rg\" (UID: \"444cf910-f6a2-498e-9f57-b787add9e855\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg"
Jul 09 02:01:02.850332 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.850185    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf7ws\" (UniqueName: \"kubernetes.io/projected/444cf910-f6a2-498e-9f57-b787add9e855-kube-api-access-jf7ws\") pod \"monitoring-plugin-d5dcff7cf-7m8rg\" (UID: \"444cf910-f6a2-498e-9f57-b787add9e855\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg"
Jul 09 02:01:02.857507 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.857459    2556 generic.go:356] "Generic (PLEG): container finished" podID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerID="675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777" exitCode=0
Jul 09 02:01:02.857688 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.857530    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerDied","Data":"675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777"}
Jul 09 02:01:02.860651 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.860620    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrllw" event={"ID":"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d","Type":"ContainerStarted","Data":"b97c9c40d67c49a196c461f97fc8adfe0e954e7a83bdb6829c84994f52c2b7a4"}
Jul 09 02:01:02.860765 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.860694    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jrllw" event={"ID":"f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d","Type":"ContainerStarted","Data":"293982d074e15586869318e274e27024f5116fdf461ce998a7342bc7aebbe8fd"}
Jul 09 02:01:02.904055 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.903942    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jrllw" podStartSLOduration=3.024033775 podStartE2EDuration="4.903925432s" totalImagesPullingTime="1.761604523s" totalInitContainerRuntime="118.287134ms" isStatefulPod=true podCreationTimestamp="2026-07-09 02:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:01:02.903049057 +0000 UTC m=+88.184973204" watchObservedRunningTime="2026-07-09 02:01:02.903925432 +0000 UTC m=+88.185849568"
Jul 09 02:01:02.951062 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.951019    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf7ws\" (UniqueName: \"kubernetes.io/projected/444cf910-f6a2-498e-9f57-b787add9e855-kube-api-access-jf7ws\") pod \"monitoring-plugin-d5dcff7cf-7m8rg\" (UID: \"444cf910-f6a2-498e-9f57-b787add9e855\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg"
Jul 09 02:01:02.951984 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.951821    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/444cf910-f6a2-498e-9f57-b787add9e855-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7m8rg\" (UID: \"444cf910-f6a2-498e-9f57-b787add9e855\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg"
Jul 09 02:01:02.951984 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:01:02.951914    2556 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 09 02:01:02.951984 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:01:02.951987    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/444cf910-f6a2-498e-9f57-b787add9e855-monitoring-plugin-cert podName:444cf910-f6a2-498e-9f57-b787add9e855 nodeName:}" failed. No retries permitted until 2026-07-09 02:01:03.451967314 +0000 UTC m=+88.733891432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/444cf910-f6a2-498e-9f57-b787add9e855-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-7m8rg" (UID: "444cf910-f6a2-498e-9f57-b787add9e855") : secret "monitoring-plugin-cert" not found
Jul 09 02:01:02.965112 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:02.965078    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf7ws\" (UniqueName: \"kubernetes.io/projected/444cf910-f6a2-498e-9f57-b787add9e855-kube-api-access-jf7ws\") pod \"monitoring-plugin-d5dcff7cf-7m8rg\" (UID: \"444cf910-f6a2-498e-9f57-b787add9e855\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg"
Jul 09 02:01:03.397001 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.396962    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:01:03.397196 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.397035    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:01:03.402506 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.402482    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:01:03.455986 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.455943    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/444cf910-f6a2-498e-9f57-b787add9e855-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7m8rg\" (UID: \"444cf910-f6a2-498e-9f57-b787add9e855\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg"
Jul 09 02:01:03.458716 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.458693    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/444cf910-f6a2-498e-9f57-b787add9e855-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7m8rg\" (UID: \"444cf910-f6a2-498e-9f57-b787add9e855\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg"
Jul 09 02:01:03.500498 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.500461    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b9cb85569-52zcr"]
Jul 09 02:01:03.528879 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.528847    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84c457554d-4rn84"]
Jul 09 02:01:03.533379 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.533345    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.545626 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.545596    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c457554d-4rn84"]
Jul 09 02:01:03.658046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.657966    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-service-ca\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.658046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.658005    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/235d8d93-7888-405c-b30b-5e04143a7fde-console-oauth-config\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.658046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.658034    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9n6f\" (UniqueName: \"kubernetes.io/projected/235d8d93-7888-405c-b30b-5e04143a7fde-kube-api-access-h9n6f\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.658308 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.658083    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/235d8d93-7888-405c-b30b-5e04143a7fde-console-serving-cert\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.658308 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.658106    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-trusted-ca-bundle\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.658308 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.658175    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-console-config\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.658308 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.658274    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-oauth-serving-cert\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.724702 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.724677    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg"
Jul 09 02:01:03.759721 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.759690    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-oauth-serving-cert\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.759866 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.759751    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-service-ca\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.759866 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.759778    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/235d8d93-7888-405c-b30b-5e04143a7fde-console-oauth-config\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.759866 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.759806    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9n6f\" (UniqueName: \"kubernetes.io/projected/235d8d93-7888-405c-b30b-5e04143a7fde-kube-api-access-h9n6f\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.759866 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.759831    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/235d8d93-7888-405c-b30b-5e04143a7fde-console-serving-cert\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.759866 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.759854    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-trusted-ca-bundle\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.760126 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.759888    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-console-config\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.760593 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.760513    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-oauth-serving-cert\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.760869 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.760806    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-service-ca\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.761093 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.761052    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-console-config\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.761168 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.761109    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-trusted-ca-bundle\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.762538 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.762515    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/235d8d93-7888-405c-b30b-5e04143a7fde-console-serving-cert\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.763949 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.763858    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/235d8d93-7888-405c-b30b-5e04143a7fde-console-oauth-config\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.769035 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.769008    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9n6f\" (UniqueName: \"kubernetes.io/projected/235d8d93-7888-405c-b30b-5e04143a7fde-kube-api-access-h9n6f\") pod \"console-84c457554d-4rn84\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") " pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.811763 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.811702    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-78qpz"
Jul 09 02:01:03.844358 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.844328    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:03.871270 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.871122    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm" event={"ID":"78ae7b93-903d-4eaa-89e6-42fce22ff8cb","Type":"ContainerStarted","Data":"fa5a38d5e255e2203e8066f386139006c5206ec42ae87348920dc8f66d7cb8d0"}
Jul 09 02:01:03.871270 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.871199    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm" event={"ID":"78ae7b93-903d-4eaa-89e6-42fce22ff8cb","Type":"ContainerStarted","Data":"290b8e2dd6728bf8c7e8ef2f55c35652243e7a107ab030f2c0f38afe580064ac"}
Jul 09 02:01:03.871270 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.871241    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm" event={"ID":"78ae7b93-903d-4eaa-89e6-42fce22ff8cb","Type":"ContainerStarted","Data":"e30d7eb8ae948639da0999c82a1253906854c33f50c598c042e509cbe2d5f2ed"}
Jul 09 02:01:03.876657 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.876627    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:01:03.885078 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:03.884910    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg"]
Jul 09 02:01:03.887349 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:01:03.887321    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod444cf910_f6a2_498e_9f57_b787add9e855.slice/crio-c66736333be45dcdfc0bf9b6d15ede3ffffbc68ff12a76bbc1be6172e67c9617 WatchSource:0}: Error finding container c66736333be45dcdfc0bf9b6d15ede3ffffbc68ff12a76bbc1be6172e67c9617: Status 404 returned error can't find the container with id c66736333be45dcdfc0bf9b6d15ede3ffffbc68ff12a76bbc1be6172e67c9617
Jul 09 02:01:04.020711 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:04.020636    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c457554d-4rn84"]
Jul 09 02:01:04.880989 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:04.880924    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg" event={"ID":"444cf910-f6a2-498e-9f57-b787add9e855","Type":"ContainerStarted","Data":"c66736333be45dcdfc0bf9b6d15ede3ffffbc68ff12a76bbc1be6172e67c9617"}
Jul 09 02:01:04.883735 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:04.883700    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c457554d-4rn84" event={"ID":"235d8d93-7888-405c-b30b-5e04143a7fde","Type":"ContainerStarted","Data":"d7a61cd2e41909f348fe556d6d9a90f9740fd0be593b7b37447cc5dd77661bbf"}
Jul 09 02:01:04.883878 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:04.883769    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c457554d-4rn84" event={"ID":"235d8d93-7888-405c-b30b-5e04143a7fde","Type":"ContainerStarted","Data":"07c386d4cc437035d141c4b3b7a185e91628ae7808ef2266a8322ddefef039a6"}
Jul 09 02:01:04.930600 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:04.930421    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84c457554d-4rn84" podStartSLOduration=1.9304055629999999 podStartE2EDuration="1.930405563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:01:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:01:04.929716751 +0000 UTC m=+90.211640888" watchObservedRunningTime="2026-07-09 02:01:04.930405563 +0000 UTC m=+90.212329700"
Jul 09 02:01:05.890527 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:05.890495    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg" event={"ID":"444cf910-f6a2-498e-9f57-b787add9e855","Type":"ContainerStarted","Data":"bee28c19ddf8626f88b988d1884d25fd4cf020dc702f91facd649fb205c22c5a"}
Jul 09 02:01:05.890883 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:05.890573    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg"
Jul 09 02:01:05.894351 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:05.894327    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm" event={"ID":"78ae7b93-903d-4eaa-89e6-42fce22ff8cb","Type":"ContainerStarted","Data":"84523dd643fbe942d5cc19f633005ffc0438a8a9606e4cf125bd196ca25997f5"}
Jul 09 02:01:05.896926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:05.896806    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerStarted","Data":"2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27"}
Jul 09 02:01:05.897046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:05.897030    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg"
Jul 09 02:01:05.911360 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:05.911313    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7m8rg" podStartSLOduration=2.084260039 podStartE2EDuration="3.911294164s" totalImagesPullingTime="1.827034125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:01:05.908132958 +0000 UTC m=+91.190057094" watchObservedRunningTime="2026-07-09 02:01:05.911294164 +0000 UTC m=+91.193218294"
Jul 09 02:01:06.906170 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:06.906129    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm" event={"ID":"78ae7b93-903d-4eaa-89e6-42fce22ff8cb","Type":"ContainerStarted","Data":"0808e8809c32db7de443652e628f81bcc33a6cea2f54292de03adc6314c66e12"}
Jul 09 02:01:06.906677 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:06.906233    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm" event={"ID":"78ae7b93-903d-4eaa-89e6-42fce22ff8cb","Type":"ContainerStarted","Data":"cad6a9b14fa910fbee7f42a91d1c94fa52e273045619107e4b1de127d564e347"}
Jul 09 02:01:06.906677 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:06.906277    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:06.909398 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:06.909369    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerStarted","Data":"6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc"}
Jul 09 02:01:06.909511 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:06.909432    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerStarted","Data":"e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394"}
Jul 09 02:01:06.909511 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:06.909460    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerStarted","Data":"ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035"}
Jul 09 02:01:06.909511 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:06.909484    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerStarted","Data":"bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47"}
Jul 09 02:01:06.909511 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:06.909507    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerStarted","Data":"9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a"}
Jul 09 02:01:06.937449 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:06.937391    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm" podStartSLOduration=2.457537304 podStartE2EDuration="6.937373326s" totalImagesPullingTime="4.479836022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:01:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:01:06.93545824 +0000 UTC m=+92.217382377" watchObservedRunningTime="2026-07-09 02:01:06.937373326 +0000 UTC m=+92.219297462"
Jul 09 02:01:06.975649 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:06.975580    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.4129736680000002 podStartE2EDuration="7.975547095s" totalImagesPullingTime="4.540242529s" totalInitContainerRuntime="22.330898ms" isStatefulPod=false podCreationTimestamp="2026-07-09 02:00:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:01:06.97342096 +0000 UTC m=+92.255345093" watchObservedRunningTime="2026-07-09 02:01:06.975547095 +0000 UTC m=+92.257471231"
Jul 09 02:01:12.919423 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:12.919397    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-54b8b56c8c-dfswm"
Jul 09 02:01:13.845652 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:13.845615    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:13.845652 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:13.845676    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:13.850438 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:13.850420    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:13.941588 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:13.941544    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:01:16.769282 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:16.769248    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4dmzq"
Jul 09 02:01:29.912547 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:29.912479    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b9cb85569-52zcr" podUID="2f67fc1a-ccd6-4cfd-babd-f82ed697d589" containerName="console" containerID="cri-o://523957c7c3baf0ad16d688c49ba8ee3081baad6ee8a2da2f555d104818967fd7" gracePeriod=15
Jul 09 02:01:30.205967 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.205898    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:01:30.294367 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.294329    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-serving-cert\") pod \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") "
Jul 09 02:01:30.294590 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.294398    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-oauth-config\") pod \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") "
Jul 09 02:01:30.294590 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.294436    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-oauth-serving-cert\") pod \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") "
Jul 09 02:01:30.294590 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.294471    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-trusted-ca-bundle\") pod \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") "
Jul 09 02:01:30.294590 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.294522    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-service-ca\") pod \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") "
Jul 09 02:01:30.294590 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.294579    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5rxd\" (UniqueName: \"kubernetes.io/projected/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-kube-api-access-h5rxd\") pod \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") "
Jul 09 02:01:30.294864 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.294619    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-config\") pod \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\" (UID: \"2f67fc1a-ccd6-4cfd-babd-f82ed697d589\") "
Jul 09 02:01:30.295064 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.295026    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2f67fc1a-ccd6-4cfd-babd-f82ed697d589" (UID: "2f67fc1a-ccd6-4cfd-babd-f82ed697d589"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:01:30.295064 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.295040    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2f67fc1a-ccd6-4cfd-babd-f82ed697d589" (UID: "2f67fc1a-ccd6-4cfd-babd-f82ed697d589"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:01:30.295064 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.295054    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-service-ca" (OuterVolumeSpecName: "service-ca") pod "2f67fc1a-ccd6-4cfd-babd-f82ed697d589" (UID: "2f67fc1a-ccd6-4cfd-babd-f82ed697d589"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:01:30.295239 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.295210    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-config" (OuterVolumeSpecName: "console-config") pod "2f67fc1a-ccd6-4cfd-babd-f82ed697d589" (UID: "2f67fc1a-ccd6-4cfd-babd-f82ed697d589"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:01:30.296754 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.296732    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2f67fc1a-ccd6-4cfd-babd-f82ed697d589" (UID: "2f67fc1a-ccd6-4cfd-babd-f82ed697d589"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:01:30.296840 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.296759    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2f67fc1a-ccd6-4cfd-babd-f82ed697d589" (UID: "2f67fc1a-ccd6-4cfd-babd-f82ed697d589"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:01:30.296840 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.296826    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-kube-api-access-h5rxd" (OuterVolumeSpecName: "kube-api-access-h5rxd") pod "2f67fc1a-ccd6-4cfd-babd-f82ed697d589" (UID: "2f67fc1a-ccd6-4cfd-babd-f82ed697d589"). InnerVolumeSpecName "kube-api-access-h5rxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:01:30.395337 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.395301    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-oauth-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:01:30.395337 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.395329    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-oauth-serving-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:01:30.395337 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.395338    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-trusted-ca-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:01:30.395337 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.395347    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:01:30.395623 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.395356    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5rxd\" (UniqueName: \"kubernetes.io/projected/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-kube-api-access-h5rxd\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:01:30.395623 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.395364    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:01:30.395623 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:30.395372    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f67fc1a-ccd6-4cfd-babd-f82ed697d589-console-serving-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:01:31.003869 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:31.003834    2556 generic.go:356] "Generic (PLEG): container finished" podID="2f67fc1a-ccd6-4cfd-babd-f82ed697d589" containerID="523957c7c3baf0ad16d688c49ba8ee3081baad6ee8a2da2f555d104818967fd7" exitCode=0
Jul 09 02:01:31.004329 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:31.003879    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9cb85569-52zcr"
Jul 09 02:01:31.004329 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:31.003922    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9cb85569-52zcr" event={"ID":"2f67fc1a-ccd6-4cfd-babd-f82ed697d589","Type":"ContainerDied","Data":"523957c7c3baf0ad16d688c49ba8ee3081baad6ee8a2da2f555d104818967fd7"}
Jul 09 02:01:31.004329 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:31.003974    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9cb85569-52zcr" event={"ID":"2f67fc1a-ccd6-4cfd-babd-f82ed697d589","Type":"ContainerDied","Data":"b784b44d5cc6c6411d0f32cfaf82079f1b73b2ddc44b125fff290bef8808a601"}
Jul 09 02:01:31.004329 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:31.003996    2556 scope.go:117] "RemoveContainer" containerID="523957c7c3baf0ad16d688c49ba8ee3081baad6ee8a2da2f555d104818967fd7"
Jul 09 02:01:31.013657 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:31.013638    2556 scope.go:117] "RemoveContainer" containerID="523957c7c3baf0ad16d688c49ba8ee3081baad6ee8a2da2f555d104818967fd7"
Jul 09 02:01:31.013977 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:01:31.013939    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"523957c7c3baf0ad16d688c49ba8ee3081baad6ee8a2da2f555d104818967fd7\": container with ID starting with 523957c7c3baf0ad16d688c49ba8ee3081baad6ee8a2da2f555d104818967fd7 not found: ID does not exist" containerID="523957c7c3baf0ad16d688c49ba8ee3081baad6ee8a2da2f555d104818967fd7"
Jul 09 02:01:31.014052 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:31.013984    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"523957c7c3baf0ad16d688c49ba8ee3081baad6ee8a2da2f555d104818967fd7"} err="failed to get container status \"523957c7c3baf0ad16d688c49ba8ee3081baad6ee8a2da2f555d104818967fd7\": rpc error: code = NotFound desc = could not find container \"523957c7c3baf0ad16d688c49ba8ee3081baad6ee8a2da2f555d104818967fd7\": container with ID starting with 523957c7c3baf0ad16d688c49ba8ee3081baad6ee8a2da2f555d104818967fd7 not found: ID does not exist"
Jul 09 02:01:31.030003 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:31.029974    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b9cb85569-52zcr"]
Jul 09 02:01:31.032425 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:31.032402    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b9cb85569-52zcr"]
Jul 09 02:01:31.272806 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:01:31.272733    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f67fc1a-ccd6-4cfd-babd-f82ed697d589" path="/var/lib/kubelet/pods/2f67fc1a-ccd6-4cfd-babd-f82ed697d589/volumes"
Jul 09 02:02:18.567002 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:18.566967    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 02:02:18.567580 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:18.567326    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="alertmanager" containerID="cri-o://2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27" gracePeriod=120
Jul 09 02:02:18.567580 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:18.567401    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="kube-rbac-proxy-metric" containerID="cri-o://e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394" gracePeriod=120
Jul 09 02:02:18.567580 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:18.567421    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="prom-label-proxy" containerID="cri-o://6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc" gracePeriod=120
Jul 09 02:02:18.567580 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:18.567463    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="config-reloader" containerID="cri-o://9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a" gracePeriod=120
Jul 09 02:02:18.567580 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:18.567472    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="kube-rbac-proxy" containerID="cri-o://ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035" gracePeriod=120
Jul 09 02:02:18.567580 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:18.567441    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="kube-rbac-proxy-web" containerID="cri-o://bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47" gracePeriod=120
Jul 09 02:02:19.193940 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.193908    2556 generic.go:356] "Generic (PLEG): container finished" podID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerID="6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc" exitCode=0
Jul 09 02:02:19.193940 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.193934    2556 generic.go:356] "Generic (PLEG): container finished" podID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerID="ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035" exitCode=0
Jul 09 02:02:19.193940 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.193942    2556 generic.go:356] "Generic (PLEG): container finished" podID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerID="9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a" exitCode=0
Jul 09 02:02:19.193940 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.193948    2556 generic.go:356] "Generic (PLEG): container finished" podID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerID="2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27" exitCode=0
Jul 09 02:02:19.194199 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.193981    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerDied","Data":"6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc"}
Jul 09 02:02:19.194199 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.194041    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerDied","Data":"ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035"}
Jul 09 02:02:19.194199 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.194069    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerDied","Data":"9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a"}
Jul 09 02:02:19.194199 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.194094    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerDied","Data":"2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27"}
Jul 09 02:02:19.806504 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.806479    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:19.909782 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.909698    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-tls-assets\") pod \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") "
Jul 09 02:02:19.909782 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.909737    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-config-volume\") pod \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") "
Jul 09 02:02:19.909782 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.909773    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") "
Jul 09 02:02:19.910042 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.909790    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-cluster-tls-config\") pod \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") "
Jul 09 02:02:19.910042 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.909920    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") "
Jul 09 02:02:19.910042 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.909980    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-main-tls\") pod \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") "
Jul 09 02:02:19.910042 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.910015    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-alertmanager-main-db\") pod \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") "
Jul 09 02:02:19.910248 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.910059    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy\") pod \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") "
Jul 09 02:02:19.910248 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.910111    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-web-config\") pod \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") "
Jul 09 02:02:19.910248 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.910171    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-alertmanager-trusted-ca-bundle\") pod \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") "
Jul 09 02:02:19.910248 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.910203    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-metrics-client-ca\") pod \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") "
Jul 09 02:02:19.910248 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.910241    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-config-out\") pod \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") "
Jul 09 02:02:19.910481 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.910270    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pxwz\" (UniqueName: \"kubernetes.io/projected/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-kube-api-access-4pxwz\") pod \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\" (UID: \"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7\") "
Jul 09 02:02:19.911854 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.911597    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" (UID: "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:02:19.911854 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.911625    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" (UID: "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:02:19.911854 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.911840    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" (UID: "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:02:19.912844 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.912813    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" (UID: "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:02:19.913053 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.912969    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" (UID: "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:02:19.913169 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.913071    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" (UID: "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:02:19.913382 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.913354    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-kube-api-access-4pxwz" (OuterVolumeSpecName: "kube-api-access-4pxwz") pod "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" (UID: "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7"). InnerVolumeSpecName "kube-api-access-4pxwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:02:19.913480 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.913410    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" (UID: "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:02:19.913923 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.913886    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-config-volume" (OuterVolumeSpecName: "config-volume") pod "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" (UID: "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:02:19.914210 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.914190    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-config-out" (OuterVolumeSpecName: "config-out") pod "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" (UID: "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:02:19.915194 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.915167    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" (UID: "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:02:19.917943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.917701    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" (UID: "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:02:19.924886 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:19.924856    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-web-config" (OuterVolumeSpecName: "web-config") pod "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" (UID: "9af0c3b8-7173-46f9-8857-d1e1bad3e4f7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:02:20.011652 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.011602    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:02:20.011652 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.011648    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-web-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:02:20.011652 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.011659    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:02:20.011652 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.011668    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-metrics-client-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:02:20.011897 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.011676    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-config-out\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:02:20.011897 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.011686    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pxwz\" (UniqueName: \"kubernetes.io/projected/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-kube-api-access-4pxwz\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:02:20.011897 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.011694    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-tls-assets\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:02:20.011897 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.011702    2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-config-volume\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:02:20.011897 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.011710    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:02:20.011897 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.011721    2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-cluster-tls-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:02:20.011897 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.011731    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:02:20.011897 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.011740    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-secret-alertmanager-main-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:02:20.011897 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.011750    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7-alertmanager-main-db\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:02:20.200408 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.200327    2556 generic.go:356] "Generic (PLEG): container finished" podID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerID="e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394" exitCode=0
Jul 09 02:02:20.200408 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.200351    2556 generic.go:356] "Generic (PLEG): container finished" podID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerID="bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47" exitCode=0
Jul 09 02:02:20.200408 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.200394    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.200408 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.200399    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerDied","Data":"e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394"}
Jul 09 02:02:20.200654 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.200465    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerDied","Data":"bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47"}
Jul 09 02:02:20.200654 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.200492    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9af0c3b8-7173-46f9-8857-d1e1bad3e4f7","Type":"ContainerDied","Data":"c38755d02f3656469db342736a45bb93399617e5ae0bd47fda0fa6c991247788"}
Jul 09 02:02:20.200654 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.200523    2556 scope.go:117] "RemoveContainer" containerID="6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc"
Jul 09 02:02:20.208878 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.208858    2556 scope.go:117] "RemoveContainer" containerID="e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394"
Jul 09 02:02:20.216551 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.216529    2556 scope.go:117] "RemoveContainer" containerID="ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035"
Jul 09 02:02:20.224130 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.224106    2556 scope.go:117] "RemoveContainer" containerID="bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47"
Jul 09 02:02:20.226141 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.226116    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 02:02:20.231569 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.231536    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 02:02:20.232411 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.232394    2556 scope.go:117] "RemoveContainer" containerID="9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a"
Jul 09 02:02:20.239585 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.239549    2556 scope.go:117] "RemoveContainer" containerID="2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27"
Jul 09 02:02:20.246829 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.246813    2556 scope.go:117] "RemoveContainer" containerID="675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777"
Jul 09 02:02:20.253705 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.253611    2556 scope.go:117] "RemoveContainer" containerID="6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc"
Jul 09 02:02:20.253901 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:02:20.253882    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc\": container with ID starting with 6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc not found: ID does not exist" containerID="6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc"
Jul 09 02:02:20.253950 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.253911    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc"} err="failed to get container status \"6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc\": rpc error: code = NotFound desc = could not find container \"6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc\": container with ID starting with 6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc not found: ID does not exist"
Jul 09 02:02:20.253950 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.253930    2556 scope.go:117] "RemoveContainer" containerID="e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394"
Jul 09 02:02:20.254190 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:02:20.254172    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394\": container with ID starting with e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394 not found: ID does not exist" containerID="e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394"
Jul 09 02:02:20.254236 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.254198    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394"} err="failed to get container status \"e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394\": rpc error: code = NotFound desc = could not find container \"e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394\": container with ID starting with e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394 not found: ID does not exist"
Jul 09 02:02:20.254236 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.254219    2556 scope.go:117] "RemoveContainer" containerID="ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035"
Jul 09 02:02:20.254455 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:02:20.254441    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035\": container with ID starting with ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035 not found: ID does not exist" containerID="ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035"
Jul 09 02:02:20.254496 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.254457    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035"} err="failed to get container status \"ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035\": rpc error: code = NotFound desc = could not find container \"ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035\": container with ID starting with ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035 not found: ID does not exist"
Jul 09 02:02:20.254496 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.254470    2556 scope.go:117] "RemoveContainer" containerID="bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47"
Jul 09 02:02:20.254728 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:02:20.254710    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47\": container with ID starting with bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47 not found: ID does not exist" containerID="bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47"
Jul 09 02:02:20.254810 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.254736    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47"} err="failed to get container status \"bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47\": rpc error: code = NotFound desc = could not find container \"bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47\": container with ID starting with bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47 not found: ID does not exist"
Jul 09 02:02:20.254810 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.254757    2556 scope.go:117] "RemoveContainer" containerID="9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a"
Jul 09 02:02:20.255018 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:02:20.255001    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a\": container with ID starting with 9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a not found: ID does not exist" containerID="9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a"
Jul 09 02:02:20.255059 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.255024    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a"} err="failed to get container status \"9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a\": rpc error: code = NotFound desc = could not find container \"9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a\": container with ID starting with 9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a not found: ID does not exist"
Jul 09 02:02:20.255059 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.255040    2556 scope.go:117] "RemoveContainer" containerID="2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27"
Jul 09 02:02:20.255236 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:02:20.255217    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27\": container with ID starting with 2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27 not found: ID does not exist" containerID="2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27"
Jul 09 02:02:20.255277 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.255239    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27"} err="failed to get container status \"2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27\": rpc error: code = NotFound desc = could not find container \"2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27\": container with ID starting with 2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27 not found: ID does not exist"
Jul 09 02:02:20.255277 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.255252    2556 scope.go:117] "RemoveContainer" containerID="675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777"
Jul 09 02:02:20.255429 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:02:20.255413    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777\": container with ID starting with 675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777 not found: ID does not exist" containerID="675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777"
Jul 09 02:02:20.255484 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.255435    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777"} err="failed to get container status \"675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777\": rpc error: code = NotFound desc = could not find container \"675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777\": container with ID starting with 675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777 not found: ID does not exist"
Jul 09 02:02:20.255484 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.255454    2556 scope.go:117] "RemoveContainer" containerID="6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc"
Jul 09 02:02:20.255701 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.255682    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc"} err="failed to get container status \"6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc\": rpc error: code = NotFound desc = could not find container \"6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc\": container with ID starting with 6d906935bc09273aecbb4a77df36c59483089a1bafa3a1081861d337554817bc not found: ID does not exist"
Jul 09 02:02:20.255742 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.255701    2556 scope.go:117] "RemoveContainer" containerID="e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394"
Jul 09 02:02:20.255893 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.255875    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394"} err="failed to get container status \"e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394\": rpc error: code = NotFound desc = could not find container \"e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394\": container with ID starting with e3673609a1239ee4fec7260524c0c453d1a18280f1bcc15d3dd8fbccef20c394 not found: ID does not exist"
Jul 09 02:02:20.255929 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.255894    2556 scope.go:117] "RemoveContainer" containerID="ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035"
Jul 09 02:02:20.256118 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.256102    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035"} err="failed to get container status \"ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035\": rpc error: code = NotFound desc = could not find container \"ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035\": container with ID starting with ee6e0be8287d5af60c6e5859f067977eec51827e0ba781b04bfea1faad3a3035 not found: ID does not exist"
Jul 09 02:02:20.256163 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.256118    2556 scope.go:117] "RemoveContainer" containerID="bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47"
Jul 09 02:02:20.256294 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.256280    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47"} err="failed to get container status \"bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47\": rpc error: code = NotFound desc = could not find container \"bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47\": container with ID starting with bd01b78d2e77bb71da8c66f45c99de0ede45bacf8664120c9e7efb49ec481f47 not found: ID does not exist"
Jul 09 02:02:20.256334 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.256294    2556 scope.go:117] "RemoveContainer" containerID="9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a"
Jul 09 02:02:20.256476 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.256462    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a"} err="failed to get container status \"9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a\": rpc error: code = NotFound desc = could not find container \"9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a\": container with ID starting with 9d87fd232110712b5761df940cacb43b4b7e323d9789305b3ac5936a2dec9e6a not found: ID does not exist"
Jul 09 02:02:20.256476 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.256476    2556 scope.go:117] "RemoveContainer" containerID="2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27"
Jul 09 02:02:20.256701 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.256682    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27"} err="failed to get container status \"2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27\": rpc error: code = NotFound desc = could not find container \"2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27\": container with ID starting with 2683279de9510bef750c8cd4d516f5f73ab39a4f58de59b010d5d1be35c78d27 not found: ID does not exist"
Jul 09 02:02:20.256751 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.256703    2556 scope.go:117] "RemoveContainer" containerID="675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777"
Jul 09 02:02:20.256912 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.256896    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777"} err="failed to get container status \"675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777\": rpc error: code = NotFound desc = could not find container \"675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777\": container with ID starting with 675a8f31668dc575cef012e2154c02f0992e20c1b21101f452e66a8e0c603777 not found: ID does not exist"
Jul 09 02:02:20.266514 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.265830    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 02:02:20.266514 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.266456    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="config-reloader"
Jul 09 02:02:20.266514 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.266476    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="config-reloader"
Jul 09 02:02:20.266514 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.266490    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="init-config-reloader"
Jul 09 02:02:20.266752 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.266499    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="init-config-reloader"
Jul 09 02:02:20.266752 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.266601    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f67fc1a-ccd6-4cfd-babd-f82ed697d589" containerName="console"
Jul 09 02:02:20.266752 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.266612    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f67fc1a-ccd6-4cfd-babd-f82ed697d589" containerName="console"
Jul 09 02:02:20.266752 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.266623    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="kube-rbac-proxy"
Jul 09 02:02:20.266752 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.266629    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="kube-rbac-proxy"
Jul 09 02:02:20.266897 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.266779    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="kube-rbac-proxy-metric"
Jul 09 02:02:20.266976 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.266964    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="kube-rbac-proxy-metric"
Jul 09 02:02:20.267010 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.266985    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="kube-rbac-proxy-web"
Jul 09 02:02:20.267010 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.266994    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="kube-rbac-proxy-web"
Jul 09 02:02:20.267010 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.267007    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="alertmanager"
Jul 09 02:02:20.267104 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.267013    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="alertmanager"
Jul 09 02:02:20.267104 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.267019    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="prom-label-proxy"
Jul 09 02:02:20.267104 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.267027    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="prom-label-proxy"
Jul 09 02:02:20.267104 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.267100    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f67fc1a-ccd6-4cfd-babd-f82ed697d589" containerName="console"
Jul 09 02:02:20.267254 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.267110    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="kube-rbac-proxy-metric"
Jul 09 02:02:20.267254 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.267119    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="config-reloader"
Jul 09 02:02:20.267254 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.267129    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="kube-rbac-proxy-web"
Jul 09 02:02:20.267254 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.267140    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="alertmanager"
Jul 09 02:02:20.267254 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.267149    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="prom-label-proxy"
Jul 09 02:02:20.267254 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.267155    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" containerName="kube-rbac-proxy"
Jul 09 02:02:20.270746 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.270729    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.275375 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.275346    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 02:02:20.275375 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.275365    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 02:02:20.275642 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.275378    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-k5gnr\""
Jul 09 02:02:20.275642 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.275379    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 02:02:20.275642 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.275437    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 02:02:20.275642 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.275350    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 02:02:20.275899 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.275658    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 02:02:20.275899 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.275782    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 02:02:20.275899 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.275852    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 02:02:20.280409 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.280391    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 02:02:20.285936 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.285911    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 02:02:20.313695 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.313661    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c58805f6-bebf-4bcf-a49e-3998415d5330-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.313695 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.313705    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-config-volume\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.313953 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.313723    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.313953 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.313746    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.313953 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.313869    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-web-config\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.314117 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.313980    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c58805f6-bebf-4bcf-a49e-3998415d5330-config-out\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.314117 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.314013    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.314117 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.314050    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.314117 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.314101    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58805f6-bebf-4bcf-a49e-3998415d5330-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.314320 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.314182    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6prw2\" (UniqueName: \"kubernetes.io/projected/c58805f6-bebf-4bcf-a49e-3998415d5330-kube-api-access-6prw2\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.314320 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.314227    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c58805f6-bebf-4bcf-a49e-3998415d5330-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.314320 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.314293    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c58805f6-bebf-4bcf-a49e-3998415d5330-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.314486 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.314350    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.415662 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.415621    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c58805f6-bebf-4bcf-a49e-3998415d5330-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.415662 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.415663    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c58805f6-bebf-4bcf-a49e-3998415d5330-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.415926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.415702    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.415926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.415730    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c58805f6-bebf-4bcf-a49e-3998415d5330-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.415926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.415760    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-config-volume\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.415926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.415779    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.415926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.415915    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.416218 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.415968    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-web-config\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.416218 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.416012    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c58805f6-bebf-4bcf-a49e-3998415d5330-config-out\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.416218 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.416034    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.416218 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.416067    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.416218 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.416092    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58805f6-bebf-4bcf-a49e-3998415d5330-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.416218 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.416127    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6prw2\" (UniqueName: \"kubernetes.io/projected/c58805f6-bebf-4bcf-a49e-3998415d5330-kube-api-access-6prw2\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.416218 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.416147    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c58805f6-bebf-4bcf-a49e-3998415d5330-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.417319 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.416657    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c58805f6-bebf-4bcf-a49e-3998415d5330-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.417319 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.417315    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c58805f6-bebf-4bcf-a49e-3998415d5330-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.418910 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.418870    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.419265 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.419152    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-config-volume\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.419265 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.419162    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c58805f6-bebf-4bcf-a49e-3998415d5330-config-out\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.419265 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.419159    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.419491 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.419347    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c58805f6-bebf-4bcf-a49e-3998415d5330-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.419750 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.419730    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.419848 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.419826    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-web-config\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.419888 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.419856    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.420300 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.420286    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c58805f6-bebf-4bcf-a49e-3998415d5330-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.426742 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.426718    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6prw2\" (UniqueName: \"kubernetes.io/projected/c58805f6-bebf-4bcf-a49e-3998415d5330-kube-api-access-6prw2\") pod \"alertmanager-main-0\" (UID: \"c58805f6-bebf-4bcf-a49e-3998415d5330\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.580990 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.580903    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 02:02:20.724376 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:20.724343    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 02:02:20.727893 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:02:20.727863    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58805f6_bebf_4bcf_a49e_3998415d5330.slice/crio-0538ab4bf3ef60db045734bcd56068e5162798d0d626d24f37081877b0c852a1 WatchSource:0}: Error finding container 0538ab4bf3ef60db045734bcd56068e5162798d0d626d24f37081877b0c852a1: Status 404 returned error can't find the container with id 0538ab4bf3ef60db045734bcd56068e5162798d0d626d24f37081877b0c852a1
Jul 09 02:02:21.206870 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:21.206833    2556 generic.go:356] "Generic (PLEG): container finished" podID="c58805f6-bebf-4bcf-a49e-3998415d5330" containerID="6532c83b4d31cfc11e8f751b92491f720aba6f18fa9e7668e2461fa67b66a86a" exitCode=0
Jul 09 02:02:21.207320 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:21.206927    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c58805f6-bebf-4bcf-a49e-3998415d5330","Type":"ContainerDied","Data":"6532c83b4d31cfc11e8f751b92491f720aba6f18fa9e7668e2461fa67b66a86a"}
Jul 09 02:02:21.207320 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:21.206992    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c58805f6-bebf-4bcf-a49e-3998415d5330","Type":"ContainerStarted","Data":"0538ab4bf3ef60db045734bcd56068e5162798d0d626d24f37081877b0c852a1"}
Jul 09 02:02:21.273391 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:21.273365    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9af0c3b8-7173-46f9-8857-d1e1bad3e4f7" path="/var/lib/kubelet/pods/9af0c3b8-7173-46f9-8857-d1e1bad3e4f7/volumes"
Jul 09 02:02:22.215113 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.215076    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c58805f6-bebf-4bcf-a49e-3998415d5330","Type":"ContainerStarted","Data":"3344690d27bfc34e001a675f102f4a340923147a9e7eabc68027c2cdbaa03ed0"}
Jul 09 02:02:22.215498 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.215172    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c58805f6-bebf-4bcf-a49e-3998415d5330","Type":"ContainerStarted","Data":"bc86f9cc2cfbb301780964e165dd98bf0c54de8cddc82fb5701b82006c1e90fb"}
Jul 09 02:02:22.215498 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.215197    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c58805f6-bebf-4bcf-a49e-3998415d5330","Type":"ContainerStarted","Data":"dc6c3e7ebcd77614b6f0f09c1a9f52c795601f2f57b51051647db5d6591d2360"}
Jul 09 02:02:22.215498 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.215230    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c58805f6-bebf-4bcf-a49e-3998415d5330","Type":"ContainerStarted","Data":"e68e33a1d7d8c2350bb525cd5d8a7494c6eabb9020ee22f8a7fbfe2435c2e827"}
Jul 09 02:02:22.215498 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.215254    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c58805f6-bebf-4bcf-a49e-3998415d5330","Type":"ContainerStarted","Data":"09a4827a91a6d066284e79db9588707202e4bf1aa0f5e47d4033e8be41b8e3af"}
Jul 09 02:02:22.215498 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.215286    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c58805f6-bebf-4bcf-a49e-3998415d5330","Type":"ContainerStarted","Data":"b17f3bfd27fb20f11fbe70430d8b6eb71c98dfc00a4db4f970b0f24e6d6bd375"}
Jul 09 02:02:22.248071 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.248010    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.231584259 podStartE2EDuration="2.247993097s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.408838ms" isStatefulPod=false podCreationTimestamp="2026-07-09 02:02:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:02:22.246346325 +0000 UTC m=+167.528270462" watchObservedRunningTime="2026-07-09 02:02:22.247993097 +0000 UTC m=+167.529917234"
Jul 09 02:02:22.605725 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.605686    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-84b7586788-c9bqt"]
Jul 09 02:02:22.608481 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.608450    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.611724 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.611685    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 09 02:02:22.611724 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.611686    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 09 02:02:22.611934 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.611685    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 09 02:02:22.611934 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.611817    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 09 02:02:22.612043 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.612030    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 09 02:02:22.613823 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.613633    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5tnm5\""
Jul 09 02:02:22.619082 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.619062    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 09 02:02:22.625374 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.625343    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84b7586788-c9bqt"]
Jul 09 02:02:22.633205 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.633167    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-secret-telemeter-client\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.633467 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.633447    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pcb8\" (UniqueName: \"kubernetes.io/projected/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-kube-api-access-8pcb8\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.633611 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.633597    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-federate-client-tls\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.633714 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.633701    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-metrics-client-ca\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.633819 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.633804    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.633949 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.633934    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.634051 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.634039    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-serving-certs-ca-bundle\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.634148 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.634126    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-telemeter-client-tls\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.735335 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.735280    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.735539 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.735369    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-serving-certs-ca-bundle\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.735539 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.735411    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-telemeter-client-tls\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.735539 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.735463    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-secret-telemeter-client\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.735539 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.735513    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pcb8\" (UniqueName: \"kubernetes.io/projected/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-kube-api-access-8pcb8\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.735829 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.735578    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-federate-client-tls\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.735829 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.735615    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-metrics-client-ca\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.735829 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.735665    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.736499 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.736467    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-serving-certs-ca-bundle\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.737088 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.737067    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-metrics-client-ca\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.737341 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.737311    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.738714 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.738686    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.738916 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.738893    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-telemeter-client-tls\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.739108 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.739087    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-secret-telemeter-client\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.739372 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.739357    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-federate-client-tls\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.745672 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.745648    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pcb8\" (UniqueName: \"kubernetes.io/projected/e0269e02-ad16-4ce0-9d6f-d50ca3d0b188-kube-api-access-8pcb8\") pod \"telemeter-client-84b7586788-c9bqt\" (UID: \"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188\") " pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:22.920089 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:22.919781    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt"
Jul 09 02:02:23.081761 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:23.081730    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84b7586788-c9bqt"]
Jul 09 02:02:23.085046 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:02:23.085006    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0269e02_ad16_4ce0_9d6f_d50ca3d0b188.slice/crio-89a1325a49af16fe8d97822b3cda1a5cc7b7c0c50bd612ea27596271a909777c WatchSource:0}: Error finding container 89a1325a49af16fe8d97822b3cda1a5cc7b7c0c50bd612ea27596271a909777c: Status 404 returned error can't find the container with id 89a1325a49af16fe8d97822b3cda1a5cc7b7c0c50bd612ea27596271a909777c
Jul 09 02:02:23.222253 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:23.222158    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt" event={"ID":"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188","Type":"ContainerStarted","Data":"89a1325a49af16fe8d97822b3cda1a5cc7b7c0c50bd612ea27596271a909777c"}
Jul 09 02:02:25.232401 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:25.232366    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt" event={"ID":"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188","Type":"ContainerStarted","Data":"143caa531f960331484335a4e7d4290ae07d516955add6ca56c2a8ef1affd2d1"}
Jul 09 02:02:26.238416 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:26.238378    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt" event={"ID":"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188","Type":"ContainerStarted","Data":"b370e4bf1d12832279ea5d67390d9116d1302b834a775f8aad7072751652409c"}
Jul 09 02:02:26.238933 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:26.238439    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt" event={"ID":"e0269e02-ad16-4ce0-9d6f-d50ca3d0b188","Type":"ContainerStarted","Data":"0529de999b92af7ac2f2d11640286ca963b0709088afd193f1545cd3f6b11e93"}
Jul 09 02:02:26.265443 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:26.264971    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-84b7586788-c9bqt" podStartSLOduration=2.206036256 podStartE2EDuration="4.264950422s" totalImagesPullingTime="2.058914166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:02:26.263036754 +0000 UTC m=+171.544960889" watchObservedRunningTime="2026-07-09 02:02:26.264950422 +0000 UTC m=+171.546874558"
Jul 09 02:02:26.936322 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:26.936274    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77469857d9-8n7v4"]
Jul 09 02:02:26.938950 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:26.938920    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:26.954674 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:26.954644    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77469857d9-8n7v4"]
Jul 09 02:02:26.974339 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:26.974298    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-trusted-ca-bundle\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:26.974339 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:26.974341    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f24736c6-28fd-42ff-b079-1f393513e915-console-serving-cert\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:26.974550 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:26.974378    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f24736c6-28fd-42ff-b079-1f393513e915-console-oauth-config\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:26.974550 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:26.974410    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvpvx\" (UniqueName: \"kubernetes.io/projected/f24736c6-28fd-42ff-b079-1f393513e915-kube-api-access-mvpvx\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:26.974550 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:26.974483    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-console-config\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:26.974550 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:26.974509    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-service-ca\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:26.974550 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:26.974531    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-oauth-serving-cert\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.076090 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.076045    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-trusted-ca-bundle\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.076299 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.076101    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f24736c6-28fd-42ff-b079-1f393513e915-console-serving-cert\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.076299 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.076147    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f24736c6-28fd-42ff-b079-1f393513e915-console-oauth-config\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.076299 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.076181    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvpvx\" (UniqueName: \"kubernetes.io/projected/f24736c6-28fd-42ff-b079-1f393513e915-kube-api-access-mvpvx\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.076299 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.076220    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-console-config\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.076299 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.076243    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-service-ca\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.076299 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.076263    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-oauth-serving-cert\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.077118 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.077090    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-oauth-serving-cert\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.077628 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.077427    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-service-ca\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.077628 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.077615    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-trusted-ca-bundle\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.077781 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.077645    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-console-config\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.079333 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.079308    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f24736c6-28fd-42ff-b079-1f393513e915-console-serving-cert\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.079811 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.079793    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f24736c6-28fd-42ff-b079-1f393513e915-console-oauth-config\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.086265 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.086236    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvpvx\" (UniqueName: \"kubernetes.io/projected/f24736c6-28fd-42ff-b079-1f393513e915-kube-api-access-mvpvx\") pod \"console-77469857d9-8n7v4\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") " pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.247627 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.247532    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:27.407411 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:27.407352    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77469857d9-8n7v4"]
Jul 09 02:02:27.410073 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:02:27.410045    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf24736c6_28fd_42ff_b079_1f393513e915.slice/crio-293794cad0fa092cdc8b135695e6c5d686a7ed6cf724cf1ce542ff94eaf84d16 WatchSource:0}: Error finding container 293794cad0fa092cdc8b135695e6c5d686a7ed6cf724cf1ce542ff94eaf84d16: Status 404 returned error can't find the container with id 293794cad0fa092cdc8b135695e6c5d686a7ed6cf724cf1ce542ff94eaf84d16
Jul 09 02:02:28.247609 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:28.247574    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77469857d9-8n7v4" event={"ID":"f24736c6-28fd-42ff-b079-1f393513e915","Type":"ContainerStarted","Data":"de67a14b06f28b97268c09991fe77da8dd4463d4e4a2fe69f0fa35c2352ddc4d"}
Jul 09 02:02:28.247753 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:28.247624    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77469857d9-8n7v4" event={"ID":"f24736c6-28fd-42ff-b079-1f393513e915","Type":"ContainerStarted","Data":"293794cad0fa092cdc8b135695e6c5d686a7ed6cf724cf1ce542ff94eaf84d16"}
Jul 09 02:02:28.267831 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:28.267776    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77469857d9-8n7v4" podStartSLOduration=2.2677593529999998 podStartE2EDuration="2.267759353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:02:28.267095541 +0000 UTC m=+173.549019679" watchObservedRunningTime="2026-07-09 02:02:28.267759353 +0000 UTC m=+173.549683488"
Jul 09 02:02:37.248137 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:37.248099    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:37.248520 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:37.248195    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:37.252890 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:37.252868    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:37.288079 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:37.288046    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:02:37.343884 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:02:37.343840    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c457554d-4rn84"]
Jul 09 02:03:02.367056 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.366997    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-84c457554d-4rn84" podUID="235d8d93-7888-405c-b30b-5e04143a7fde" containerName="console" containerID="cri-o://d7a61cd2e41909f348fe556d6d9a90f9740fd0be593b7b37447cc5dd77661bbf" gracePeriod=15
Jul 09 02:03:02.613002 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.612976    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:03:02.795974 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.795875    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/235d8d93-7888-405c-b30b-5e04143a7fde-console-serving-cert\") pod \"235d8d93-7888-405c-b30b-5e04143a7fde\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") "
Jul 09 02:03:02.795974 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.795927    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-trusted-ca-bundle\") pod \"235d8d93-7888-405c-b30b-5e04143a7fde\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") "
Jul 09 02:03:02.795974 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.795947    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-oauth-serving-cert\") pod \"235d8d93-7888-405c-b30b-5e04143a7fde\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") "
Jul 09 02:03:02.795974 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.795970    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-service-ca\") pod \"235d8d93-7888-405c-b30b-5e04143a7fde\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") "
Jul 09 02:03:02.796307 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.796033    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-console-config\") pod \"235d8d93-7888-405c-b30b-5e04143a7fde\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") "
Jul 09 02:03:02.796307 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.796055    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9n6f\" (UniqueName: \"kubernetes.io/projected/235d8d93-7888-405c-b30b-5e04143a7fde-kube-api-access-h9n6f\") pod \"235d8d93-7888-405c-b30b-5e04143a7fde\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") "
Jul 09 02:03:02.796307 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.796088    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/235d8d93-7888-405c-b30b-5e04143a7fde-console-oauth-config\") pod \"235d8d93-7888-405c-b30b-5e04143a7fde\" (UID: \"235d8d93-7888-405c-b30b-5e04143a7fde\") "
Jul 09 02:03:02.796525 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.796460    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "235d8d93-7888-405c-b30b-5e04143a7fde" (UID: "235d8d93-7888-405c-b30b-5e04143a7fde"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:03:02.796525 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.796465    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "235d8d93-7888-405c-b30b-5e04143a7fde" (UID: "235d8d93-7888-405c-b30b-5e04143a7fde"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:03:02.796668 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.796530    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-service-ca" (OuterVolumeSpecName: "service-ca") pod "235d8d93-7888-405c-b30b-5e04143a7fde" (UID: "235d8d93-7888-405c-b30b-5e04143a7fde"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:03:02.796668 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.796588    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-console-config" (OuterVolumeSpecName: "console-config") pod "235d8d93-7888-405c-b30b-5e04143a7fde" (UID: "235d8d93-7888-405c-b30b-5e04143a7fde"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:03:02.798333 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.798306    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/235d8d93-7888-405c-b30b-5e04143a7fde-kube-api-access-h9n6f" (OuterVolumeSpecName: "kube-api-access-h9n6f") pod "235d8d93-7888-405c-b30b-5e04143a7fde" (UID: "235d8d93-7888-405c-b30b-5e04143a7fde"). InnerVolumeSpecName "kube-api-access-h9n6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:03:02.798435 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.798341    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/235d8d93-7888-405c-b30b-5e04143a7fde-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "235d8d93-7888-405c-b30b-5e04143a7fde" (UID: "235d8d93-7888-405c-b30b-5e04143a7fde"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:03:02.798435 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.798369    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/235d8d93-7888-405c-b30b-5e04143a7fde-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "235d8d93-7888-405c-b30b-5e04143a7fde" (UID: "235d8d93-7888-405c-b30b-5e04143a7fde"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:03:02.897552 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.897517    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-console-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:03:02.897552 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.897545    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9n6f\" (UniqueName: \"kubernetes.io/projected/235d8d93-7888-405c-b30b-5e04143a7fde-kube-api-access-h9n6f\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:03:02.897552 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.897576    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/235d8d93-7888-405c-b30b-5e04143a7fde-console-oauth-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:03:02.897552 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.897586    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/235d8d93-7888-405c-b30b-5e04143a7fde-console-serving-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:03:02.897845 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.897594    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-trusted-ca-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:03:02.897845 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.897603    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-oauth-serving-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:03:02.897845 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:02.897611    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/235d8d93-7888-405c-b30b-5e04143a7fde-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:03:03.393787 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:03.393742    2556 generic.go:356] "Generic (PLEG): container finished" podID="235d8d93-7888-405c-b30b-5e04143a7fde" containerID="d7a61cd2e41909f348fe556d6d9a90f9740fd0be593b7b37447cc5dd77661bbf" exitCode=0
Jul 09 02:03:03.393787 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:03.393790    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c457554d-4rn84"
Jul 09 02:03:03.394258 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:03.393823    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c457554d-4rn84" event={"ID":"235d8d93-7888-405c-b30b-5e04143a7fde","Type":"ContainerDied","Data":"d7a61cd2e41909f348fe556d6d9a90f9740fd0be593b7b37447cc5dd77661bbf"}
Jul 09 02:03:03.394258 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:03.393884    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c457554d-4rn84" event={"ID":"235d8d93-7888-405c-b30b-5e04143a7fde","Type":"ContainerDied","Data":"07c386d4cc437035d141c4b3b7a185e91628ae7808ef2266a8322ddefef039a6"}
Jul 09 02:03:03.394258 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:03.393907    2556 scope.go:117] "RemoveContainer" containerID="d7a61cd2e41909f348fe556d6d9a90f9740fd0be593b7b37447cc5dd77661bbf"
Jul 09 02:03:03.402063 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:03.402044    2556 scope.go:117] "RemoveContainer" containerID="d7a61cd2e41909f348fe556d6d9a90f9740fd0be593b7b37447cc5dd77661bbf"
Jul 09 02:03:03.402378 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:03:03.402354    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7a61cd2e41909f348fe556d6d9a90f9740fd0be593b7b37447cc5dd77661bbf\": container with ID starting with d7a61cd2e41909f348fe556d6d9a90f9740fd0be593b7b37447cc5dd77661bbf not found: ID does not exist" containerID="d7a61cd2e41909f348fe556d6d9a90f9740fd0be593b7b37447cc5dd77661bbf"
Jul 09 02:03:03.402449 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:03.402388    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7a61cd2e41909f348fe556d6d9a90f9740fd0be593b7b37447cc5dd77661bbf"} err="failed to get container status \"d7a61cd2e41909f348fe556d6d9a90f9740fd0be593b7b37447cc5dd77661bbf\": rpc error: code = NotFound desc = could not find container \"d7a61cd2e41909f348fe556d6d9a90f9740fd0be593b7b37447cc5dd77661bbf\": container with ID starting with d7a61cd2e41909f348fe556d6d9a90f9740fd0be593b7b37447cc5dd77661bbf not found: ID does not exist"
Jul 09 02:03:03.411372 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:03.411343    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c457554d-4rn84"]
Jul 09 02:03:03.417197 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:03.417167    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84c457554d-4rn84"]
Jul 09 02:03:05.278315 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:05.276134    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="235d8d93-7888-405c-b30b-5e04143a7fde" path="/var/lib/kubelet/pods/235d8d93-7888-405c-b30b-5e04143a7fde/volumes"
Jul 09 02:03:35.585811 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.585737    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59464dd586-vmnpv"]
Jul 09 02:03:35.586189 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.586109    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="235d8d93-7888-405c-b30b-5e04143a7fde" containerName="console"
Jul 09 02:03:35.586189 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.586121    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="235d8d93-7888-405c-b30b-5e04143a7fde" containerName="console"
Jul 09 02:03:35.586189 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.586190    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="235d8d93-7888-405c-b30b-5e04143a7fde" containerName="console"
Jul 09 02:03:35.589741 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.589722    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.603132 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.603105    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59464dd586-vmnpv"]
Jul 09 02:03:35.627796 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.627769    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-config\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.627959 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.627802    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-trusted-ca-bundle\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.627959 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.627838    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-serving-cert\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.627959 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.627887    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-service-ca\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.627959 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.627911    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-oauth-config\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.627959 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.627943    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-oauth-serving-cert\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.627959 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.627960    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9jwv\" (UniqueName: \"kubernetes.io/projected/a5f58ea6-a398-4dec-833b-3769e92d3fd4-kube-api-access-q9jwv\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.728645 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.728591    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-trusted-ca-bundle\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.728645 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.728650    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-serving-cert\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.728645 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.728666    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-service-ca\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.729020 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.728688    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-oauth-config\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.729020 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.728716    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-oauth-serving-cert\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.729020 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.728741    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jwv\" (UniqueName: \"kubernetes.io/projected/a5f58ea6-a398-4dec-833b-3769e92d3fd4-kube-api-access-q9jwv\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.729020 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.728827    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-config\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.729542 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.729514    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-service-ca\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.729542 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.729525    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-oauth-serving-cert\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.729717 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.729634    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-config\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.729717 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.729670    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-trusted-ca-bundle\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.731235 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.731208    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-serving-cert\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.731235 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.731232    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-oauth-config\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.738285 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.738265    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9jwv\" (UniqueName: \"kubernetes.io/projected/a5f58ea6-a398-4dec-833b-3769e92d3fd4-kube-api-access-q9jwv\") pod \"console-59464dd586-vmnpv\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") " pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:35.898679 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:35.898649    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:36.034209 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:36.034080    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59464dd586-vmnpv"]
Jul 09 02:03:36.523087 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:36.523054    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59464dd586-vmnpv" event={"ID":"a5f58ea6-a398-4dec-833b-3769e92d3fd4","Type":"ContainerStarted","Data":"39f0566e3b498e36aefbfbafcfc66d6e235ce7e4073aa5634f2faf47300fc6ae"}
Jul 09 02:03:36.523314 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:36.523106    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59464dd586-vmnpv" event={"ID":"a5f58ea6-a398-4dec-833b-3769e92d3fd4","Type":"ContainerStarted","Data":"0e0d67daa161255bfe6033773c82f206be3b11f0a78605d6d22bbf3339f56028"}
Jul 09 02:03:36.541276 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:36.541221    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59464dd586-vmnpv" podStartSLOduration=1.541204265 podStartE2EDuration="1.541204265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:03:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:03:36.540301358 +0000 UTC m=+241.822225495" watchObservedRunningTime="2026-07-09 02:03:36.541204265 +0000 UTC m=+241.823128400"
Jul 09 02:03:45.899292 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:45.899247    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:45.899859 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:45.899319    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:45.904278 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:45.904249    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:46.570749 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:46.570719    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:03:46.618114 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:03:46.618080    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77469857d9-8n7v4"]
Jul 09 02:04:11.639342 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:11.639234    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-77469857d9-8n7v4" podUID="f24736c6-28fd-42ff-b079-1f393513e915" containerName="console" containerID="cri-o://de67a14b06f28b97268c09991fe77da8dd4463d4e4a2fe69f0fa35c2352ddc4d" gracePeriod=15
Jul 09 02:04:11.879154 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:11.879130    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:04:12.055960 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.055871    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f24736c6-28fd-42ff-b079-1f393513e915-console-oauth-config\") pod \"f24736c6-28fd-42ff-b079-1f393513e915\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") "
Jul 09 02:04:12.055960 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.055925    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-console-config\") pod \"f24736c6-28fd-42ff-b079-1f393513e915\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") "
Jul 09 02:04:12.055960 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.055954    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-oauth-serving-cert\") pod \"f24736c6-28fd-42ff-b079-1f393513e915\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") "
Jul 09 02:04:12.056219 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.055970    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f24736c6-28fd-42ff-b079-1f393513e915-console-serving-cert\") pod \"f24736c6-28fd-42ff-b079-1f393513e915\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") "
Jul 09 02:04:12.056219 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.055999    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-service-ca\") pod \"f24736c6-28fd-42ff-b079-1f393513e915\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") "
Jul 09 02:04:12.056219 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.056037    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-trusted-ca-bundle\") pod \"f24736c6-28fd-42ff-b079-1f393513e915\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") "
Jul 09 02:04:12.056361 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.056210    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvpvx\" (UniqueName: \"kubernetes.io/projected/f24736c6-28fd-42ff-b079-1f393513e915-kube-api-access-mvpvx\") pod \"f24736c6-28fd-42ff-b079-1f393513e915\" (UID: \"f24736c6-28fd-42ff-b079-1f393513e915\") "
Jul 09 02:04:12.056414 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.056356    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f24736c6-28fd-42ff-b079-1f393513e915" (UID: "f24736c6-28fd-42ff-b079-1f393513e915"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:04:12.056471 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.056446    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-console-config" (OuterVolumeSpecName: "console-config") pod "f24736c6-28fd-42ff-b079-1f393513e915" (UID: "f24736c6-28fd-42ff-b079-1f393513e915"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:04:12.056471 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.056442    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-service-ca" (OuterVolumeSpecName: "service-ca") pod "f24736c6-28fd-42ff-b079-1f393513e915" (UID: "f24736c6-28fd-42ff-b079-1f393513e915"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:04:12.056617 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.056508    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f24736c6-28fd-42ff-b079-1f393513e915" (UID: "f24736c6-28fd-42ff-b079-1f393513e915"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:04:12.056617 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.056545    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-console-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:04:12.056617 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.056589    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-oauth-serving-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:04:12.056617 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.056605    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:04:12.058143 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.058118    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f24736c6-28fd-42ff-b079-1f393513e915-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f24736c6-28fd-42ff-b079-1f393513e915" (UID: "f24736c6-28fd-42ff-b079-1f393513e915"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:04:12.058282 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.058204    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f24736c6-28fd-42ff-b079-1f393513e915-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f24736c6-28fd-42ff-b079-1f393513e915" (UID: "f24736c6-28fd-42ff-b079-1f393513e915"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:04:12.058338 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.058298    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f24736c6-28fd-42ff-b079-1f393513e915-kube-api-access-mvpvx" (OuterVolumeSpecName: "kube-api-access-mvpvx") pod "f24736c6-28fd-42ff-b079-1f393513e915" (UID: "f24736c6-28fd-42ff-b079-1f393513e915"). InnerVolumeSpecName "kube-api-access-mvpvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:04:12.158032 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.157993    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvpvx\" (UniqueName: \"kubernetes.io/projected/f24736c6-28fd-42ff-b079-1f393513e915-kube-api-access-mvpvx\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:04:12.158032 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.158024    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f24736c6-28fd-42ff-b079-1f393513e915-console-oauth-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:04:12.158032 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.158036    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f24736c6-28fd-42ff-b079-1f393513e915-console-serving-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:04:12.158032 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.158045    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f24736c6-28fd-42ff-b079-1f393513e915-trusted-ca-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:04:12.675249 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.675210    2556 generic.go:356] "Generic (PLEG): container finished" podID="f24736c6-28fd-42ff-b079-1f393513e915" containerID="de67a14b06f28b97268c09991fe77da8dd4463d4e4a2fe69f0fa35c2352ddc4d" exitCode=0
Jul 09 02:04:12.675715 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.675266    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77469857d9-8n7v4"
Jul 09 02:04:12.675715 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.675290    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77469857d9-8n7v4" event={"ID":"f24736c6-28fd-42ff-b079-1f393513e915","Type":"ContainerDied","Data":"de67a14b06f28b97268c09991fe77da8dd4463d4e4a2fe69f0fa35c2352ddc4d"}
Jul 09 02:04:12.675715 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.675363    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77469857d9-8n7v4" event={"ID":"f24736c6-28fd-42ff-b079-1f393513e915","Type":"ContainerDied","Data":"293794cad0fa092cdc8b135695e6c5d686a7ed6cf724cf1ce542ff94eaf84d16"}
Jul 09 02:04:12.675715 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.675384    2556 scope.go:117] "RemoveContainer" containerID="de67a14b06f28b97268c09991fe77da8dd4463d4e4a2fe69f0fa35c2352ddc4d"
Jul 09 02:04:12.684147 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.684130    2556 scope.go:117] "RemoveContainer" containerID="de67a14b06f28b97268c09991fe77da8dd4463d4e4a2fe69f0fa35c2352ddc4d"
Jul 09 02:04:12.684429 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:04:12.684409    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de67a14b06f28b97268c09991fe77da8dd4463d4e4a2fe69f0fa35c2352ddc4d\": container with ID starting with de67a14b06f28b97268c09991fe77da8dd4463d4e4a2fe69f0fa35c2352ddc4d not found: ID does not exist" containerID="de67a14b06f28b97268c09991fe77da8dd4463d4e4a2fe69f0fa35c2352ddc4d"
Jul 09 02:04:12.684487 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.684437    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de67a14b06f28b97268c09991fe77da8dd4463d4e4a2fe69f0fa35c2352ddc4d"} err="failed to get container status \"de67a14b06f28b97268c09991fe77da8dd4463d4e4a2fe69f0fa35c2352ddc4d\": rpc error: code = NotFound desc = could not find container \"de67a14b06f28b97268c09991fe77da8dd4463d4e4a2fe69f0fa35c2352ddc4d\": container with ID starting with de67a14b06f28b97268c09991fe77da8dd4463d4e4a2fe69f0fa35c2352ddc4d not found: ID does not exist"
Jul 09 02:04:12.697026 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.697002    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77469857d9-8n7v4"]
Jul 09 02:04:12.700539 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:12.700516    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77469857d9-8n7v4"]
Jul 09 02:04:13.273009 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:13.272976    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f24736c6-28fd-42ff-b079-1f393513e915" path="/var/lib/kubelet/pods/f24736c6-28fd-42ff-b079-1f393513e915/volumes"
Jul 09 02:04:35.103504 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:35.103470    2556 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 02:04:39.050994 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.050954    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"]
Jul 09 02:04:39.052385 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.051285    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f24736c6-28fd-42ff-b079-1f393513e915" containerName="console"
Jul 09 02:04:39.052385 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.051297    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f24736c6-28fd-42ff-b079-1f393513e915" containerName="console"
Jul 09 02:04:39.052385 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.051362    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f24736c6-28fd-42ff-b079-1f393513e915" containerName="console"
Jul 09 02:04:39.053181 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.053165    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"
Jul 09 02:04:39.056446 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.056412    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 02:04:39.057226 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.057198    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5m8gr\""
Jul 09 02:04:39.057343 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.057325    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 02:04:39.065039 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.065011    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"]
Jul 09 02:04:39.166759 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.166704    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4a289ca-a760-4d4c-8e4c-3c834b777115-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z\" (UID: \"f4a289ca-a760-4d4c-8e4c-3c834b777115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"
Jul 09 02:04:39.166759 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.166758    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwspx\" (UniqueName: \"kubernetes.io/projected/f4a289ca-a760-4d4c-8e4c-3c834b777115-kube-api-access-bwspx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z\" (UID: \"f4a289ca-a760-4d4c-8e4c-3c834b777115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"
Jul 09 02:04:39.166989 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.166786    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4a289ca-a760-4d4c-8e4c-3c834b777115-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z\" (UID: \"f4a289ca-a760-4d4c-8e4c-3c834b777115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"
Jul 09 02:04:39.267723 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.267685    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4a289ca-a760-4d4c-8e4c-3c834b777115-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z\" (UID: \"f4a289ca-a760-4d4c-8e4c-3c834b777115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"
Jul 09 02:04:39.267899 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.267766    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4a289ca-a760-4d4c-8e4c-3c834b777115-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z\" (UID: \"f4a289ca-a760-4d4c-8e4c-3c834b777115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"
Jul 09 02:04:39.267899 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.267783    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwspx\" (UniqueName: \"kubernetes.io/projected/f4a289ca-a760-4d4c-8e4c-3c834b777115-kube-api-access-bwspx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z\" (UID: \"f4a289ca-a760-4d4c-8e4c-3c834b777115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"
Jul 09 02:04:39.268152 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.268121    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4a289ca-a760-4d4c-8e4c-3c834b777115-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z\" (UID: \"f4a289ca-a760-4d4c-8e4c-3c834b777115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"
Jul 09 02:04:39.268152 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.268135    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4a289ca-a760-4d4c-8e4c-3c834b777115-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z\" (UID: \"f4a289ca-a760-4d4c-8e4c-3c834b777115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"
Jul 09 02:04:39.276621 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.276595    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwspx\" (UniqueName: \"kubernetes.io/projected/f4a289ca-a760-4d4c-8e4c-3c834b777115-kube-api-access-bwspx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z\" (UID: \"f4a289ca-a760-4d4c-8e4c-3c834b777115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"
Jul 09 02:04:39.366669 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.366626    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"
Jul 09 02:04:39.493947 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.493915    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"]
Jul 09 02:04:39.496952 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:04:39.496926    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a289ca_a760_4d4c_8e4c_3c834b777115.slice/crio-eb5771d828cc55a8b5dbb9e7a2ce245091326a806d2bc7d152fe6026e406dca2 WatchSource:0}: Error finding container eb5771d828cc55a8b5dbb9e7a2ce245091326a806d2bc7d152fe6026e406dca2: Status 404 returned error can't find the container with id eb5771d828cc55a8b5dbb9e7a2ce245091326a806d2bc7d152fe6026e406dca2
Jul 09 02:04:39.498881 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.498864    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 02:04:39.781294 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:39.781204    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z" event={"ID":"f4a289ca-a760-4d4c-8e4c-3c834b777115","Type":"ContainerStarted","Data":"eb5771d828cc55a8b5dbb9e7a2ce245091326a806d2bc7d152fe6026e406dca2"}
Jul 09 02:04:49.823998 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:49.823967    2556 generic.go:356] "Generic (PLEG): container finished" podID="f4a289ca-a760-4d4c-8e4c-3c834b777115" containerID="439849616c4fc8e9948864407097327f6827d774a80aef18cb3b0aaff11219e5" exitCode=0
Jul 09 02:04:49.824391 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:49.824049    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z" event={"ID":"f4a289ca-a760-4d4c-8e4c-3c834b777115","Type":"ContainerDied","Data":"439849616c4fc8e9948864407097327f6827d774a80aef18cb3b0aaff11219e5"}
Jul 09 02:04:52.837642 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:52.837604    2556 generic.go:356] "Generic (PLEG): container finished" podID="f4a289ca-a760-4d4c-8e4c-3c834b777115" containerID="e3cbbc1d6293e5ac5f4f3ed05c9336fe3cc2b1ef6d360beb6a9c21d044d00970" exitCode=0
Jul 09 02:04:52.838050 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:52.837683    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z" event={"ID":"f4a289ca-a760-4d4c-8e4c-3c834b777115","Type":"ContainerDied","Data":"e3cbbc1d6293e5ac5f4f3ed05c9336fe3cc2b1ef6d360beb6a9c21d044d00970"}
Jul 09 02:04:59.871992 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:59.871953    2556 generic.go:356] "Generic (PLEG): container finished" podID="f4a289ca-a760-4d4c-8e4c-3c834b777115" containerID="ce3041bc27e5277e3a08ddcf19fe7278595064b43130984061ebb553061a88ad" exitCode=0
Jul 09 02:04:59.872468 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:04:59.872021    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z" event={"ID":"f4a289ca-a760-4d4c-8e4c-3c834b777115","Type":"ContainerDied","Data":"ce3041bc27e5277e3a08ddcf19fe7278595064b43130984061ebb553061a88ad"}
Jul 09 02:05:01.007462 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:01.007438    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"
Jul 09 02:05:01.166608 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:01.166484    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4a289ca-a760-4d4c-8e4c-3c834b777115-util\") pod \"f4a289ca-a760-4d4c-8e4c-3c834b777115\" (UID: \"f4a289ca-a760-4d4c-8e4c-3c834b777115\") "
Jul 09 02:05:01.166608 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:01.166543    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4a289ca-a760-4d4c-8e4c-3c834b777115-bundle\") pod \"f4a289ca-a760-4d4c-8e4c-3c834b777115\" (UID: \"f4a289ca-a760-4d4c-8e4c-3c834b777115\") "
Jul 09 02:05:01.166608 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:01.166586    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwspx\" (UniqueName: \"kubernetes.io/projected/f4a289ca-a760-4d4c-8e4c-3c834b777115-kube-api-access-bwspx\") pod \"f4a289ca-a760-4d4c-8e4c-3c834b777115\" (UID: \"f4a289ca-a760-4d4c-8e4c-3c834b777115\") "
Jul 09 02:05:01.167153 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:01.167129    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4a289ca-a760-4d4c-8e4c-3c834b777115-bundle" (OuterVolumeSpecName: "bundle") pod "f4a289ca-a760-4d4c-8e4c-3c834b777115" (UID: "f4a289ca-a760-4d4c-8e4c-3c834b777115"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:05:01.168831 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:01.168807    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4a289ca-a760-4d4c-8e4c-3c834b777115-kube-api-access-bwspx" (OuterVolumeSpecName: "kube-api-access-bwspx") pod "f4a289ca-a760-4d4c-8e4c-3c834b777115" (UID: "f4a289ca-a760-4d4c-8e4c-3c834b777115"). InnerVolumeSpecName "kube-api-access-bwspx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:05:01.171850 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:01.171823    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4a289ca-a760-4d4c-8e4c-3c834b777115-util" (OuterVolumeSpecName: "util") pod "f4a289ca-a760-4d4c-8e4c-3c834b777115" (UID: "f4a289ca-a760-4d4c-8e4c-3c834b777115"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:05:01.267847 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:01.267817    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4a289ca-a760-4d4c-8e4c-3c834b777115-util\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:05:01.267847 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:01.267844    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4a289ca-a760-4d4c-8e4c-3c834b777115-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:05:01.267847 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:01.267853    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwspx\" (UniqueName: \"kubernetes.io/projected/f4a289ca-a760-4d4c-8e4c-3c834b777115-kube-api-access-bwspx\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:05:01.882000 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:01.881973    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z"
Jul 09 02:05:01.882175 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:01.881966    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402dx9z" event={"ID":"f4a289ca-a760-4d4c-8e4c-3c834b777115","Type":"ContainerDied","Data":"eb5771d828cc55a8b5dbb9e7a2ce245091326a806d2bc7d152fe6026e406dca2"}
Jul 09 02:05:01.882175 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:01.882098    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb5771d828cc55a8b5dbb9e7a2ce245091326a806d2bc7d152fe6026e406dca2"
Jul 09 02:05:07.137167 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.137129    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-njz7h"]
Jul 09 02:05:07.137539 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.137433    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4a289ca-a760-4d4c-8e4c-3c834b777115" containerName="util"
Jul 09 02:05:07.137539 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.137443    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4a289ca-a760-4d4c-8e4c-3c834b777115" containerName="util"
Jul 09 02:05:07.137539 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.137457    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4a289ca-a760-4d4c-8e4c-3c834b777115" containerName="pull"
Jul 09 02:05:07.137539 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.137462    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4a289ca-a760-4d4c-8e4c-3c834b777115" containerName="pull"
Jul 09 02:05:07.137539 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.137474    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4a289ca-a760-4d4c-8e4c-3c834b777115" containerName="extract"
Jul 09 02:05:07.137539 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.137480    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4a289ca-a760-4d4c-8e4c-3c834b777115" containerName="extract"
Jul 09 02:05:07.137539 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.137536    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4a289ca-a760-4d4c-8e4c-3c834b777115" containerName="extract"
Jul 09 02:05:07.199875 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.199838    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-njz7h"]
Jul 09 02:05:07.200044 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.199981    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-njz7h"
Jul 09 02:05:07.203503 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.203483    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-klqkx\""
Jul 09 02:05:07.203717 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.203704    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 09 02:05:07.204430 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.204417    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 09 02:05:07.331545 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.331509    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e06e684-35aa-477f-afa2-e2485c53a2a1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-njz7h\" (UID: \"3e06e684-35aa-477f-afa2-e2485c53a2a1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-njz7h"
Jul 09 02:05:07.331545 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.331545    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4rp7\" (UniqueName: \"kubernetes.io/projected/3e06e684-35aa-477f-afa2-e2485c53a2a1-kube-api-access-f4rp7\") pod \"cert-manager-operator-controller-manager-55c444bf86-njz7h\" (UID: \"3e06e684-35aa-477f-afa2-e2485c53a2a1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-njz7h"
Jul 09 02:05:07.433168 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.433076    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e06e684-35aa-477f-afa2-e2485c53a2a1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-njz7h\" (UID: \"3e06e684-35aa-477f-afa2-e2485c53a2a1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-njz7h"
Jul 09 02:05:07.433336 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.433286    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4rp7\" (UniqueName: \"kubernetes.io/projected/3e06e684-35aa-477f-afa2-e2485c53a2a1-kube-api-access-f4rp7\") pod \"cert-manager-operator-controller-manager-55c444bf86-njz7h\" (UID: \"3e06e684-35aa-477f-afa2-e2485c53a2a1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-njz7h"
Jul 09 02:05:07.433449 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.433427    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e06e684-35aa-477f-afa2-e2485c53a2a1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-njz7h\" (UID: \"3e06e684-35aa-477f-afa2-e2485c53a2a1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-njz7h"
Jul 09 02:05:07.442981 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.442946    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4rp7\" (UniqueName: \"kubernetes.io/projected/3e06e684-35aa-477f-afa2-e2485c53a2a1-kube-api-access-f4rp7\") pod \"cert-manager-operator-controller-manager-55c444bf86-njz7h\" (UID: \"3e06e684-35aa-477f-afa2-e2485c53a2a1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-njz7h"
Jul 09 02:05:07.509840 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.509799    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-njz7h"
Jul 09 02:05:07.672067 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.672033    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-njz7h"]
Jul 09 02:05:07.675975 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:05:07.675945    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e06e684_35aa_477f_afa2_e2485c53a2a1.slice/crio-1faf573b0a609d42ca49dce23388e6015d4c68ac6c3f8fb548292285252a18bd WatchSource:0}: Error finding container 1faf573b0a609d42ca49dce23388e6015d4c68ac6c3f8fb548292285252a18bd: Status 404 returned error can't find the container with id 1faf573b0a609d42ca49dce23388e6015d4c68ac6c3f8fb548292285252a18bd
Jul 09 02:05:07.907929 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:07.907895    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-njz7h" event={"ID":"3e06e684-35aa-477f-afa2-e2485c53a2a1","Type":"ContainerStarted","Data":"1faf573b0a609d42ca49dce23388e6015d4c68ac6c3f8fb548292285252a18bd"}
Jul 09 02:05:10.924205 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:10.924170    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-njz7h" event={"ID":"3e06e684-35aa-477f-afa2-e2485c53a2a1","Type":"ContainerStarted","Data":"c1b069f933560c34dc493c206d56b023a78db5ea7f768ddebba50e0bcfa64514"}
Jul 09 02:05:10.947859 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:10.947807    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-njz7h" podStartSLOduration=1.489454724 podStartE2EDuration="3.947785245s" totalImagesPullingTime="2.458330521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:05:10.946017969 +0000 UTC m=+336.227942117" watchObservedRunningTime="2026-07-09 02:05:10.947785245 +0000 UTC m=+336.229709382"
Jul 09 02:05:13.439983 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.439946    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gnhg6"]
Jul 09 02:05:13.442358 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.442342    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gnhg6"
Jul 09 02:05:13.444943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.444922    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 02:05:13.446112 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.446095    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 02:05:13.446206 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.446114    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-cz6ks\""
Jul 09 02:05:13.451318 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.451296    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gnhg6"]
Jul 09 02:05:13.485965 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.485922    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgnh5\" (UniqueName: \"kubernetes.io/projected/b1758d2f-dc36-4262-bf6b-178cf8168efa-kube-api-access-lgnh5\") pod \"cert-manager-webhook-6486ffd997-gnhg6\" (UID: \"b1758d2f-dc36-4262-bf6b-178cf8168efa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gnhg6"
Jul 09 02:05:13.486155 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.486002    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1758d2f-dc36-4262-bf6b-178cf8168efa-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gnhg6\" (UID: \"b1758d2f-dc36-4262-bf6b-178cf8168efa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gnhg6"
Jul 09 02:05:13.586622 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.586584    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1758d2f-dc36-4262-bf6b-178cf8168efa-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gnhg6\" (UID: \"b1758d2f-dc36-4262-bf6b-178cf8168efa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gnhg6"
Jul 09 02:05:13.586822 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.586756    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgnh5\" (UniqueName: \"kubernetes.io/projected/b1758d2f-dc36-4262-bf6b-178cf8168efa-kube-api-access-lgnh5\") pod \"cert-manager-webhook-6486ffd997-gnhg6\" (UID: \"b1758d2f-dc36-4262-bf6b-178cf8168efa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gnhg6"
Jul 09 02:05:13.595118 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.595091    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1758d2f-dc36-4262-bf6b-178cf8168efa-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gnhg6\" (UID: \"b1758d2f-dc36-4262-bf6b-178cf8168efa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gnhg6"
Jul 09 02:05:13.595283 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.595262    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgnh5\" (UniqueName: \"kubernetes.io/projected/b1758d2f-dc36-4262-bf6b-178cf8168efa-kube-api-access-lgnh5\") pod \"cert-manager-webhook-6486ffd997-gnhg6\" (UID: \"b1758d2f-dc36-4262-bf6b-178cf8168efa\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gnhg6"
Jul 09 02:05:13.752345 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.752252    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gnhg6"
Jul 09 02:05:13.887696 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.887670    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gnhg6"]
Jul 09 02:05:13.890355 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:05:13.890323    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1758d2f_dc36_4262_bf6b_178cf8168efa.slice/crio-88734a184d11e65329651d9f24a8f3d5251fea6482e4c2abef8e9e13fd9f50f5 WatchSource:0}: Error finding container 88734a184d11e65329651d9f24a8f3d5251fea6482e4c2abef8e9e13fd9f50f5: Status 404 returned error can't find the container with id 88734a184d11e65329651d9f24a8f3d5251fea6482e4c2abef8e9e13fd9f50f5
Jul 09 02:05:13.937215 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:13.937172    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gnhg6" event={"ID":"b1758d2f-dc36-4262-bf6b-178cf8168efa","Type":"ContainerStarted","Data":"88734a184d11e65329651d9f24a8f3d5251fea6482e4c2abef8e9e13fd9f50f5"}
Jul 09 02:05:16.954094 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:16.954055    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gnhg6" event={"ID":"b1758d2f-dc36-4262-bf6b-178cf8168efa","Type":"ContainerStarted","Data":"a8f9158a5b4ac7f8a3fb2b2215e1c53ec2b7c5afeda043855cfdd41042646af6"}
Jul 09 02:05:16.954617 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:16.954116    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gnhg6"
Jul 09 02:05:16.974454 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:16.974400    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gnhg6" podStartSLOduration=1.279258935 podStartE2EDuration="3.974384369s" totalImagesPullingTime="2.695125434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:05:16.973075037 +0000 UTC m=+342.254999170" watchObservedRunningTime="2026-07-09 02:05:16.974384369 +0000 UTC m=+342.256308504"
Jul 09 02:05:22.814720 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:22.814683    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6rfcv"]
Jul 09 02:05:22.817507 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:22.817486    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6rfcv"
Jul 09 02:05:22.820306 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:22.820291    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fltms\""
Jul 09 02:05:22.827297 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:22.827276    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6rfcv"]
Jul 09 02:05:22.868396 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:22.868367    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/038286af-42d0-4d5b-a7af-6aa54fa18684-bound-sa-token\") pod \"cert-manager-55b4d954d5-6rfcv\" (UID: \"038286af-42d0-4d5b-a7af-6aa54fa18684\") " pod="cert-manager/cert-manager-55b4d954d5-6rfcv"
Jul 09 02:05:22.868593 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:22.868422    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fspsm\" (UniqueName: \"kubernetes.io/projected/038286af-42d0-4d5b-a7af-6aa54fa18684-kube-api-access-fspsm\") pod \"cert-manager-55b4d954d5-6rfcv\" (UID: \"038286af-42d0-4d5b-a7af-6aa54fa18684\") " pod="cert-manager/cert-manager-55b4d954d5-6rfcv"
Jul 09 02:05:22.960910 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:22.960881    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gnhg6"
Jul 09 02:05:22.969050 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:22.969026    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/038286af-42d0-4d5b-a7af-6aa54fa18684-bound-sa-token\") pod \"cert-manager-55b4d954d5-6rfcv\" (UID: \"038286af-42d0-4d5b-a7af-6aa54fa18684\") " pod="cert-manager/cert-manager-55b4d954d5-6rfcv"
Jul 09 02:05:22.969139 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:22.969085    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fspsm\" (UniqueName: \"kubernetes.io/projected/038286af-42d0-4d5b-a7af-6aa54fa18684-kube-api-access-fspsm\") pod \"cert-manager-55b4d954d5-6rfcv\" (UID: \"038286af-42d0-4d5b-a7af-6aa54fa18684\") " pod="cert-manager/cert-manager-55b4d954d5-6rfcv"
Jul 09 02:05:22.978085 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:22.978043    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/038286af-42d0-4d5b-a7af-6aa54fa18684-bound-sa-token\") pod \"cert-manager-55b4d954d5-6rfcv\" (UID: \"038286af-42d0-4d5b-a7af-6aa54fa18684\") " pod="cert-manager/cert-manager-55b4d954d5-6rfcv"
Jul 09 02:05:22.978256 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:22.978223    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fspsm\" (UniqueName: \"kubernetes.io/projected/038286af-42d0-4d5b-a7af-6aa54fa18684-kube-api-access-fspsm\") pod \"cert-manager-55b4d954d5-6rfcv\" (UID: \"038286af-42d0-4d5b-a7af-6aa54fa18684\") " pod="cert-manager/cert-manager-55b4d954d5-6rfcv"
Jul 09 02:05:23.126887 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:23.126848    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6rfcv"
Jul 09 02:05:23.253706 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:23.253682    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6rfcv"]
Jul 09 02:05:23.986753 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:23.986713    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6rfcv" event={"ID":"038286af-42d0-4d5b-a7af-6aa54fa18684","Type":"ContainerStarted","Data":"743145611b43dd1dfb10246702a99f0dde84834beb69fffebb1437375b5e372c"}
Jul 09 02:05:23.987120 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:23.986762    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6rfcv" event={"ID":"038286af-42d0-4d5b-a7af-6aa54fa18684","Type":"ContainerStarted","Data":"4aa79e9cde3420989fba49c9eff0e4d559efb81e077519e84bac9c907142d3ee"}
Jul 09 02:05:24.004654 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:24.004606    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6rfcv" podStartSLOduration=2.004589943 podStartE2EDuration="2.004589943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:05:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:05:24.002725421 +0000 UTC m=+349.284649557" watchObservedRunningTime="2026-07-09 02:05:24.004589943 +0000 UTC m=+349.286514079"
Jul 09 02:05:41.740730 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.740651    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"]
Jul 09 02:05:41.743152 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.743133    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"
Jul 09 02:05:41.745742 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.745717    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 02:05:41.745860 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.745818    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5m8gr\""
Jul 09 02:05:41.746933 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.746917    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 02:05:41.752312 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.752293    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"]
Jul 09 02:05:41.834092 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.834059    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb2f246f-22fe-49a8-8712-14aecc086900-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq\" (UID: \"cb2f246f-22fe-49a8-8712-14aecc086900\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"
Jul 09 02:05:41.834092 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.834102    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdg8b\" (UniqueName: \"kubernetes.io/projected/cb2f246f-22fe-49a8-8712-14aecc086900-kube-api-access-wdg8b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq\" (UID: \"cb2f246f-22fe-49a8-8712-14aecc086900\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"
Jul 09 02:05:41.834334 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.834150    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb2f246f-22fe-49a8-8712-14aecc086900-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq\" (UID: \"cb2f246f-22fe-49a8-8712-14aecc086900\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"
Jul 09 02:05:41.935599 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.935532    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb2f246f-22fe-49a8-8712-14aecc086900-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq\" (UID: \"cb2f246f-22fe-49a8-8712-14aecc086900\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"
Jul 09 02:05:41.935795 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.935693    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdg8b\" (UniqueName: \"kubernetes.io/projected/cb2f246f-22fe-49a8-8712-14aecc086900-kube-api-access-wdg8b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq\" (UID: \"cb2f246f-22fe-49a8-8712-14aecc086900\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"
Jul 09 02:05:41.935795 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.935762    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb2f246f-22fe-49a8-8712-14aecc086900-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq\" (UID: \"cb2f246f-22fe-49a8-8712-14aecc086900\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"
Jul 09 02:05:41.935956 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.935933    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb2f246f-22fe-49a8-8712-14aecc086900-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq\" (UID: \"cb2f246f-22fe-49a8-8712-14aecc086900\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"
Jul 09 02:05:41.936134 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.936117    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb2f246f-22fe-49a8-8712-14aecc086900-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq\" (UID: \"cb2f246f-22fe-49a8-8712-14aecc086900\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"
Jul 09 02:05:41.944198 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:41.944175    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdg8b\" (UniqueName: \"kubernetes.io/projected/cb2f246f-22fe-49a8-8712-14aecc086900-kube-api-access-wdg8b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq\" (UID: \"cb2f246f-22fe-49a8-8712-14aecc086900\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"
Jul 09 02:05:42.052837 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:42.052747    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"
Jul 09 02:05:42.181600 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:42.181527    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"]
Jul 09 02:05:42.183792 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:05:42.183765    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2f246f_22fe_49a8_8712_14aecc086900.slice/crio-675c60c1be4c3c79629f7a077bff8e160e707c664dddba378f41d284a9aa5a35 WatchSource:0}: Error finding container 675c60c1be4c3c79629f7a077bff8e160e707c664dddba378f41d284a9aa5a35: Status 404 returned error can't find the container with id 675c60c1be4c3c79629f7a077bff8e160e707c664dddba378f41d284a9aa5a35
Jul 09 02:05:43.071008 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:43.070972    2556 generic.go:356] "Generic (PLEG): container finished" podID="cb2f246f-22fe-49a8-8712-14aecc086900" containerID="f6ca06e8432beb44c5caa989e7dcd085b3a7b267ee94eb02511cc9bfac84d065" exitCode=0
Jul 09 02:05:43.071484 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:43.071019    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq" event={"ID":"cb2f246f-22fe-49a8-8712-14aecc086900","Type":"ContainerDied","Data":"f6ca06e8432beb44c5caa989e7dcd085b3a7b267ee94eb02511cc9bfac84d065"}
Jul 09 02:05:43.071484 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:43.071055    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq" event={"ID":"cb2f246f-22fe-49a8-8712-14aecc086900","Type":"ContainerStarted","Data":"675c60c1be4c3c79629f7a077bff8e160e707c664dddba378f41d284a9aa5a35"}
Jul 09 02:05:44.077059 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:44.076972    2556 generic.go:356] "Generic (PLEG): container finished" podID="cb2f246f-22fe-49a8-8712-14aecc086900" containerID="ea269e70b9b35c4136c67a928f9beb7f94de0d6366a6ee18616c573a977f7909" exitCode=0
Jul 09 02:05:44.077433 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:44.077062    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq" event={"ID":"cb2f246f-22fe-49a8-8712-14aecc086900","Type":"ContainerDied","Data":"ea269e70b9b35c4136c67a928f9beb7f94de0d6366a6ee18616c573a977f7909"}
Jul 09 02:05:45.083939 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:45.083904    2556 generic.go:356] "Generic (PLEG): container finished" podID="cb2f246f-22fe-49a8-8712-14aecc086900" containerID="14c612d865011af49379ea052601edd801023216adb430cb290145f4cb91a45c" exitCode=0
Jul 09 02:05:45.084387 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:45.083960    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq" event={"ID":"cb2f246f-22fe-49a8-8712-14aecc086900","Type":"ContainerDied","Data":"14c612d865011af49379ea052601edd801023216adb430cb290145f4cb91a45c"}
Jul 09 02:05:46.216974 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:46.216948    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"
Jul 09 02:05:46.374879 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:46.374839    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb2f246f-22fe-49a8-8712-14aecc086900-bundle\") pod \"cb2f246f-22fe-49a8-8712-14aecc086900\" (UID: \"cb2f246f-22fe-49a8-8712-14aecc086900\") "
Jul 09 02:05:46.375045 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:46.374884    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdg8b\" (UniqueName: \"kubernetes.io/projected/cb2f246f-22fe-49a8-8712-14aecc086900-kube-api-access-wdg8b\") pod \"cb2f246f-22fe-49a8-8712-14aecc086900\" (UID: \"cb2f246f-22fe-49a8-8712-14aecc086900\") "
Jul 09 02:05:46.375045 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:46.374920    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb2f246f-22fe-49a8-8712-14aecc086900-util\") pod \"cb2f246f-22fe-49a8-8712-14aecc086900\" (UID: \"cb2f246f-22fe-49a8-8712-14aecc086900\") "
Jul 09 02:05:46.375691 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:46.375666    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb2f246f-22fe-49a8-8712-14aecc086900-bundle" (OuterVolumeSpecName: "bundle") pod "cb2f246f-22fe-49a8-8712-14aecc086900" (UID: "cb2f246f-22fe-49a8-8712-14aecc086900"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:05:46.377055 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:46.377032    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb2f246f-22fe-49a8-8712-14aecc086900-kube-api-access-wdg8b" (OuterVolumeSpecName: "kube-api-access-wdg8b") pod "cb2f246f-22fe-49a8-8712-14aecc086900" (UID: "cb2f246f-22fe-49a8-8712-14aecc086900"). InnerVolumeSpecName "kube-api-access-wdg8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:05:46.380469 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:46.380423    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb2f246f-22fe-49a8-8712-14aecc086900-util" (OuterVolumeSpecName: "util") pod "cb2f246f-22fe-49a8-8712-14aecc086900" (UID: "cb2f246f-22fe-49a8-8712-14aecc086900"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:05:46.476158 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:46.476117    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb2f246f-22fe-49a8-8712-14aecc086900-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:05:46.476158 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:46.476151    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdg8b\" (UniqueName: \"kubernetes.io/projected/cb2f246f-22fe-49a8-8712-14aecc086900-kube-api-access-wdg8b\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:05:46.476158 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:46.476162    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb2f246f-22fe-49a8-8712-14aecc086900-util\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:05:47.094651 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:47.094623    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq"
Jul 09 02:05:47.094901 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:47.094620    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nwq" event={"ID":"cb2f246f-22fe-49a8-8712-14aecc086900","Type":"ContainerDied","Data":"675c60c1be4c3c79629f7a077bff8e160e707c664dddba378f41d284a9aa5a35"}
Jul 09 02:05:47.094901 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:47.094745    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="675c60c1be4c3c79629f7a077bff8e160e707c664dddba378f41d284a9aa5a35"
Jul 09 02:05:52.375882 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.375838    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"]
Jul 09 02:05:52.378529 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.376673    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2f246f-22fe-49a8-8712-14aecc086900" containerName="extract"
Jul 09 02:05:52.378529 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.376697    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2f246f-22fe-49a8-8712-14aecc086900" containerName="extract"
Jul 09 02:05:52.378529 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.376723    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2f246f-22fe-49a8-8712-14aecc086900" containerName="pull"
Jul 09 02:05:52.378529 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.376731    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2f246f-22fe-49a8-8712-14aecc086900" containerName="pull"
Jul 09 02:05:52.378529 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.376761    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2f246f-22fe-49a8-8712-14aecc086900" containerName="util"
Jul 09 02:05:52.378529 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.376770    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2f246f-22fe-49a8-8712-14aecc086900" containerName="util"
Jul 09 02:05:52.378529 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.376933    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb2f246f-22fe-49a8-8712-14aecc086900" containerName="extract"
Jul 09 02:05:52.381153 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.380629    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:52.384354 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.384331    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 02:05:52.384603 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.384587    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 02:05:52.384692 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.384646    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 02:05:52.385718 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.385695    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 02:05:52.385834 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.385781    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tjgsb\""
Jul 09 02:05:52.385834 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.385828    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 02:05:52.431493 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.431461    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cbf796ca-d972-4c9c-b1cd-b1860842db9a-manager-config\") pod \"lws-controller-manager-596d76b798-ds7gd\" (UID: \"cbf796ca-d972-4c9c-b1cd-b1860842db9a\") " pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:52.431684 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.431510    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cbf796ca-d972-4c9c-b1cd-b1860842db9a-metrics-cert\") pod \"lws-controller-manager-596d76b798-ds7gd\" (UID: \"cbf796ca-d972-4c9c-b1cd-b1860842db9a\") " pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:52.431684 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.431576    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbqzl\" (UniqueName: \"kubernetes.io/projected/cbf796ca-d972-4c9c-b1cd-b1860842db9a-kube-api-access-rbqzl\") pod \"lws-controller-manager-596d76b798-ds7gd\" (UID: \"cbf796ca-d972-4c9c-b1cd-b1860842db9a\") " pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:52.431684 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.431611    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbf796ca-d972-4c9c-b1cd-b1860842db9a-cert\") pod \"lws-controller-manager-596d76b798-ds7gd\" (UID: \"cbf796ca-d972-4c9c-b1cd-b1860842db9a\") " pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:52.467928 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.467889    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"]
Jul 09 02:05:52.532286 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.532248    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbqzl\" (UniqueName: \"kubernetes.io/projected/cbf796ca-d972-4c9c-b1cd-b1860842db9a-kube-api-access-rbqzl\") pod \"lws-controller-manager-596d76b798-ds7gd\" (UID: \"cbf796ca-d972-4c9c-b1cd-b1860842db9a\") " pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:52.532286 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.532290    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbf796ca-d972-4c9c-b1cd-b1860842db9a-cert\") pod \"lws-controller-manager-596d76b798-ds7gd\" (UID: \"cbf796ca-d972-4c9c-b1cd-b1860842db9a\") " pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:52.532517 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.532336    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cbf796ca-d972-4c9c-b1cd-b1860842db9a-manager-config\") pod \"lws-controller-manager-596d76b798-ds7gd\" (UID: \"cbf796ca-d972-4c9c-b1cd-b1860842db9a\") " pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:52.532517 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.532373    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cbf796ca-d972-4c9c-b1cd-b1860842db9a-metrics-cert\") pod \"lws-controller-manager-596d76b798-ds7gd\" (UID: \"cbf796ca-d972-4c9c-b1cd-b1860842db9a\") " pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:52.533127 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.533103    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cbf796ca-d972-4c9c-b1cd-b1860842db9a-manager-config\") pod \"lws-controller-manager-596d76b798-ds7gd\" (UID: \"cbf796ca-d972-4c9c-b1cd-b1860842db9a\") " pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:52.534810 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.534790    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cbf796ca-d972-4c9c-b1cd-b1860842db9a-metrics-cert\") pod \"lws-controller-manager-596d76b798-ds7gd\" (UID: \"cbf796ca-d972-4c9c-b1cd-b1860842db9a\") " pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:52.534909 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.534891    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cbf796ca-d972-4c9c-b1cd-b1860842db9a-cert\") pod \"lws-controller-manager-596d76b798-ds7gd\" (UID: \"cbf796ca-d972-4c9c-b1cd-b1860842db9a\") " pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:52.543458 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.543429    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbqzl\" (UniqueName: \"kubernetes.io/projected/cbf796ca-d972-4c9c-b1cd-b1860842db9a-kube-api-access-rbqzl\") pod \"lws-controller-manager-596d76b798-ds7gd\" (UID: \"cbf796ca-d972-4c9c-b1cd-b1860842db9a\") " pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:52.691179 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.691073    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:52.867938 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:52.867873    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"]
Jul 09 02:05:52.870297 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:05:52.870264    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf796ca_d972_4c9c_b1cd_b1860842db9a.slice/crio-3ef2d16568dd1498c57a4573b8adea89372defde2c332005d68e27d475a736e6 WatchSource:0}: Error finding container 3ef2d16568dd1498c57a4573b8adea89372defde2c332005d68e27d475a736e6: Status 404 returned error can't find the container with id 3ef2d16568dd1498c57a4573b8adea89372defde2c332005d68e27d475a736e6
Jul 09 02:05:53.122882 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:53.122843    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd" event={"ID":"cbf796ca-d972-4c9c-b1cd-b1860842db9a","Type":"ContainerStarted","Data":"3ef2d16568dd1498c57a4573b8adea89372defde2c332005d68e27d475a736e6"}
Jul 09 02:05:54.845171 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:54.845136    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"]
Jul 09 02:05:54.850078 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:54.850052    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:54.852886 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:54.852858    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 02:05:54.853035 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:54.852955    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k9pj9\""
Jul 09 02:05:54.853485 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:54.853115    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 02:05:54.853485 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:54.853251    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 02:05:54.853646 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:54.853612    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 02:05:54.870491 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:54.870458    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"]
Jul 09 02:05:54.951946 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:54.951912    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcsrz\" (UniqueName: \"kubernetes.io/projected/d3a14dcc-179f-438e-9d48-f49e959d7277-kube-api-access-mcsrz\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:54.952134 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:54.952033    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3a14dcc-179f-438e-9d48-f49e959d7277-tmp\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:54.952134 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:54.952076    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d3a14dcc-179f-438e-9d48-f49e959d7277-manifests\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:54.952241 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:54.952188    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3a14dcc-179f-438e-9d48-f49e959d7277-webhook-cert\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:54.952293 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:54.952239    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d3a14dcc-179f-438e-9d48-f49e959d7277-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:55.052838 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:55.052785    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d3a14dcc-179f-438e-9d48-f49e959d7277-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:55.053040 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:55.052892    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcsrz\" (UniqueName: \"kubernetes.io/projected/d3a14dcc-179f-438e-9d48-f49e959d7277-kube-api-access-mcsrz\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:55.053040 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:55.052992    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3a14dcc-179f-438e-9d48-f49e959d7277-tmp\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:55.053040 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:55.053031    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d3a14dcc-179f-438e-9d48-f49e959d7277-manifests\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:55.053212 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:55.053080    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3a14dcc-179f-438e-9d48-f49e959d7277-webhook-cert\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:55.053541 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:55.053513    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d3a14dcc-179f-438e-9d48-f49e959d7277-manifests\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:55.056172 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:55.056148    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3a14dcc-179f-438e-9d48-f49e959d7277-tmp\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:55.057077 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:55.057054    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d3a14dcc-179f-438e-9d48-f49e959d7277-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:55.057258 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:55.057235    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3a14dcc-179f-438e-9d48-f49e959d7277-webhook-cert\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:55.066042 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:55.066009    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcsrz\" (UniqueName: \"kubernetes.io/projected/d3a14dcc-179f-438e-9d48-f49e959d7277-kube-api-access-mcsrz\") pod \"opendatahub-operator-controller-manager-8687897cbb-5lzn4\" (UID: \"d3a14dcc-179f-438e-9d48-f49e959d7277\") " pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:55.164972 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:55.164891    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:05:55.928960 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:55.928930    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"]
Jul 09 02:05:55.931770 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:05:55.931741    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3a14dcc_179f_438e_9d48_f49e959d7277.slice/crio-2ae758a06ac8ccabbada9d7d3b403f28b771188db169fd6fac4eb9bc5e101906 WatchSource:0}: Error finding container 2ae758a06ac8ccabbada9d7d3b403f28b771188db169fd6fac4eb9bc5e101906: Status 404 returned error can't find the container with id 2ae758a06ac8ccabbada9d7d3b403f28b771188db169fd6fac4eb9bc5e101906
Jul 09 02:05:56.145014 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:56.144974    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd" event={"ID":"cbf796ca-d972-4c9c-b1cd-b1860842db9a","Type":"ContainerStarted","Data":"2a4aea37d9c38e52ba3f44578aa596a31a3918f076543844456ac37f9f308030"}
Jul 09 02:05:56.145244 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:56.145099    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:05:56.146169 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:56.146139    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4" event={"ID":"d3a14dcc-179f-438e-9d48-f49e959d7277","Type":"ContainerStarted","Data":"2ae758a06ac8ccabbada9d7d3b403f28b771188db169fd6fac4eb9bc5e101906"}
Jul 09 02:05:56.164399 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:56.164346    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd" podStartSLOduration=1.2173042330000001 podStartE2EDuration="4.164330125s" totalImagesPullingTime="2.947025892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:05:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:05:56.162437309 +0000 UTC m=+381.444361446" watchObservedRunningTime="2026-07-09 02:05:56.164330125 +0000 UTC m=+381.446254260"
Jul 09 02:05:59.165467 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:05:59.165432    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4" event={"ID":"d3a14dcc-179f-438e-9d48-f49e959d7277","Type":"ContainerStarted","Data":"698fbffc271e6517dec64e2b3d1ed0356d0acb380b93541a7f3e2b56ec3e6e19"}
Jul 09 02:06:00.171537 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:00.171504    2556 generic.go:356] "Generic (PLEG): container finished" podID="d3a14dcc-179f-438e-9d48-f49e959d7277" containerID="698fbffc271e6517dec64e2b3d1ed0356d0acb380b93541a7f3e2b56ec3e6e19" exitCode=0
Jul 09 02:06:00.171952 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:00.171595    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4" event={"ID":"d3a14dcc-179f-438e-9d48-f49e959d7277","Type":"ContainerDied","Data":"698fbffc271e6517dec64e2b3d1ed0356d0acb380b93541a7f3e2b56ec3e6e19"}
Jul 09 02:06:01.178345 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:01.178307    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4" event={"ID":"d3a14dcc-179f-438e-9d48-f49e959d7277","Type":"ContainerStarted","Data":"9b6463086dcb8fe5e250eb25b366754d1aaff4e4de4b4d30ed3db64e3b432d78"}
Jul 09 02:06:01.178877 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:01.178409    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:06:01.203434 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:01.203383    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4" podStartSLOduration=3.021861411 podStartE2EDuration="7.203366345s" totalImagesPullingTime="3.154410827s" totalInitContainerRuntime="1.027094107s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:05:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:06:01.201220525 +0000 UTC m=+386.483144696" watchObservedRunningTime="2026-07-09 02:06:01.203366345 +0000 UTC m=+386.485290480"
Jul 09 02:06:07.154606 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:07.154570    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-596d76b798-ds7gd"
Jul 09 02:06:12.186057 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:12.186025    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8687897cbb-5lzn4"
Jul 09 02:06:27.670703 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.670666    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"]
Jul 09 02:06:27.672806 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.672790    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.676827 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.676803    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 02:06:27.678866 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.678843    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 02:06:27.680047 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.680027    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 02:06:27.680243 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.680230    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vxlqw\""
Jul 09 02:06:27.705451 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.705425    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"]
Jul 09 02:06:27.842143 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.842109    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.842143 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.842147    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p8hs\" (UniqueName: \"kubernetes.io/projected/50ad9c72-0351-43cf-b577-e9a3549dc67b-kube-api-access-8p8hs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.842367 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.842182    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.842367 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.842200    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.842367 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.842219    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.842367 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.842293    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50ad9c72-0351-43cf-b577-e9a3549dc67b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.842367 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.842354    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50ad9c72-0351-43cf-b577-e9a3549dc67b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.842648 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.842371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50ad9c72-0351-43cf-b577-e9a3549dc67b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.842648 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.842400    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.943295 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.943204    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.943295 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.943248    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p8hs\" (UniqueName: \"kubernetes.io/projected/50ad9c72-0351-43cf-b577-e9a3549dc67b-kube-api-access-8p8hs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.943534 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.943377    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.943534 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.943417    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.943534 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.943451    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.943534 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.943518    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50ad9c72-0351-43cf-b577-e9a3549dc67b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.943774 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.943609    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50ad9c72-0351-43cf-b577-e9a3549dc67b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.943774 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.943641    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50ad9c72-0351-43cf-b577-e9a3549dc67b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.943774 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.943694    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.943774 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.943735    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.943997 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.943804    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.943997 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.943946    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.944101 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.944049    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.944319 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.944298    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50ad9c72-0351-43cf-b577-e9a3549dc67b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.945927 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.945894    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50ad9c72-0351-43cf-b577-e9a3549dc67b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.946040 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.945966    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50ad9c72-0351-43cf-b577-e9a3549dc67b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.952308 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.952287    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50ad9c72-0351-43cf-b577-e9a3549dc67b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.952434 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.952415    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p8hs\" (UniqueName: \"kubernetes.io/projected/50ad9c72-0351-43cf-b577-e9a3549dc67b-kube-api-access-8p8hs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bssp5\" (UID: \"50ad9c72-0351-43cf-b577-e9a3549dc67b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:27.983084 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:27.983053    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:28.145279 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:28.139398    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"]
Jul 09 02:06:28.147190 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:06:28.147154    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ad9c72_0351_43cf_b577_e9a3549dc67b.slice/crio-9ce022feedcc09352fe20accc8db9e96d118c6522f7f44b660a6d184cacbbe9e WatchSource:0}: Error finding container 9ce022feedcc09352fe20accc8db9e96d118c6522f7f44b660a6d184cacbbe9e: Status 404 returned error can't find the container with id 9ce022feedcc09352fe20accc8db9e96d118c6522f7f44b660a6d184cacbbe9e
Jul 09 02:06:28.309102 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:28.309008    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5" event={"ID":"50ad9c72-0351-43cf-b577-e9a3549dc67b","Type":"ContainerStarted","Data":"9ce022feedcc09352fe20accc8db9e96d118c6522f7f44b660a6d184cacbbe9e"}
Jul 09 02:06:29.779823 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.779790    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"]
Jul 09 02:06:29.782047 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.782032    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.786585 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.786547    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 02:06:29.786725 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.786651    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 02:06:29.786840 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.786821    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 02:06:29.786886 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.786872    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8dn2t\""
Jul 09 02:06:29.807009 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.806975    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"]
Jul 09 02:06:29.863576 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.863520    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d59ae476-dd75-42a5-a785-c0bee6d44c6f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.863576 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.863573    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftd9t\" (UniqueName: \"kubernetes.io/projected/d59ae476-dd75-42a5-a785-c0bee6d44c6f-kube-api-access-ftd9t\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.863843 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.863613    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d59ae476-dd75-42a5-a785-c0bee6d44c6f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.863843 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.863633    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d59ae476-dd75-42a5-a785-c0bee6d44c6f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.863843 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.863721    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d59ae476-dd75-42a5-a785-c0bee6d44c6f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.863843 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.863754    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d59ae476-dd75-42a5-a785-c0bee6d44c6f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.863843 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.863839    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d59ae476-dd75-42a5-a785-c0bee6d44c6f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.964860 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.964824    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d59ae476-dd75-42a5-a785-c0bee6d44c6f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.964860 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.964867    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d59ae476-dd75-42a5-a785-c0bee6d44c6f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.965110 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.964904    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d59ae476-dd75-42a5-a785-c0bee6d44c6f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.965110 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.964982    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d59ae476-dd75-42a5-a785-c0bee6d44c6f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.965110 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.965023    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftd9t\" (UniqueName: \"kubernetes.io/projected/d59ae476-dd75-42a5-a785-c0bee6d44c6f-kube-api-access-ftd9t\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.965110 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.965056    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d59ae476-dd75-42a5-a785-c0bee6d44c6f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.965110 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.965079    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d59ae476-dd75-42a5-a785-c0bee6d44c6f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.965940 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.965891    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d59ae476-dd75-42a5-a785-c0bee6d44c6f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.968355 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.968333    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d59ae476-dd75-42a5-a785-c0bee6d44c6f-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.968466 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.968397    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d59ae476-dd75-42a5-a785-c0bee6d44c6f-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.968608 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.968587    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d59ae476-dd75-42a5-a785-c0bee6d44c6f-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.968650 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.968602    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d59ae476-dd75-42a5-a785-c0bee6d44c6f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.975721 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.975699    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d59ae476-dd75-42a5-a785-c0bee6d44c6f-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:29.976459 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:29.976441    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftd9t\" (UniqueName: \"kubernetes.io/projected/d59ae476-dd75-42a5-a785-c0bee6d44c6f-kube-api-access-ftd9t\") pod \"istiod-openshift-gateway-94bb8fbfd-thpdr\" (UID: \"d59ae476-dd75-42a5-a785-c0bee6d44c6f\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:30.091585 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:30.091539    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:30.256538 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:06:30.256490    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd59ae476_dd75_42a5_a785_c0bee6d44c6f.slice/crio-020d0afbbd1cb9a8b700b28488f4bb4d92447f97a41202cec4c8fa9d593fb658 WatchSource:0}: Error finding container 020d0afbbd1cb9a8b700b28488f4bb4d92447f97a41202cec4c8fa9d593fb658: Status 404 returned error can't find the container with id 020d0afbbd1cb9a8b700b28488f4bb4d92447f97a41202cec4c8fa9d593fb658
Jul 09 02:06:30.257500 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:30.257397    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"]
Jul 09 02:06:30.320829 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:30.320796    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr" event={"ID":"d59ae476-dd75-42a5-a785-c0bee6d44c6f","Type":"ContainerStarted","Data":"020d0afbbd1cb9a8b700b28488f4bb4d92447f97a41202cec4c8fa9d593fb658"}
Jul 09 02:06:31.487404 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:31.487356    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:06:31.487729 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:31.487428    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:06:31.487729 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:31.487457    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:06:32.334476 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:32.334438    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5" event={"ID":"50ad9c72-0351-43cf-b577-e9a3549dc67b","Type":"ContainerStarted","Data":"cb9753681f7b42666d956523ad77ef6a83455a667f3394e63af36d8cfff7ec6a"}
Jul 09 02:06:32.382465 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:32.382397    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5" podStartSLOduration=2.044656566 podStartE2EDuration="5.38237248s" totalImagesPullingTime="3.337715914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:06:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:06:32.379577482 +0000 UTC m=+417.661501609" watchObservedRunningTime="2026-07-09 02:06:32.38237248 +0000 UTC m=+417.664296618"
Jul 09 02:06:32.983904 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:32.983869    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:32.989190 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:32.989164    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:33.340812 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:33.340786    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:33.341937 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:33.341914    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bssp5"
Jul 09 02:06:33.504479 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:33.504444    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:06:33.504611 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:33.504508    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:06:34.348246 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:34.348206    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr" event={"ID":"d59ae476-dd75-42a5-a785-c0bee6d44c6f","Type":"ContainerStarted","Data":"d55ea618633c27d0069d1c7154b1ce4d931acda467b30bbb84a995227e24b4bc"}
Jul 09 02:06:34.348708 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:34.348471    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:34.350216 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:34.350197    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr"
Jul 09 02:06:34.376124 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:06:34.376075    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-thpdr" podStartSLOduration=2.130978945 podStartE2EDuration="5.376059762s" totalImagesPullingTime="3.245080817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:06:34.375377789 +0000 UTC m=+419.657301927" watchObservedRunningTime="2026-07-09 02:06:34.376059762 +0000 UTC m=+419.657983897"
Jul 09 02:07:45.776289 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:07:45.776249    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59464dd586-vmnpv"]
Jul 09 02:08:10.797192 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:10.797150    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59464dd586-vmnpv" podUID="a5f58ea6-a398-4dec-833b-3769e92d3fd4" containerName="console" containerID="cri-o://39f0566e3b498e36aefbfbafcfc66d6e235ce7e4073aa5634f2faf47300fc6ae" gracePeriod=15
Jul 09 02:08:11.048404 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.048341    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:08:11.179774 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.179736    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-service-ca\") pod \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") "
Jul 09 02:08:11.179963 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.179803    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9jwv\" (UniqueName: \"kubernetes.io/projected/a5f58ea6-a398-4dec-833b-3769e92d3fd4-kube-api-access-q9jwv\") pod \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") "
Jul 09 02:08:11.179963 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.179831    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-trusted-ca-bundle\") pod \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") "
Jul 09 02:08:11.179963 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.179866    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-serving-cert\") pod \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") "
Jul 09 02:08:11.179963 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.179906    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-oauth-config\") pod \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") "
Jul 09 02:08:11.179963 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.179927    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-config\") pod \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") "
Jul 09 02:08:11.180220 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.179965    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-oauth-serving-cert\") pod \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\" (UID: \"a5f58ea6-a398-4dec-833b-3769e92d3fd4\") "
Jul 09 02:08:11.180276 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.180239    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-service-ca" (OuterVolumeSpecName: "service-ca") pod "a5f58ea6-a398-4dec-833b-3769e92d3fd4" (UID: "a5f58ea6-a398-4dec-833b-3769e92d3fd4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:08:11.180357 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.180321    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-config" (OuterVolumeSpecName: "console-config") pod "a5f58ea6-a398-4dec-833b-3769e92d3fd4" (UID: "a5f58ea6-a398-4dec-833b-3769e92d3fd4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:08:11.180446 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.180337    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a5f58ea6-a398-4dec-833b-3769e92d3fd4" (UID: "a5f58ea6-a398-4dec-833b-3769e92d3fd4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:08:11.180539 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.180518    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a5f58ea6-a398-4dec-833b-3769e92d3fd4" (UID: "a5f58ea6-a398-4dec-833b-3769e92d3fd4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:08:11.182071 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.182050    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a5f58ea6-a398-4dec-833b-3769e92d3fd4" (UID: "a5f58ea6-a398-4dec-833b-3769e92d3fd4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:08:11.182134 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.182082    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a5f58ea6-a398-4dec-833b-3769e92d3fd4" (UID: "a5f58ea6-a398-4dec-833b-3769e92d3fd4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:08:11.182189 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.182171    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5f58ea6-a398-4dec-833b-3769e92d3fd4-kube-api-access-q9jwv" (OuterVolumeSpecName: "kube-api-access-q9jwv") pod "a5f58ea6-a398-4dec-833b-3769e92d3fd4" (UID: "a5f58ea6-a398-4dec-833b-3769e92d3fd4"). InnerVolumeSpecName "kube-api-access-q9jwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:08:11.280664 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.280631    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-oauth-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:08:11.280664 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.280659    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-config\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:08:11.280664 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.280668    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-oauth-serving-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:08:11.280878 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.280677    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:08:11.280878 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.280685    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9jwv\" (UniqueName: \"kubernetes.io/projected/a5f58ea6-a398-4dec-833b-3769e92d3fd4-kube-api-access-q9jwv\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:08:11.280878 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.280694    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5f58ea6-a398-4dec-833b-3769e92d3fd4-trusted-ca-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:08:11.280878 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.280703    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5f58ea6-a398-4dec-833b-3769e92d3fd4-console-serving-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:08:11.810693 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.810654    2556 generic.go:356] "Generic (PLEG): container finished" podID="a5f58ea6-a398-4dec-833b-3769e92d3fd4" containerID="39f0566e3b498e36aefbfbafcfc66d6e235ce7e4073aa5634f2faf47300fc6ae" exitCode=0
Jul 09 02:08:11.811198 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.810702    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59464dd586-vmnpv"
Jul 09 02:08:11.811198 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.810744    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59464dd586-vmnpv" event={"ID":"a5f58ea6-a398-4dec-833b-3769e92d3fd4","Type":"ContainerDied","Data":"39f0566e3b498e36aefbfbafcfc66d6e235ce7e4073aa5634f2faf47300fc6ae"}
Jul 09 02:08:11.811198 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.810810    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59464dd586-vmnpv" event={"ID":"a5f58ea6-a398-4dec-833b-3769e92d3fd4","Type":"ContainerDied","Data":"0e0d67daa161255bfe6033773c82f206be3b11f0a78605d6d22bbf3339f56028"}
Jul 09 02:08:11.811198 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.810842    2556 scope.go:117] "RemoveContainer" containerID="39f0566e3b498e36aefbfbafcfc66d6e235ce7e4073aa5634f2faf47300fc6ae"
Jul 09 02:08:11.819385 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.819366    2556 scope.go:117] "RemoveContainer" containerID="39f0566e3b498e36aefbfbafcfc66d6e235ce7e4073aa5634f2faf47300fc6ae"
Jul 09 02:08:11.819674 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:08:11.819655    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39f0566e3b498e36aefbfbafcfc66d6e235ce7e4073aa5634f2faf47300fc6ae\": container with ID starting with 39f0566e3b498e36aefbfbafcfc66d6e235ce7e4073aa5634f2faf47300fc6ae not found: ID does not exist" containerID="39f0566e3b498e36aefbfbafcfc66d6e235ce7e4073aa5634f2faf47300fc6ae"
Jul 09 02:08:11.819743 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.819683    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39f0566e3b498e36aefbfbafcfc66d6e235ce7e4073aa5634f2faf47300fc6ae"} err="failed to get container status \"39f0566e3b498e36aefbfbafcfc66d6e235ce7e4073aa5634f2faf47300fc6ae\": rpc error: code = NotFound desc = could not find container \"39f0566e3b498e36aefbfbafcfc66d6e235ce7e4073aa5634f2faf47300fc6ae\": container with ID starting with 39f0566e3b498e36aefbfbafcfc66d6e235ce7e4073aa5634f2faf47300fc6ae not found: ID does not exist"
Jul 09 02:08:11.829427 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.829398    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59464dd586-vmnpv"]
Jul 09 02:08:11.833899 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:11.833867    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59464dd586-vmnpv"]
Jul 09 02:08:13.274909 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:13.274870    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5f58ea6-a398-4dec-833b-3769e92d3fd4" path="/var/lib/kubelet/pods/a5f58ea6-a398-4dec-833b-3769e92d3fd4/volumes"
Jul 09 02:08:42.545617 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.545573    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"]
Jul 09 02:08:42.546095 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.545973    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5f58ea6-a398-4dec-833b-3769e92d3fd4" containerName="console"
Jul 09 02:08:42.546095 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.545988    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5f58ea6-a398-4dec-833b-3769e92d3fd4" containerName="console"
Jul 09 02:08:42.546095 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.546062    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5f58ea6-a398-4dec-833b-3769e92d3fd4" containerName="console"
Jul 09 02:08:42.550272 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.550256    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.552910 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.552881    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tfpwt\""
Jul 09 02:08:42.561412 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.561387    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"]
Jul 09 02:08:42.644846 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.644816    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.645014 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.644862    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.645014 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.644890    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.645014 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.644926    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.645014 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.644944    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.645014 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.644961    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58e0bd42-2798-4fe1-a334-482e039808cc-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.645185 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.645056    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58e0bd42-2798-4fe1-a334-482e039808cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.645185 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.645096    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58e0bd42-2798-4fe1-a334-482e039808cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.645185 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.645163    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j954v\" (UniqueName: \"kubernetes.io/projected/58e0bd42-2798-4fe1-a334-482e039808cc-kube-api-access-j954v\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.746389 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.746351    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.746626 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.746398    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.746626 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.746416    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.746626 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.746442    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.746626 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.746457    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.746626 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.746484    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58e0bd42-2798-4fe1-a334-482e039808cc-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.746626 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.746522    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58e0bd42-2798-4fe1-a334-482e039808cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.746626 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.746550    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58e0bd42-2798-4fe1-a334-482e039808cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.747037 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.746705    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j954v\" (UniqueName: \"kubernetes.io/projected/58e0bd42-2798-4fe1-a334-482e039808cc-kube-api-access-j954v\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.747037 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.746867    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.747037 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.746915    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.747037 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.746934    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.747343 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.747302    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58e0bd42-2798-4fe1-a334-482e039808cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.747452 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.747375    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.749140 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.749119    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58e0bd42-2798-4fe1-a334-482e039808cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.749226 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.749174    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58e0bd42-2798-4fe1-a334-482e039808cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.755338 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.755305    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j954v\" (UniqueName: \"kubernetes.io/projected/58e0bd42-2798-4fe1-a334-482e039808cc-kube-api-access-j954v\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.755761 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.755737    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58e0bd42-2798-4fe1-a334-482e039808cc-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-55h66\" (UID: \"58e0bd42-2798-4fe1-a334-482e039808cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:42.861809 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:42.861774    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:43.004149 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:43.004126    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"]
Jul 09 02:08:43.006013 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:08:43.005985    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e0bd42_2798_4fe1_a334_482e039808cc.slice/crio-d77322dadab96454e82a5de24105b904d5031867f2ec1f87ba7bab11e744404c WatchSource:0}: Error finding container d77322dadab96454e82a5de24105b904d5031867f2ec1f87ba7bab11e744404c: Status 404 returned error can't find the container with id d77322dadab96454e82a5de24105b904d5031867f2ec1f87ba7bab11e744404c
Jul 09 02:08:43.008173 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:43.008141    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:08:43.008254 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:43.008212    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:08:43.008254 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:43.008241    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:08:43.973332 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:43.973289    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66" event={"ID":"58e0bd42-2798-4fe1-a334-482e039808cc","Type":"ContainerStarted","Data":"d5f41bad3fb242da88cabb4f1ce0f5feab718dcdaa1d5fe804fcc1c9819e6b25"}
Jul 09 02:08:43.973748 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:43.973342    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66" event={"ID":"58e0bd42-2798-4fe1-a334-482e039808cc","Type":"ContainerStarted","Data":"d77322dadab96454e82a5de24105b904d5031867f2ec1f87ba7bab11e744404c"}
Jul 09 02:08:43.998147 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:43.998096    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66" podStartSLOduration=1.9980712600000001 podStartE2EDuration="1.99807126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:08:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:08:43.996573978 +0000 UTC m=+549.278498117" watchObservedRunningTime="2026-07-09 02:08:43.99807126 +0000 UTC m=+549.279995396"
Jul 09 02:08:44.862359 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:44.862314    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:44.867048 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:44.867019    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:44.979247 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:44.979217    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:08:44.980134 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:08:44.980114    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:09:27.446109 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:27.446070    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75b97d969f-ghjmk"]
Jul 09 02:09:27.449726 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:27.449707    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b97d969f-ghjmk"
Jul 09 02:09:27.452418 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:27.452400    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 02:09:27.452712 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:27.452691    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 02:09:27.452778 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:27.452728    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-m5h9z\""
Jul 09 02:09:27.462686 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:27.462664    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b97d969f-ghjmk"]
Jul 09 02:09:27.548523 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:27.548480    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7g6r\" (UniqueName: \"kubernetes.io/projected/6b63f667-4995-4649-af30-3fdf92e26d93-kube-api-access-w7g6r\") pod \"maas-controller-75b97d969f-ghjmk\" (UID: \"6b63f667-4995-4649-af30-3fdf92e26d93\") " pod="opendatahub/maas-controller-75b97d969f-ghjmk"
Jul 09 02:09:27.548729 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:27.548622    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b63f667-4995-4649-af30-3fdf92e26d93-webhook-cert\") pod \"maas-controller-75b97d969f-ghjmk\" (UID: \"6b63f667-4995-4649-af30-3fdf92e26d93\") " pod="opendatahub/maas-controller-75b97d969f-ghjmk"
Jul 09 02:09:27.649649 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:27.649611    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7g6r\" (UniqueName: \"kubernetes.io/projected/6b63f667-4995-4649-af30-3fdf92e26d93-kube-api-access-w7g6r\") pod \"maas-controller-75b97d969f-ghjmk\" (UID: \"6b63f667-4995-4649-af30-3fdf92e26d93\") " pod="opendatahub/maas-controller-75b97d969f-ghjmk"
Jul 09 02:09:27.649836 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:27.649740    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b63f667-4995-4649-af30-3fdf92e26d93-webhook-cert\") pod \"maas-controller-75b97d969f-ghjmk\" (UID: \"6b63f667-4995-4649-af30-3fdf92e26d93\") " pod="opendatahub/maas-controller-75b97d969f-ghjmk"
Jul 09 02:09:27.652177 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:27.652157    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b63f667-4995-4649-af30-3fdf92e26d93-webhook-cert\") pod \"maas-controller-75b97d969f-ghjmk\" (UID: \"6b63f667-4995-4649-af30-3fdf92e26d93\") " pod="opendatahub/maas-controller-75b97d969f-ghjmk"
Jul 09 02:09:27.658700 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:27.658671    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7g6r\" (UniqueName: \"kubernetes.io/projected/6b63f667-4995-4649-af30-3fdf92e26d93-kube-api-access-w7g6r\") pod \"maas-controller-75b97d969f-ghjmk\" (UID: \"6b63f667-4995-4649-af30-3fdf92e26d93\") " pod="opendatahub/maas-controller-75b97d969f-ghjmk"
Jul 09 02:09:27.760410 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:27.760323    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b97d969f-ghjmk"
Jul 09 02:09:27.895047 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:27.895020    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b97d969f-ghjmk"]
Jul 09 02:09:27.897234 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:09:27.897203    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b63f667_4995_4649_af30_3fdf92e26d93.slice/crio-7b220a0511f93b561741bf20f499f7fd22b5fe35fe2643b5ab1d305d78d13adc WatchSource:0}: Error finding container 7b220a0511f93b561741bf20f499f7fd22b5fe35fe2643b5ab1d305d78d13adc: Status 404 returned error can't find the container with id 7b220a0511f93b561741bf20f499f7fd22b5fe35fe2643b5ab1d305d78d13adc
Jul 09 02:09:28.189654 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:28.189618    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b97d969f-ghjmk" event={"ID":"6b63f667-4995-4649-af30-3fdf92e26d93","Type":"ContainerStarted","Data":"7b220a0511f93b561741bf20f499f7fd22b5fe35fe2643b5ab1d305d78d13adc"}
Jul 09 02:09:30.201831 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:30.201787    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b97d969f-ghjmk" event={"ID":"6b63f667-4995-4649-af30-3fdf92e26d93","Type":"ContainerStarted","Data":"900d20db3f2691dfedebed351e3d6a65cf205355262f1ad288d043cbe863392f"}
Jul 09 02:09:30.202592 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:30.202538    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75b97d969f-ghjmk"
Jul 09 02:09:30.225048 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:30.224998    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75b97d969f-ghjmk" podStartSLOduration=1.036906477 podStartE2EDuration="3.224980692s" totalImagesPullingTime="2.188074215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:09:30.22453433 +0000 UTC m=+595.506458467" watchObservedRunningTime="2026-07-09 02:09:30.224980692 +0000 UTC m=+595.506904827"
Jul 09 02:09:41.212067 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:41.212034    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75b97d969f-ghjmk"
Jul 09 02:09:41.507437 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:41.507342    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75b97d969f-ghjmk"]
Jul 09 02:09:41.507623 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:41.507528    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-75b97d969f-ghjmk" podUID="6b63f667-4995-4649-af30-3fdf92e26d93" containerName="manager" containerID="cri-o://900d20db3f2691dfedebed351e3d6a65cf205355262f1ad288d043cbe863392f" gracePeriod=30
Jul 09 02:09:41.755761 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:41.755729    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b97d969f-ghjmk"
Jul 09 02:09:41.886339 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:41.886306    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7g6r\" (UniqueName: \"kubernetes.io/projected/6b63f667-4995-4649-af30-3fdf92e26d93-kube-api-access-w7g6r\") pod \"6b63f667-4995-4649-af30-3fdf92e26d93\" (UID: \"6b63f667-4995-4649-af30-3fdf92e26d93\") "
Jul 09 02:09:41.886550 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:41.886381    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b63f667-4995-4649-af30-3fdf92e26d93-webhook-cert\") pod \"6b63f667-4995-4649-af30-3fdf92e26d93\" (UID: \"6b63f667-4995-4649-af30-3fdf92e26d93\") "
Jul 09 02:09:41.888617 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:41.888591    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b63f667-4995-4649-af30-3fdf92e26d93-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6b63f667-4995-4649-af30-3fdf92e26d93" (UID: "6b63f667-4995-4649-af30-3fdf92e26d93"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:09:41.888617 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:41.888601    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b63f667-4995-4649-af30-3fdf92e26d93-kube-api-access-w7g6r" (OuterVolumeSpecName: "kube-api-access-w7g6r") pod "6b63f667-4995-4649-af30-3fdf92e26d93" (UID: "6b63f667-4995-4649-af30-3fdf92e26d93"). InnerVolumeSpecName "kube-api-access-w7g6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:09:41.987725 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:41.987680    2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b63f667-4995-4649-af30-3fdf92e26d93-webhook-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:09:41.987725 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:41.987714    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7g6r\" (UniqueName: \"kubernetes.io/projected/6b63f667-4995-4649-af30-3fdf92e26d93-kube-api-access-w7g6r\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:09:42.262044 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:42.261948    2556 generic.go:356] "Generic (PLEG): container finished" podID="6b63f667-4995-4649-af30-3fdf92e26d93" containerID="900d20db3f2691dfedebed351e3d6a65cf205355262f1ad288d043cbe863392f" exitCode=0
Jul 09 02:09:42.262044 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:42.262000    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b97d969f-ghjmk"
Jul 09 02:09:42.262044 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:42.262037    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b97d969f-ghjmk" event={"ID":"6b63f667-4995-4649-af30-3fdf92e26d93","Type":"ContainerDied","Data":"900d20db3f2691dfedebed351e3d6a65cf205355262f1ad288d043cbe863392f"}
Jul 09 02:09:42.262665 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:42.262085    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b97d969f-ghjmk" event={"ID":"6b63f667-4995-4649-af30-3fdf92e26d93","Type":"ContainerDied","Data":"7b220a0511f93b561741bf20f499f7fd22b5fe35fe2643b5ab1d305d78d13adc"}
Jul 09 02:09:42.262665 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:42.262109    2556 scope.go:117] "RemoveContainer" containerID="900d20db3f2691dfedebed351e3d6a65cf205355262f1ad288d043cbe863392f"
Jul 09 02:09:42.271801 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:42.271773    2556 scope.go:117] "RemoveContainer" containerID="900d20db3f2691dfedebed351e3d6a65cf205355262f1ad288d043cbe863392f"
Jul 09 02:09:42.272079 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:09:42.272061    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"900d20db3f2691dfedebed351e3d6a65cf205355262f1ad288d043cbe863392f\": container with ID starting with 900d20db3f2691dfedebed351e3d6a65cf205355262f1ad288d043cbe863392f not found: ID does not exist" containerID="900d20db3f2691dfedebed351e3d6a65cf205355262f1ad288d043cbe863392f"
Jul 09 02:09:42.272122 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:42.272089    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"900d20db3f2691dfedebed351e3d6a65cf205355262f1ad288d043cbe863392f"} err="failed to get container status \"900d20db3f2691dfedebed351e3d6a65cf205355262f1ad288d043cbe863392f\": rpc error: code = NotFound desc = could not find container \"900d20db3f2691dfedebed351e3d6a65cf205355262f1ad288d043cbe863392f\": container with ID starting with 900d20db3f2691dfedebed351e3d6a65cf205355262f1ad288d043cbe863392f not found: ID does not exist"
Jul 09 02:09:42.285987 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:42.285958    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75b97d969f-ghjmk"]
Jul 09 02:09:42.290193 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:42.290168    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75b97d969f-ghjmk"]
Jul 09 02:09:43.274165 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:09:43.274132    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b63f667-4995-4649-af30-3fdf92e26d93" path="/var/lib/kubelet/pods/6b63f667-4995-4649-af30-3fdf92e26d93/volumes"
Jul 09 02:10:04.583123 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.583033    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7f86449945-8jpts"]
Jul 09 02:10:04.583726 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.583588    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b63f667-4995-4649-af30-3fdf92e26d93" containerName="manager"
Jul 09 02:10:04.583726 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.583608    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b63f667-4995-4649-af30-3fdf92e26d93" containerName="manager"
Jul 09 02:10:04.583726 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.583712    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b63f667-4995-4649-af30-3fdf92e26d93" containerName="manager"
Jul 09 02:10:04.586421 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.586396    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts"
Jul 09 02:10:04.589086 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.589058    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vmdf4\""
Jul 09 02:10:04.589219 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.589188    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 02:10:04.589480 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.589457    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 02:10:04.590275 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.590260    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 09 02:10:04.597807 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.597779    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f86449945-8jpts"]
Jul 09 02:10:04.689828 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.689792    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b237646f-3c91-43b9-b76d-3f4fd0fd11e7-maas-api-tls\") pod \"maas-api-7f86449945-8jpts\" (UID: \"b237646f-3c91-43b9-b76d-3f4fd0fd11e7\") " pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts"
Jul 09 02:10:04.689828 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.689827    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b237646f-3c91-43b9-b76d-3f4fd0fd11e7-openshift-service-ca\") pod \"maas-api-7f86449945-8jpts\" (UID: \"b237646f-3c91-43b9-b76d-3f4fd0fd11e7\") " pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts"
Jul 09 02:10:04.690044 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.689865    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwqnv\" (UniqueName: \"kubernetes.io/projected/b237646f-3c91-43b9-b76d-3f4fd0fd11e7-kube-api-access-bwqnv\") pod \"maas-api-7f86449945-8jpts\" (UID: \"b237646f-3c91-43b9-b76d-3f4fd0fd11e7\") " pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts"
Jul 09 02:10:04.791221 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.791186    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwqnv\" (UniqueName: \"kubernetes.io/projected/b237646f-3c91-43b9-b76d-3f4fd0fd11e7-kube-api-access-bwqnv\") pod \"maas-api-7f86449945-8jpts\" (UID: \"b237646f-3c91-43b9-b76d-3f4fd0fd11e7\") " pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts"
Jul 09 02:10:04.791395 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.791284    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b237646f-3c91-43b9-b76d-3f4fd0fd11e7-maas-api-tls\") pod \"maas-api-7f86449945-8jpts\" (UID: \"b237646f-3c91-43b9-b76d-3f4fd0fd11e7\") " pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts"
Jul 09 02:10:04.791395 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.791304    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b237646f-3c91-43b9-b76d-3f4fd0fd11e7-openshift-service-ca\") pod \"maas-api-7f86449945-8jpts\" (UID: \"b237646f-3c91-43b9-b76d-3f4fd0fd11e7\") " pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts"
Jul 09 02:10:04.791934 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.791915    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b237646f-3c91-43b9-b76d-3f4fd0fd11e7-openshift-service-ca\") pod \"maas-api-7f86449945-8jpts\" (UID: \"b237646f-3c91-43b9-b76d-3f4fd0fd11e7\") " pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts"
Jul 09 02:10:04.793857 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.793831    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b237646f-3c91-43b9-b76d-3f4fd0fd11e7-maas-api-tls\") pod \"maas-api-7f86449945-8jpts\" (UID: \"b237646f-3c91-43b9-b76d-3f4fd0fd11e7\") " pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts"
Jul 09 02:10:04.803171 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.803143    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwqnv\" (UniqueName: \"kubernetes.io/projected/b237646f-3c91-43b9-b76d-3f4fd0fd11e7-kube-api-access-bwqnv\") pod \"maas-api-7f86449945-8jpts\" (UID: \"b237646f-3c91-43b9-b76d-3f4fd0fd11e7\") " pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts"
Jul 09 02:10:04.897250 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:04.897211    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts"
Jul 09 02:10:05.050735 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.050702    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f86449945-8jpts"]
Jul 09 02:10:05.052022 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:10:05.051988    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb237646f_3c91_43b9_b76d_3f4fd0fd11e7.slice/crio-6de7ca2bb4e3c42b10aaa701b2a8bb80a9cb316bfa85ccadea0276bde611c72c WatchSource:0}: Error finding container 6de7ca2bb4e3c42b10aaa701b2a8bb80a9cb316bfa85ccadea0276bde611c72c: Status 404 returned error can't find the container with id 6de7ca2bb4e3c42b10aaa701b2a8bb80a9cb316bfa85ccadea0276bde611c72c
Jul 09 02:10:05.053405 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.053386    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 02:10:05.085811 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.085771    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-lkk9d"]
Jul 09 02:10:05.089665 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.089627    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-lkk9d"
Jul 09 02:10:05.093514 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.093485    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ktthp\""
Jul 09 02:10:05.093514 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.093495    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 02:10:05.100492 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.100433    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-lkk9d"]
Jul 09 02:10:05.194548 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.194448    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a592784-f207-437c-84b1-be5cc052fd75-plugins-config-volume\") pod \"payload-pre-processing-7964457696-lkk9d\" (UID: \"9a592784-f207-437c-84b1-be5cc052fd75\") " pod="openshift-ingress/payload-pre-processing-7964457696-lkk9d"
Jul 09 02:10:05.194548 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.194494    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt9dq\" (UniqueName: \"kubernetes.io/projected/9a592784-f207-437c-84b1-be5cc052fd75-kube-api-access-zt9dq\") pod \"payload-pre-processing-7964457696-lkk9d\" (UID: \"9a592784-f207-437c-84b1-be5cc052fd75\") " pod="openshift-ingress/payload-pre-processing-7964457696-lkk9d"
Jul 09 02:10:05.295477 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.295441    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a592784-f207-437c-84b1-be5cc052fd75-plugins-config-volume\") pod \"payload-pre-processing-7964457696-lkk9d\" (UID: \"9a592784-f207-437c-84b1-be5cc052fd75\") " pod="openshift-ingress/payload-pre-processing-7964457696-lkk9d"
Jul 09 02:10:05.295477 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.295488    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt9dq\" (UniqueName: \"kubernetes.io/projected/9a592784-f207-437c-84b1-be5cc052fd75-kube-api-access-zt9dq\") pod \"payload-pre-processing-7964457696-lkk9d\" (UID: \"9a592784-f207-437c-84b1-be5cc052fd75\") " pod="openshift-ingress/payload-pre-processing-7964457696-lkk9d"
Jul 09 02:10:05.296250 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.296231    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a592784-f207-437c-84b1-be5cc052fd75-plugins-config-volume\") pod \"payload-pre-processing-7964457696-lkk9d\" (UID: \"9a592784-f207-437c-84b1-be5cc052fd75\") " pod="openshift-ingress/payload-pre-processing-7964457696-lkk9d"
Jul 09 02:10:05.315285 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.315249    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt9dq\" (UniqueName: \"kubernetes.io/projected/9a592784-f207-437c-84b1-be5cc052fd75-kube-api-access-zt9dq\") pod \"payload-pre-processing-7964457696-lkk9d\" (UID: \"9a592784-f207-437c-84b1-be5cc052fd75\") " pod="openshift-ingress/payload-pre-processing-7964457696-lkk9d"
Jul 09 02:10:05.375384 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.375349    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts" event={"ID":"b237646f-3c91-43b9-b76d-3f4fd0fd11e7","Type":"ContainerStarted","Data":"6de7ca2bb4e3c42b10aaa701b2a8bb80a9cb316bfa85ccadea0276bde611c72c"}
Jul 09 02:10:05.402377 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.402338    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-lkk9d"
Jul 09 02:10:05.557682 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:05.557628    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-lkk9d"]
Jul 09 02:10:05.559921 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:10:05.559898    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a592784_f207_437c_84b1_be5cc052fd75.slice/crio-91e1b22f279dcb8eaa214082ee9b0e92eb0504d1338b2e13397b8cb671599586 WatchSource:0}: Error finding container 91e1b22f279dcb8eaa214082ee9b0e92eb0504d1338b2e13397b8cb671599586: Status 404 returned error can't find the container with id 91e1b22f279dcb8eaa214082ee9b0e92eb0504d1338b2e13397b8cb671599586
Jul 09 02:10:06.383383 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:06.383260    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-lkk9d" event={"ID":"9a592784-f207-437c-84b1-be5cc052fd75","Type":"ContainerStarted","Data":"91e1b22f279dcb8eaa214082ee9b0e92eb0504d1338b2e13397b8cb671599586"}
Jul 09 02:10:08.394988 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:08.394952    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts" event={"ID":"b237646f-3c91-43b9-b76d-3f4fd0fd11e7","Type":"ContainerStarted","Data":"9eebb15f1e56e92601e5ff6bf259a916975f1f6d9eac13b0b4e46d28998a38b7"}
Jul 09 02:10:08.395457 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:08.395096    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts"
Jul 09 02:10:08.396414 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:08.396390    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-lkk9d" event={"ID":"9a592784-f207-437c-84b1-be5cc052fd75","Type":"ContainerStarted","Data":"7005b21dfc31a62cc0a06df151a03441a2eb463a0d1d0a963a13a9425c5963e7"}
Jul 09 02:10:08.396545 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:08.396529    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-lkk9d"
Jul 09 02:10:08.415380 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:08.415332    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts" podStartSLOduration=1.9547153860000002 podStartE2EDuration="4.415318098s" totalImagesPullingTime="2.460602712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:10:08.414225916 +0000 UTC m=+633.696150079" watchObservedRunningTime="2026-07-09 02:10:08.415318098 +0000 UTC m=+633.697242233"
Jul 09 02:10:08.431258 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:08.431183    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-lkk9d" podStartSLOduration=1.477130155 podStartE2EDuration="3.431166472s" totalImagesPullingTime="1.954036317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:10:08.429687229 +0000 UTC m=+633.711611369" watchObservedRunningTime="2026-07-09 02:10:08.431166472 +0000 UTC m=+633.713090611"
Jul 09 02:10:13.429915 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:13.429880    2556 generic.go:356] "Generic (PLEG): container finished" podID="58e0bd42-2798-4fe1-a334-482e039808cc" containerID="d5f41bad3fb242da88cabb4f1ce0f5feab718dcdaa1d5fe804fcc1c9819e6b25" exitCode=0
Jul 09 02:10:13.430341 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:13.429940    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66" event={"ID":"58e0bd42-2798-4fe1-a334-482e039808cc","Type":"ContainerDied","Data":"d5f41bad3fb242da88cabb4f1ce0f5feab718dcdaa1d5fe804fcc1c9819e6b25"}
Jul 09 02:10:13.430414 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:13.430395    2556 scope.go:117] "RemoveContainer" containerID="d5f41bad3fb242da88cabb4f1ce0f5feab718dcdaa1d5fe804fcc1c9819e6b25"
Jul 09 02:10:13.431508 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:13.431477    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:10:13.431584 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:13.431548    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:10:13.431630 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:13.431612    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:10:14.406511 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:14.406485    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7f86449945-8jpts"
Jul 09 02:10:14.438879 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:14.438846    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66" event={"ID":"58e0bd42-2798-4fe1-a334-482e039808cc","Type":"ContainerStarted","Data":"4b152a6343aa187608b16e85ff092a8797b95985cb5fcfd76f2519473cc42cb8"}
Jul 09 02:10:14.862152 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:14.862114    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:10:14.863329 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:14.863296    2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-55h66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 02:10:14.863468 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:14.863358    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66" podUID="58e0bd42-2798-4fe1-a334-482e039808cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 02:10:14.979355 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:14.979318    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:10:15.862262 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:15.862221    2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-55h66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 02:10:15.862680 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:15.862286    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66" podUID="58e0bd42-2798-4fe1-a334-482e039808cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 02:10:16.862930 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:16.862896    2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-55h66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 02:10:16.863343 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:16.862953    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66" podUID="58e0bd42-2798-4fe1-a334-482e039808cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 02:10:17.863033 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:17.862993    2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-55h66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 09 02:10:17.863432 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:17.863063    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66" podUID="58e0bd42-2798-4fe1-a334-482e039808cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 09 02:10:18.866626 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:18.866592    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:10:18.867656 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:18.867634    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-55h66"
Jul 09 02:10:19.404165 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:19.404131    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-lkk9d"
Jul 09 02:10:23.703455 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.703423    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"]
Jul 09 02:10:23.706057 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.706036    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.710308 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.710281    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 02:10:23.711574 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.711542    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 09 02:10:23.711683 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.711632    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 02:10:23.711683 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.711632    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tcfth\""
Jul 09 02:10:23.729289 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.729259    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"]
Jul 09 02:10:23.772153 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.772115    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69c7d19b-8902-4133-a6cf-2d59a620e6b1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.772318 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.772169    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69c7d19b-8902-4133-a6cf-2d59a620e6b1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.772318 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.772195    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69c7d19b-8902-4133-a6cf-2d59a620e6b1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.772318 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.772247    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69c7d19b-8902-4133-a6cf-2d59a620e6b1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.772318 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.772261    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69c7d19b-8902-4133-a6cf-2d59a620e6b1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.772318 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.772281    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htnkx\" (UniqueName: \"kubernetes.io/projected/69c7d19b-8902-4133-a6cf-2d59a620e6b1-kube-api-access-htnkx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.873831 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.873791    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69c7d19b-8902-4133-a6cf-2d59a620e6b1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.874034 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.873855    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69c7d19b-8902-4133-a6cf-2d59a620e6b1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.874034 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.873885    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69c7d19b-8902-4133-a6cf-2d59a620e6b1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.874034 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.873922    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69c7d19b-8902-4133-a6cf-2d59a620e6b1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.874034 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.873940    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69c7d19b-8902-4133-a6cf-2d59a620e6b1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.874034 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.873963    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htnkx\" (UniqueName: \"kubernetes.io/projected/69c7d19b-8902-4133-a6cf-2d59a620e6b1-kube-api-access-htnkx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.874344 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.874315    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69c7d19b-8902-4133-a6cf-2d59a620e6b1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.874590 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.874542    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69c7d19b-8902-4133-a6cf-2d59a620e6b1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.874708 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.874604    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69c7d19b-8902-4133-a6cf-2d59a620e6b1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.876942 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.876920    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69c7d19b-8902-4133-a6cf-2d59a620e6b1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.877368 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.877351    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69c7d19b-8902-4133-a6cf-2d59a620e6b1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:23.885746 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:23.885716    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htnkx\" (UniqueName: \"kubernetes.io/projected/69c7d19b-8902-4133-a6cf-2d59a620e6b1-kube-api-access-htnkx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tnbf8\" (UID: \"69c7d19b-8902-4133-a6cf-2d59a620e6b1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:24.016799 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:24.016696    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:24.162071 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:24.162048    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"]
Jul 09 02:10:24.164431 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:10:24.164401    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c7d19b_8902_4133_a6cf_2d59a620e6b1.slice/crio-b43dea264714e56a925712a5e00f1eda0154ceda830219bb1130a0c6d08aa727 WatchSource:0}: Error finding container b43dea264714e56a925712a5e00f1eda0154ceda830219bb1130a0c6d08aa727: Status 404 returned error can't find the container with id b43dea264714e56a925712a5e00f1eda0154ceda830219bb1130a0c6d08aa727
Jul 09 02:10:24.495682 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:24.495630    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8" event={"ID":"69c7d19b-8902-4133-a6cf-2d59a620e6b1","Type":"ContainerStarted","Data":"b43dea264714e56a925712a5e00f1eda0154ceda830219bb1130a0c6d08aa727"}
Jul 09 02:10:25.502225 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:25.502137    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8" event={"ID":"69c7d19b-8902-4133-a6cf-2d59a620e6b1","Type":"ContainerStarted","Data":"d17a2c940828b037905797494f8be600e7653db5ed639f2da51d44b2c73c8aa0"}
Jul 09 02:10:25.522302 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:25.522237    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8" podStartSLOduration=1.505580938 podStartE2EDuration="2.522221045s" totalImagesPullingTime="1.016640107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:10:25.521224729 +0000 UTC m=+650.803148865" watchObservedRunningTime="2026-07-09 02:10:25.522221045 +0000 UTC m=+650.804145182"
Jul 09 02:10:34.017175 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:34.017121    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:34.017628 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:34.017195    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:34.029535 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:34.029504    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:10:34.556675 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:10:34.556642    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tnbf8"
Jul 09 02:11:03.210372 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.210340    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"]
Jul 09 02:11:03.214199 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.214182    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.217221 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.217200    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 09 02:11:03.230517 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.230490    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"]
Jul 09 02:11:03.342479 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.342442    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47s44\" (UniqueName: \"kubernetes.io/projected/37b859a9-1f3b-4093-89d3-ece3be682d6a-kube-api-access-47s44\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.342714 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.342490    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37b859a9-1f3b-4093-89d3-ece3be682d6a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.342714 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.342696    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37b859a9-1f3b-4093-89d3-ece3be682d6a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.342831 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.342738    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37b859a9-1f3b-4093-89d3-ece3be682d6a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.342831 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.342804    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37b859a9-1f3b-4093-89d3-ece3be682d6a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.342948 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.342868    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37b859a9-1f3b-4093-89d3-ece3be682d6a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.444068 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.444009    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47s44\" (UniqueName: \"kubernetes.io/projected/37b859a9-1f3b-4093-89d3-ece3be682d6a-kube-api-access-47s44\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.444068 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.444075    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37b859a9-1f3b-4093-89d3-ece3be682d6a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.444337 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.444188    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37b859a9-1f3b-4093-89d3-ece3be682d6a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.444337 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.444216    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37b859a9-1f3b-4093-89d3-ece3be682d6a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.444337 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.444244    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37b859a9-1f3b-4093-89d3-ece3be682d6a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.444337 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.444286    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37b859a9-1f3b-4093-89d3-ece3be682d6a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.444661 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.444626    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37b859a9-1f3b-4093-89d3-ece3be682d6a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.444723 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.444675    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37b859a9-1f3b-4093-89d3-ece3be682d6a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.444791 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.444766    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37b859a9-1f3b-4093-89d3-ece3be682d6a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.446475 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.446449    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37b859a9-1f3b-4093-89d3-ece3be682d6a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.446759 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.446741    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37b859a9-1f3b-4093-89d3-ece3be682d6a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.452716 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.452694    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47s44\" (UniqueName: \"kubernetes.io/projected/37b859a9-1f3b-4093-89d3-ece3be682d6a-kube-api-access-47s44\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-l74nf\" (UID: \"37b859a9-1f3b-4093-89d3-ece3be682d6a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.525425 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.525334    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:03.660981 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.660880    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"]
Jul 09 02:11:03.663897 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:11:03.663866    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37b859a9_1f3b_4093_89d3_ece3be682d6a.slice/crio-867adf07f5580b61834273c147142694e80f19451a2c95640e8fcfe0cbd8d07b WatchSource:0}: Error finding container 867adf07f5580b61834273c147142694e80f19451a2c95640e8fcfe0cbd8d07b: Status 404 returned error can't find the container with id 867adf07f5580b61834273c147142694e80f19451a2c95640e8fcfe0cbd8d07b
Jul 09 02:11:03.689217 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:03.689175    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf" event={"ID":"37b859a9-1f3b-4093-89d3-ece3be682d6a","Type":"ContainerStarted","Data":"867adf07f5580b61834273c147142694e80f19451a2c95640e8fcfe0cbd8d07b"}
Jul 09 02:11:04.696115 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:04.696080    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf" event={"ID":"37b859a9-1f3b-4093-89d3-ece3be682d6a","Type":"ContainerStarted","Data":"7c373ff0c17751de6323ac3380b47bb03bc12a8b3f3dbf2a0008b76083d80c17"}
Jul 09 02:11:04.715672 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:04.715620    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf" podStartSLOduration=1.483204802 podStartE2EDuration="1.715602582s" totalImagesPullingTime="232.39778ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:11:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:11:04.713400308 +0000 UTC m=+689.995324446" watchObservedRunningTime="2026-07-09 02:11:04.715602582 +0000 UTC m=+689.997526733"
Jul 09 02:11:13.526210 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:13.526172    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:13.526692 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:13.526241    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:13.538674 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:13.538646    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:11:13.751596 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:11:13.751550    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-l74nf"
Jul 09 02:25:29.425323 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.425248    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"]
Jul 09 02:25:29.428886 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.428866    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.431263 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.431236    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-75f2e25f-openshift-default-dockercfg-k7976\""
Jul 09 02:25:29.449390 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.449358    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"]
Jul 09 02:25:29.462433 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.462403    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-workload-certs\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.462618 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.462449    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-envoy\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.462618 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.462467    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-podinfo\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.462618 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.462493    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-credential-socket\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.462794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.462636    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-token\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.462794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.462685    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-workload-socket\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.462794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.462734    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-data\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.462794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.462761    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istiod-ca-cert\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.462794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.462787    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxlk4\" (UniqueName: \"kubernetes.io/projected/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-kube-api-access-hxlk4\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.564061 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.564029    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-envoy\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.564061 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.564064    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-podinfo\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.564295 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.564088    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-credential-socket\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.564295 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.564124    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-token\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.564295 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.564151    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-workload-socket\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.564295 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.564167    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-data\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.564295 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.564185    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istiod-ca-cert\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.564295 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.564206    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxlk4\" (UniqueName: \"kubernetes.io/projected/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-kube-api-access-hxlk4\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.564295 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.564277    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-workload-certs\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.564670 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.564542    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-credential-socket\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.564670 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.564587    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-data\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.564789 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.564678    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-workload-socket\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.564859 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.564842    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-workload-certs\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.565132 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.564995    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istiod-ca-cert\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.566542 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.566518    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-envoy\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.566761 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.566743    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-podinfo\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.577205 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.577184    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-token\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.578056 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.578035    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxlk4\" (UniqueName: \"kubernetes.io/projected/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-kube-api-access-hxlk4\") pod \"e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") " pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.740009 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.739919    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:29.875149 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.875124    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"]
Jul 09 02:25:29.877676 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:25:29.877648    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6303b4c3_1674_4c4b_8ee8_e87d6b8365c8.slice/crio-ed58430cbf3bbb760a9294b5fa9cb35d7258acb29636903c68daab98239cdfbc WatchSource:0}: Error finding container ed58430cbf3bbb760a9294b5fa9cb35d7258acb29636903c68daab98239cdfbc: Status 404 returned error can't find the container with id ed58430cbf3bbb760a9294b5fa9cb35d7258acb29636903c68daab98239cdfbc
Jul 09 02:25:29.879762 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.879729    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:25:29.879878 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.879803    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:25:29.879878 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.879848    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:25:29.978185 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.978152    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx" event={"ID":"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8","Type":"ContainerStarted","Data":"80899ee3e98531d9829f0eba90d3aa4bf3dd594dd0dd266a4ced5c2f56c523eb"}
Jul 09 02:25:29.978363 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.978206    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx" event={"ID":"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8","Type":"ContainerStarted","Data":"ed58430cbf3bbb760a9294b5fa9cb35d7258acb29636903c68daab98239cdfbc"}
Jul 09 02:25:29.997168 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:29.997062    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx" podStartSLOduration=0.997044129 podStartE2EDuration="997.044129ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:25:29.994980925 +0000 UTC m=+1555.276905061" watchObservedRunningTime="2026-07-09 02:25:29.997044129 +0000 UTC m=+1555.278968264"
Jul 09 02:25:30.623284 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.623242    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"]
Jul 09 02:25:30.627399 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.627377    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:30.629880 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.629857    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-75f2e25f-serving-cert\""
Jul 09 02:25:30.634048 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.634026    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"]
Jul 09 02:25:30.675168 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.675137    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgg6k\" (UniqueName: \"kubernetes.io/projected/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-kube-api-access-mgg6k\") pod \"maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6\" (UID: \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:30.675300 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.675210    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-openshift-service-ca\") pod \"maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6\" (UID: \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:30.675300 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.675247    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-maas-api-tls\") pod \"maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6\" (UID: \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:30.740072 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.740037    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:30.746730 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.746701    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:30.776675 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.776645    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-openshift-service-ca\") pod \"maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6\" (UID: \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:30.776852 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.776711    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-maas-api-tls\") pod \"maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6\" (UID: \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:30.776852 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.776815    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgg6k\" (UniqueName: \"kubernetes.io/projected/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-kube-api-access-mgg6k\") pod \"maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6\" (UID: \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:30.776968 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:25:30.776864    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-serving-cert: secret "maas-api-e2e-ait-75f2e25f-serving-cert" not found
Jul 09 02:25:30.776968 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:25:30.776938    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-maas-api-tls podName:4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2 nodeName:}" failed. No retries permitted until 2026-07-09 02:25:31.276916448 +0000 UTC m=+1556.558840573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-maas-api-tls") pod "maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6" (UID: "4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2") : secret "maas-api-e2e-ait-75f2e25f-serving-cert" not found
Jul 09 02:25:30.777330 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.777311    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-openshift-service-ca\") pod \"maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6\" (UID: \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:30.785597 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.785544    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgg6k\" (UniqueName: \"kubernetes.io/projected/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-kube-api-access-mgg6k\") pod \"maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6\" (UID: \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:30.983613 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.983508    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:30.984653 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:30.984628    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:31.280214 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:31.280126    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-maas-api-tls\") pod \"maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6\" (UID: \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:31.282616 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:31.282596    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-maas-api-tls\") pod \"maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6\" (UID: \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:31.540478 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:31.540390    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:31.670244 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:31.670219    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"]
Jul 09 02:25:31.672152 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:25:31.672122    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff024e5_6dea_4b37_8de7_7b5c46bcb2d2.slice/crio-fabd8e2f3ee67dab1f853869d980fec3822a37d5fe54ba8c0337d2aee3122733 WatchSource:0}: Error finding container fabd8e2f3ee67dab1f853869d980fec3822a37d5fe54ba8c0337d2aee3122733: Status 404 returned error can't find the container with id fabd8e2f3ee67dab1f853869d980fec3822a37d5fe54ba8c0337d2aee3122733
Jul 09 02:25:31.673735 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:31.673703    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 02:25:31.988762 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:31.988726    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6" event={"ID":"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2","Type":"ContainerStarted","Data":"fabd8e2f3ee67dab1f853869d980fec3822a37d5fe54ba8c0337d2aee3122733"}
Jul 09 02:25:32.996119 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:32.996086    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6" event={"ID":"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2","Type":"ContainerStarted","Data":"b860bd88a4eeccf4bbf85578253e158e462bffb4b7a0ba35491273d5b65c2aa1"}
Jul 09 02:25:32.996508 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:32.996165    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:33.016372 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:33.016326    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6" podStartSLOduration=2.508900376 podStartE2EDuration="3.016309221s" totalImagesPullingTime="507.408845ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:25:33.014818736 +0000 UTC m=+1558.296742872" watchObservedRunningTime="2026-07-09 02:25:33.016309221 +0000 UTC m=+1558.298233356"
Jul 09 02:25:35.879445 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:35.879413    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"]
Jul 09 02:25:35.879977 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:35.879659    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx" podUID="6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" containerName="istio-proxy" containerID="cri-o://80899ee3e98531d9829f0eba90d3aa4bf3dd594dd0dd266a4ced5c2f56c523eb" gracePeriod=30
Jul 09 02:25:36.046290 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:36.046241    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"]
Jul 09 02:25:36.046794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:36.046764    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6" podUID="4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2" containerName="maas-api" containerID="cri-o://b860bd88a4eeccf4bbf85578253e158e462bffb4b7a0ba35491273d5b65c2aa1" gracePeriod=30
Jul 09 02:25:36.356000 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:36.355964    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:36.448272 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:36.448171    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-maas-api-tls\") pod \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\" (UID: \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\") "
Jul 09 02:25:36.448272 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:36.448262    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgg6k\" (UniqueName: \"kubernetes.io/projected/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-kube-api-access-mgg6k\") pod \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\" (UID: \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\") "
Jul 09 02:25:36.448500 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:36.448355    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-openshift-service-ca\") pod \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\" (UID: \"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2\") "
Jul 09 02:25:36.448778 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:36.448749    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2" (UID: "4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:25:36.450510 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:36.450484    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2" (UID: "4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:25:36.450625 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:36.450571    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-kube-api-access-mgg6k" (OuterVolumeSpecName: "kube-api-access-mgg6k") pod "4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2" (UID: "4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2"). InnerVolumeSpecName "kube-api-access-mgg6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:25:36.550075 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:36.550038    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:36.550075 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:36.550071    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:36.550075 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:36.550080    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgg6k\" (UniqueName: \"kubernetes.io/projected/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2-kube-api-access-mgg6k\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:37.020823 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:37.020781    2556 generic.go:356] "Generic (PLEG): container finished" podID="4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2" containerID="b860bd88a4eeccf4bbf85578253e158e462bffb4b7a0ba35491273d5b65c2aa1" exitCode=0
Jul 09 02:25:37.021337 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:37.020841    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"
Jul 09 02:25:37.021337 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:37.020922    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6" event={"ID":"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2","Type":"ContainerDied","Data":"b860bd88a4eeccf4bbf85578253e158e462bffb4b7a0ba35491273d5b65c2aa1"}
Jul 09 02:25:37.021337 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:37.021004    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6" event={"ID":"4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2","Type":"ContainerDied","Data":"fabd8e2f3ee67dab1f853869d980fec3822a37d5fe54ba8c0337d2aee3122733"}
Jul 09 02:25:37.021337 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:37.021038    2556 scope.go:117] "RemoveContainer" containerID="b860bd88a4eeccf4bbf85578253e158e462bffb4b7a0ba35491273d5b65c2aa1"
Jul 09 02:25:37.037321 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:37.037017    2556 scope.go:117] "RemoveContainer" containerID="b860bd88a4eeccf4bbf85578253e158e462bffb4b7a0ba35491273d5b65c2aa1"
Jul 09 02:25:37.037658 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:25:37.037585    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b860bd88a4eeccf4bbf85578253e158e462bffb4b7a0ba35491273d5b65c2aa1\": container with ID starting with b860bd88a4eeccf4bbf85578253e158e462bffb4b7a0ba35491273d5b65c2aa1 not found: ID does not exist" containerID="b860bd88a4eeccf4bbf85578253e158e462bffb4b7a0ba35491273d5b65c2aa1"
Jul 09 02:25:37.037658 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:37.037630    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b860bd88a4eeccf4bbf85578253e158e462bffb4b7a0ba35491273d5b65c2aa1"} err="failed to get container status \"b860bd88a4eeccf4bbf85578253e158e462bffb4b7a0ba35491273d5b65c2aa1\": rpc error: code = NotFound desc = could not find container \"b860bd88a4eeccf4bbf85578253e158e462bffb4b7a0ba35491273d5b65c2aa1\": container with ID starting with b860bd88a4eeccf4bbf85578253e158e462bffb4b7a0ba35491273d5b65c2aa1 not found: ID does not exist"
Jul 09 02:25:37.060086 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:37.060059    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"]
Jul 09 02:25:37.063285 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:37.063262    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-75f2e25f-cc6fbf4c6-qp8l6"]
Jul 09 02:25:37.275167 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:37.275087    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2" path="/var/lib/kubelet/pods/4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2/volumes"
Jul 09 02:25:41.540190 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.540167    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:41.701426 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.701341    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-credential-socket\") pod \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") "
Jul 09 02:25:41.701426 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.701394    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istiod-ca-cert\") pod \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") "
Jul 09 02:25:41.701426 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.701420    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-podinfo\") pod \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") "
Jul 09 02:25:41.701743 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.701437    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-token\") pod \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") "
Jul 09 02:25:41.701743 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.701513    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-data\") pod \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") "
Jul 09 02:25:41.701743 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.701542    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-workload-socket\") pod \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") "
Jul 09 02:25:41.701743 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.701587    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-envoy\") pod \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") "
Jul 09 02:25:41.701743 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.701614    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-workload-certs\") pod \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") "
Jul 09 02:25:41.701743 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.701643    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxlk4\" (UniqueName: \"kubernetes.io/projected/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-kube-api-access-hxlk4\") pod \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\" (UID: \"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8\") "
Jul 09 02:25:41.701743 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.701693    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" (UID: "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:25:41.702122 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.701862    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" (UID: "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:25:41.702122 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.702020    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" (UID: "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:25:41.702122 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.702073    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-credential-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:41.702122 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.702093    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istiod-ca-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:41.702122 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.702090    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" (UID: "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:25:41.702509 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.702478    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-data" (OuterVolumeSpecName: "istio-data") pod "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" (UID: "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:25:41.703822 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.703793    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" (UID: "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:25:41.703822 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.703809    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" (UID: "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 02:25:41.704321 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.704296    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" (UID: "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:25:41.704409 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.704299    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-kube-api-access-hxlk4" (OuterVolumeSpecName: "kube-api-access-hxlk4") pod "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" (UID: "6303b4c3-1674-4c4b-8ee8-e87d6b8365c8"). InnerVolumeSpecName "kube-api-access-hxlk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:25:41.802769 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.802728    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-podinfo\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:41.802769 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.802762    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:41.802769 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.802771    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-data\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:41.802769 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.802778    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-workload-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:41.803042 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.802786    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-istio-envoy\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:41.803042 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.802795    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-workload-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:41.803042 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:41.802803    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxlk4\" (UniqueName: \"kubernetes.io/projected/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8-kube-api-access-hxlk4\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:42.051461 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.051362    2556 generic.go:356] "Generic (PLEG): container finished" podID="6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" containerID="80899ee3e98531d9829f0eba90d3aa4bf3dd594dd0dd266a4ced5c2f56c523eb" exitCode=0
Jul 09 02:25:42.051461 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.051415    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"
Jul 09 02:25:42.051461 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.051446    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx" event={"ID":"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8","Type":"ContainerDied","Data":"80899ee3e98531d9829f0eba90d3aa4bf3dd594dd0dd266a4ced5c2f56c523eb"}
Jul 09 02:25:42.051766 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.051501    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx" event={"ID":"6303b4c3-1674-4c4b-8ee8-e87d6b8365c8","Type":"ContainerDied","Data":"ed58430cbf3bbb760a9294b5fa9cb35d7258acb29636903c68daab98239cdfbc"}
Jul 09 02:25:42.051766 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.051523    2556 scope.go:117] "RemoveContainer" containerID="80899ee3e98531d9829f0eba90d3aa4bf3dd594dd0dd266a4ced5c2f56c523eb"
Jul 09 02:25:42.061525 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.061500    2556 scope.go:117] "RemoveContainer" containerID="80899ee3e98531d9829f0eba90d3aa4bf3dd594dd0dd266a4ced5c2f56c523eb"
Jul 09 02:25:42.061809 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:25:42.061789    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80899ee3e98531d9829f0eba90d3aa4bf3dd594dd0dd266a4ced5c2f56c523eb\": container with ID starting with 80899ee3e98531d9829f0eba90d3aa4bf3dd594dd0dd266a4ced5c2f56c523eb not found: ID does not exist" containerID="80899ee3e98531d9829f0eba90d3aa4bf3dd594dd0dd266a4ced5c2f56c523eb"
Jul 09 02:25:42.061870 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.061820    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80899ee3e98531d9829f0eba90d3aa4bf3dd594dd0dd266a4ced5c2f56c523eb"} err="failed to get container status \"80899ee3e98531d9829f0eba90d3aa4bf3dd594dd0dd266a4ced5c2f56c523eb\": rpc error: code = NotFound desc = could not find container \"80899ee3e98531d9829f0eba90d3aa4bf3dd594dd0dd266a4ced5c2f56c523eb\": container with ID starting with 80899ee3e98531d9829f0eba90d3aa4bf3dd594dd0dd266a4ced5c2f56c523eb not found: ID does not exist"
Jul 09 02:25:42.076797 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.076768    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"]
Jul 09 02:25:42.083244 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.083216    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-75f2e25f-openshift-default-fd594fc67-d4wrx"]
Jul 09 02:25:42.147378 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.147345    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"]
Jul 09 02:25:42.147964 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.147947    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2" containerName="maas-api"
Jul 09 02:25:42.148021 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.147968    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2" containerName="maas-api"
Jul 09 02:25:42.148021 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.147988    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" containerName="istio-proxy"
Jul 09 02:25:42.148021 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.147997    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" containerName="istio-proxy"
Jul 09 02:25:42.148123 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.148102    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" containerName="istio-proxy"
Jul 09 02:25:42.148123 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.148116    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff024e5-6dea-4b37-8de7-7b5c46bcb2d2" containerName="maas-api"
Jul 09 02:25:42.151391 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.151369    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.153970 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.153951    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a4117432-openshift-default-dockercfg-5dldb\""
Jul 09 02:25:42.162893 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.162871    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"]
Jul 09 02:25:42.307431 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.307342    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-workload-socket\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.307431 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.307410    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-envoy\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.307677 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.307451    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-workload-certs\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.307677 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.307473    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istiod-ca-cert\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.307677 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.307490    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7bsj\" (UniqueName: \"kubernetes.io/projected/3a5a66b1-f17d-48a4-8efb-4504e6b57250-kube-api-access-g7bsj\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.307677 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.307541    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-credential-socket\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.307677 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.307600    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-data\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.307677 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.307620    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-token\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.307677 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.307657    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-podinfo\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.408482 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.408441    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-envoy\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.408689 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.408536    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-workload-certs\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.408689 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.408602    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istiod-ca-cert\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.408689 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.408627    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7bsj\" (UniqueName: \"kubernetes.io/projected/3a5a66b1-f17d-48a4-8efb-4504e6b57250-kube-api-access-g7bsj\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.408689 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.408659    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-credential-socket\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.408689 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.408681    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-data\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.408982 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.408960    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-token\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.409044 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.409026    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-podinfo\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.409098 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.409034    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-workload-certs\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.409153 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.409091    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-workload-socket\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.409153 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.409121    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-credential-socket\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.409153 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.409138    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-data\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.409393 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.409372    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-workload-socket\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.409505 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.409398    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istiod-ca-cert\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.410797 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.410772    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-envoy\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.411236 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.411220    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-podinfo\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.418889 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.418864    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7bsj\" (UniqueName: \"kubernetes.io/projected/3a5a66b1-f17d-48a4-8efb-4504e6b57250-kube-api-access-g7bsj\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.419004 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.418865    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-token\") pod \"e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") " pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.465063 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.465033    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:42.601597 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.601572    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"]
Jul 09 02:25:42.603431 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:25:42.603400    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a5a66b1_f17d_48a4_8efb_4504e6b57250.slice/crio-7fe1d58fdf5d6092710867b652421fe3819d1571bc0bf24697fc7d73de1f629d WatchSource:0}: Error finding container 7fe1d58fdf5d6092710867b652421fe3819d1571bc0bf24697fc7d73de1f629d: Status 404 returned error can't find the container with id 7fe1d58fdf5d6092710867b652421fe3819d1571bc0bf24697fc7d73de1f629d
Jul 09 02:25:42.605625 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.605594    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:25:42.605708 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.605660    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:25:42.605708 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:42.605688    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:25:43.058495 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.058400    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6" event={"ID":"3a5a66b1-f17d-48a4-8efb-4504e6b57250","Type":"ContainerStarted","Data":"b269024ce0f340cf3438595c14f341c4deb2153a1e1be7be44c572995c393fe1"}
Jul 09 02:25:43.058495 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.058451    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6" event={"ID":"3a5a66b1-f17d-48a4-8efb-4504e6b57250","Type":"ContainerStarted","Data":"7fe1d58fdf5d6092710867b652421fe3819d1571bc0bf24697fc7d73de1f629d"}
Jul 09 02:25:43.080053 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.080005    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6" podStartSLOduration=1.07998867 podStartE2EDuration="1.07998867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:25:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:25:43.079530848 +0000 UTC m=+1568.361454985" watchObservedRunningTime="2026-07-09 02:25:43.07998867 +0000 UTC m=+1568.361912806"
Jul 09 02:25:43.276569 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.276531    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6303b4c3-1674-4c4b-8ee8-e87d6b8365c8" path="/var/lib/kubelet/pods/6303b4c3-1674-4c4b-8ee8-e87d6b8365c8/volumes"
Jul 09 02:25:43.439825 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.439791    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"]
Jul 09 02:25:43.443287 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.443251    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:43.446069 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.446049    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a4117432-serving-cert\""
Jul 09 02:25:43.453149 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.453124    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"]
Jul 09 02:25:43.465807 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.465783    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:43.466989 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.466962    2556 patch_prober.go:28] interesting pod/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 09 02:25:43.467123 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.467015    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6" podUID="3a5a66b1-f17d-48a4-8efb-4504e6b57250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 09 02:25:43.519627 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.519589    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm5lb\" (UniqueName: \"kubernetes.io/projected/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-kube-api-access-nm5lb\") pod \"maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd\" (UID: \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:43.519792 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.519677    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-maas-api-tls\") pod \"maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd\" (UID: \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:43.519792 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.519740    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-openshift-service-ca\") pod \"maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd\" (UID: \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:43.621103 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.621065    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-openshift-service-ca\") pod \"maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd\" (UID: \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:43.621611 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.621144    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5lb\" (UniqueName: \"kubernetes.io/projected/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-kube-api-access-nm5lb\") pod \"maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd\" (UID: \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:43.621611 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.621175    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-maas-api-tls\") pod \"maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd\" (UID: \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:43.621611 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:25:43.621306    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-serving-cert: secret "maas-api-e2e-ait-a4117432-serving-cert" not found
Jul 09 02:25:43.621611 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:25:43.621369    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-maas-api-tls podName:6259fd12-7cc8-4c17-bd05-7e58d0e778a8 nodeName:}" failed. No retries permitted until 2026-07-09 02:25:44.121353282 +0000 UTC m=+1569.403277396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-maas-api-tls") pod "maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd" (UID: "6259fd12-7cc8-4c17-bd05-7e58d0e778a8") : secret "maas-api-e2e-ait-a4117432-serving-cert" not found
Jul 09 02:25:43.621943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.621921    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-openshift-service-ca\") pod \"maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd\" (UID: \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:43.630468 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:43.630438    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm5lb\" (UniqueName: \"kubernetes.io/projected/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-kube-api-access-nm5lb\") pod \"maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd\" (UID: \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:44.128053 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:44.128002    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-maas-api-tls\") pod \"maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd\" (UID: \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:44.131353 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:44.131324    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-maas-api-tls\") pod \"maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd\" (UID: \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:44.357098 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:44.357065    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:44.470190 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:44.470156    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:44.490199 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:44.490169    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"]
Jul 09 02:25:44.492157 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:25:44.492131    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6259fd12_7cc8_4c17_bd05_7e58d0e778a8.slice/crio-e17f19426de7ede5f41c6c47c645ccace2c18ac9283718882d8ba73af8bf5314 WatchSource:0}: Error finding container e17f19426de7ede5f41c6c47c645ccace2c18ac9283718882d8ba73af8bf5314: Status 404 returned error can't find the container with id e17f19426de7ede5f41c6c47c645ccace2c18ac9283718882d8ba73af8bf5314
Jul 09 02:25:45.070357 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:45.070243    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd" event={"ID":"6259fd12-7cc8-4c17-bd05-7e58d0e778a8","Type":"ContainerStarted","Data":"db7f47dd90d531ac56ba150d60493ca8dc5aad94eedafa0cf49eccf2a70d528c"}
Jul 09 02:25:45.070357 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:45.070347    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd" event={"ID":"6259fd12-7cc8-4c17-bd05-7e58d0e778a8","Type":"ContainerStarted","Data":"e17f19426de7ede5f41c6c47c645ccace2c18ac9283718882d8ba73af8bf5314"}
Jul 09 02:25:45.070918 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:45.070578    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:45.070918 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:45.070625    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:45.071248 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:45.071231    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:45.087657 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:45.087607    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd" podStartSLOduration=1.795622071 podStartE2EDuration="2.087592178s" totalImagesPullingTime="291.970107ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:25:45.086152627 +0000 UTC m=+1570.368076806" watchObservedRunningTime="2026-07-09 02:25:45.087592178 +0000 UTC m=+1570.369516308"
Jul 09 02:25:48.771587 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:48.771486    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"]
Jul 09 02:25:48.772051 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:48.771747    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd" podUID="6259fd12-7cc8-4c17-bd05-7e58d0e778a8" containerName="maas-api" containerID="cri-o://db7f47dd90d531ac56ba150d60493ca8dc5aad94eedafa0cf49eccf2a70d528c" gracePeriod=30
Jul 09 02:25:49.051406 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.051334    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:49.090795 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.090760    2556 generic.go:356] "Generic (PLEG): container finished" podID="6259fd12-7cc8-4c17-bd05-7e58d0e778a8" containerID="db7f47dd90d531ac56ba150d60493ca8dc5aad94eedafa0cf49eccf2a70d528c" exitCode=0
Jul 09 02:25:49.090959 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.090808    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"
Jul 09 02:25:49.090959 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.090852    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd" event={"ID":"6259fd12-7cc8-4c17-bd05-7e58d0e778a8","Type":"ContainerDied","Data":"db7f47dd90d531ac56ba150d60493ca8dc5aad94eedafa0cf49eccf2a70d528c"}
Jul 09 02:25:49.090959 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.090914    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd" event={"ID":"6259fd12-7cc8-4c17-bd05-7e58d0e778a8","Type":"ContainerDied","Data":"e17f19426de7ede5f41c6c47c645ccace2c18ac9283718882d8ba73af8bf5314"}
Jul 09 02:25:49.090959 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.090947    2556 scope.go:117] "RemoveContainer" containerID="db7f47dd90d531ac56ba150d60493ca8dc5aad94eedafa0cf49eccf2a70d528c"
Jul 09 02:25:49.099913 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.099895    2556 scope.go:117] "RemoveContainer" containerID="db7f47dd90d531ac56ba150d60493ca8dc5aad94eedafa0cf49eccf2a70d528c"
Jul 09 02:25:49.100178 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:25:49.100158    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db7f47dd90d531ac56ba150d60493ca8dc5aad94eedafa0cf49eccf2a70d528c\": container with ID starting with db7f47dd90d531ac56ba150d60493ca8dc5aad94eedafa0cf49eccf2a70d528c not found: ID does not exist" containerID="db7f47dd90d531ac56ba150d60493ca8dc5aad94eedafa0cf49eccf2a70d528c"
Jul 09 02:25:49.100253 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.100185    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db7f47dd90d531ac56ba150d60493ca8dc5aad94eedafa0cf49eccf2a70d528c"} err="failed to get container status \"db7f47dd90d531ac56ba150d60493ca8dc5aad94eedafa0cf49eccf2a70d528c\": rpc error: code = NotFound desc = could not find container \"db7f47dd90d531ac56ba150d60493ca8dc5aad94eedafa0cf49eccf2a70d528c\": container with ID starting with db7f47dd90d531ac56ba150d60493ca8dc5aad94eedafa0cf49eccf2a70d528c not found: ID does not exist"
Jul 09 02:25:49.179860 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.179825    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm5lb\" (UniqueName: \"kubernetes.io/projected/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-kube-api-access-nm5lb\") pod \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\" (UID: \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\") "
Jul 09 02:25:49.179860 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.179859    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-maas-api-tls\") pod \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\" (UID: \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\") "
Jul 09 02:25:49.180123 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.179888    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-openshift-service-ca\") pod \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\" (UID: \"6259fd12-7cc8-4c17-bd05-7e58d0e778a8\") "
Jul 09 02:25:49.180275 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.180251    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6259fd12-7cc8-4c17-bd05-7e58d0e778a8" (UID: "6259fd12-7cc8-4c17-bd05-7e58d0e778a8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:25:49.181994 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.181968    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-kube-api-access-nm5lb" (OuterVolumeSpecName: "kube-api-access-nm5lb") pod "6259fd12-7cc8-4c17-bd05-7e58d0e778a8" (UID: "6259fd12-7cc8-4c17-bd05-7e58d0e778a8"). InnerVolumeSpecName "kube-api-access-nm5lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:25:49.182086 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.182012    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6259fd12-7cc8-4c17-bd05-7e58d0e778a8" (UID: "6259fd12-7cc8-4c17-bd05-7e58d0e778a8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:25:49.280846 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.280813    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm5lb\" (UniqueName: \"kubernetes.io/projected/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-kube-api-access-nm5lb\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:49.280846 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.280849    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:49.281101 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.280867    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6259fd12-7cc8-4c17-bd05-7e58d0e778a8-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:49.407569 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.407518    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"]
Jul 09 02:25:49.413875 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:49.413847    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a4117432-f877cbc9f-m9dxd"]
Jul 09 02:25:51.274639 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:51.274607    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6259fd12-7cc8-4c17-bd05-7e58d0e778a8" path="/var/lib/kubelet/pods/6259fd12-7cc8-4c17-bd05-7e58d0e778a8/volumes"
Jul 09 02:25:54.414103 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.414073    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"]
Jul 09 02:25:54.414531 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.414294    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6" podUID="3a5a66b1-f17d-48a4-8efb-4504e6b57250" containerName="istio-proxy" containerID="cri-o://b269024ce0f340cf3438595c14f341c4deb2153a1e1be7be44c572995c393fe1" gracePeriod=30
Jul 09 02:25:54.779408 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.779385    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:54.937186 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.937092    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-workload-socket\") pod \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") "
Jul 09 02:25:54.937186 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.937147    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-podinfo\") pod \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") "
Jul 09 02:25:54.937186 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.937179    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-credential-socket\") pod \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") "
Jul 09 02:25:54.937478 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.937215    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7bsj\" (UniqueName: \"kubernetes.io/projected/3a5a66b1-f17d-48a4-8efb-4504e6b57250-kube-api-access-g7bsj\") pod \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") "
Jul 09 02:25:54.937478 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.937249    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-envoy\") pod \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") "
Jul 09 02:25:54.937478 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.937382    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-token\") pod \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") "
Jul 09 02:25:54.937478 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.937426    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a5a66b1-f17d-48a4-8efb-4504e6b57250" (UID: "3a5a66b1-f17d-48a4-8efb-4504e6b57250"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:25:54.937478 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.937433    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istiod-ca-cert\") pod \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") "
Jul 09 02:25:54.937772 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.937515    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-data\") pod \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") "
Jul 09 02:25:54.937772 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.937535    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a5a66b1-f17d-48a4-8efb-4504e6b57250" (UID: "3a5a66b1-f17d-48a4-8efb-4504e6b57250"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:25:54.937772 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.937630    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-workload-certs\") pod \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\" (UID: \"3a5a66b1-f17d-48a4-8efb-4504e6b57250\") "
Jul 09 02:25:54.937772 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.937737    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a5a66b1-f17d-48a4-8efb-4504e6b57250" (UID: "3a5a66b1-f17d-48a4-8efb-4504e6b57250"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:25:54.937983 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.937927    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a5a66b1-f17d-48a4-8efb-4504e6b57250" (UID: "3a5a66b1-f17d-48a4-8efb-4504e6b57250"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:25:54.938038 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.938016    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-credential-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:54.938090 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.938035    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istiod-ca-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:54.938090 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.938048    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-workload-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:54.938090 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.938060    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-workload-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:54.938471 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.938448    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a5a66b1-f17d-48a4-8efb-4504e6b57250" (UID: "3a5a66b1-f17d-48a4-8efb-4504e6b57250"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:25:54.939549 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.939504    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a5a66b1-f17d-48a4-8efb-4504e6b57250" (UID: "3a5a66b1-f17d-48a4-8efb-4504e6b57250"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 02:25:54.939549 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.939526    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a5a66b1-f17d-48a4-8efb-4504e6b57250-kube-api-access-g7bsj" (OuterVolumeSpecName: "kube-api-access-g7bsj") pod "3a5a66b1-f17d-48a4-8efb-4504e6b57250" (UID: "3a5a66b1-f17d-48a4-8efb-4504e6b57250"). InnerVolumeSpecName "kube-api-access-g7bsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:25:54.939855 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.939834    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a5a66b1-f17d-48a4-8efb-4504e6b57250" (UID: "3a5a66b1-f17d-48a4-8efb-4504e6b57250"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:25:54.939855 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:54.939842    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a5a66b1-f17d-48a4-8efb-4504e6b57250" (UID: "3a5a66b1-f17d-48a4-8efb-4504e6b57250"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:25:55.038870 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.038817    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-podinfo\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:55.038870 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.038861    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7bsj\" (UniqueName: \"kubernetes.io/projected/3a5a66b1-f17d-48a4-8efb-4504e6b57250-kube-api-access-g7bsj\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:55.038870 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.038872    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-envoy\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:55.038870 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.038881    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:55.038870 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.038888    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a5a66b1-f17d-48a4-8efb-4504e6b57250-istio-data\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:25:55.124420 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.124388    2556 generic.go:356] "Generic (PLEG): container finished" podID="3a5a66b1-f17d-48a4-8efb-4504e6b57250" containerID="b269024ce0f340cf3438595c14f341c4deb2153a1e1be7be44c572995c393fe1" exitCode=0
Jul 09 02:25:55.124613 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.124447    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"
Jul 09 02:25:55.124613 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.124475    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6" event={"ID":"3a5a66b1-f17d-48a4-8efb-4504e6b57250","Type":"ContainerDied","Data":"b269024ce0f340cf3438595c14f341c4deb2153a1e1be7be44c572995c393fe1"}
Jul 09 02:25:55.124613 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.124533    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6" event={"ID":"3a5a66b1-f17d-48a4-8efb-4504e6b57250","Type":"ContainerDied","Data":"7fe1d58fdf5d6092710867b652421fe3819d1571bc0bf24697fc7d73de1f629d"}
Jul 09 02:25:55.124613 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.124578    2556 scope.go:117] "RemoveContainer" containerID="b269024ce0f340cf3438595c14f341c4deb2153a1e1be7be44c572995c393fe1"
Jul 09 02:25:55.133770 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.133747    2556 scope.go:117] "RemoveContainer" containerID="b269024ce0f340cf3438595c14f341c4deb2153a1e1be7be44c572995c393fe1"
Jul 09 02:25:55.134029 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:25:55.134008    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b269024ce0f340cf3438595c14f341c4deb2153a1e1be7be44c572995c393fe1\": container with ID starting with b269024ce0f340cf3438595c14f341c4deb2153a1e1be7be44c572995c393fe1 not found: ID does not exist" containerID="b269024ce0f340cf3438595c14f341c4deb2153a1e1be7be44c572995c393fe1"
Jul 09 02:25:55.134098 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.134041    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b269024ce0f340cf3438595c14f341c4deb2153a1e1be7be44c572995c393fe1"} err="failed to get container status \"b269024ce0f340cf3438595c14f341c4deb2153a1e1be7be44c572995c393fe1\": rpc error: code = NotFound desc = could not find container \"b269024ce0f340cf3438595c14f341c4deb2153a1e1be7be44c572995c393fe1\": container with ID starting with b269024ce0f340cf3438595c14f341c4deb2153a1e1be7be44c572995c393fe1 not found: ID does not exist"
Jul 09 02:25:55.145624 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.145580    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"]
Jul 09 02:25:55.149031 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.149011    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a4117432-openshift-default-559cc8458f-jtvj6"]
Jul 09 02:25:55.280416 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:25:55.280317    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a5a66b1-f17d-48a4-8efb-4504e6b57250" path="/var/lib/kubelet/pods/3a5a66b1-f17d-48a4-8efb-4504e6b57250/volumes"
Jul 09 02:26:00.598001 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.597973    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"]
Jul 09 02:26:00.598414 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.598397    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6259fd12-7cc8-4c17-bd05-7e58d0e778a8" containerName="maas-api"
Jul 09 02:26:00.598465 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.598418    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6259fd12-7cc8-4c17-bd05-7e58d0e778a8" containerName="maas-api"
Jul 09 02:26:00.598465 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.598445    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a5a66b1-f17d-48a4-8efb-4504e6b57250" containerName="istio-proxy"
Jul 09 02:26:00.598465 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.598451    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a5a66b1-f17d-48a4-8efb-4504e6b57250" containerName="istio-proxy"
Jul 09 02:26:00.598578 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.598515    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a5a66b1-f17d-48a4-8efb-4504e6b57250" containerName="istio-proxy"
Jul 09 02:26:00.598578 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.598525    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6259fd12-7cc8-4c17-bd05-7e58d0e778a8" containerName="maas-api"
Jul 09 02:26:00.601633 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.601604    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.604045 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.604022    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ceda7ab4-openshift-default-dockercfg-25fbz\""
Jul 09 02:26:00.611874 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.611849    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"]
Jul 09 02:26:00.688980 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.688946    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-workload-socket\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.688980 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.688990    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz98b\" (UniqueName: \"kubernetes.io/projected/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-kube-api-access-pz98b\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.689243 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.689026    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-data\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.689243 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.689105    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-workload-certs\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.689243 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.689140    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-envoy\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.689243 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.689161    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-podinfo\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.689243 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.689212    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-token\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.689243 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.689231    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istiod-ca-cert\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.689585 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.689262    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-credential-socket\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.790487 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.790452    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-data\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.790695 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.790507    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-workload-certs\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.790695 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.790598    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-envoy\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.790695 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.790624    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-podinfo\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.790695 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.790656    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-token\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.790695 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.790677    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istiod-ca-cert\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.790920 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.790895    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-credential-socket\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.790987 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.790956    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-data\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.790987 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.790969    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-workload-socket\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.790987 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.790974    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-workload-certs\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.791153 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.791034    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz98b\" (UniqueName: \"kubernetes.io/projected/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-kube-api-access-pz98b\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.791213 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.791182    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-workload-socket\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.791272 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.791254    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-credential-socket\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.791544 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.791522    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istiod-ca-cert\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.792842 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.792824    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-envoy\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.793127 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.793112    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-podinfo\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.798629 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.798599    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-token\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.798851 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.798830    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz98b\" (UniqueName: \"kubernetes.io/projected/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-kube-api-access-pz98b\") pod \"e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") " pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:00.912863 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:00.912776    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:01.045274 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.045247    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"]
Jul 09 02:26:01.047007 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:26:01.046981    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec4225ae_a3e4_4f4c_ae12_00edd2df466b.slice/crio-a190cebcc78d3040472228703bc7f821d93e01468048a3e03dc0f37c00916506 WatchSource:0}: Error finding container a190cebcc78d3040472228703bc7f821d93e01468048a3e03dc0f37c00916506: Status 404 returned error can't find the container with id a190cebcc78d3040472228703bc7f821d93e01468048a3e03dc0f37c00916506
Jul 09 02:26:01.049537 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.049501    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:26:01.049667 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.049600    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:26:01.049667 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.049653    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:26:01.158648 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.158598    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns" event={"ID":"ec4225ae-a3e4-4f4c-ae12-00edd2df466b","Type":"ContainerStarted","Data":"dda2566f073b44e15e38d5ac993a8a2b1387573e062f475e6db3ea4d539b226f"}
Jul 09 02:26:01.158833 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.158670    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns" event={"ID":"ec4225ae-a3e4-4f4c-ae12-00edd2df466b","Type":"ContainerStarted","Data":"a190cebcc78d3040472228703bc7f821d93e01468048a3e03dc0f37c00916506"}
Jul 09 02:26:01.184644 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.180026    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns" podStartSLOduration=1.18000199 podStartE2EDuration="1.18000199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:26:01.177214144 +0000 UTC m=+1586.459138306" watchObservedRunningTime="2026-07-09 02:26:01.18000199 +0000 UTC m=+1586.461926128"
Jul 09 02:26:01.886082 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.886047    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"]
Jul 09 02:26:01.889131 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.889111    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:01.891633 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.891612    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ceda7ab4-serving-cert\""
Jul 09 02:26:01.900287 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.900260    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"]
Jul 09 02:26:01.901710 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.901684    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7sf6\" (UniqueName: \"kubernetes.io/projected/378521cd-46d8-43bc-9125-22190aa68eb2-kube-api-access-m7sf6\") pod \"maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9\" (UID: \"378521cd-46d8-43bc-9125-22190aa68eb2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:01.901826 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.901749    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/378521cd-46d8-43bc-9125-22190aa68eb2-openshift-service-ca\") pod \"maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9\" (UID: \"378521cd-46d8-43bc-9125-22190aa68eb2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:01.901905 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.901883    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/378521cd-46d8-43bc-9125-22190aa68eb2-maas-api-tls\") pod \"maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9\" (UID: \"378521cd-46d8-43bc-9125-22190aa68eb2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:01.913682 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:01.913645    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:02.002634 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:02.002592    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/378521cd-46d8-43bc-9125-22190aa68eb2-openshift-service-ca\") pod \"maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9\" (UID: \"378521cd-46d8-43bc-9125-22190aa68eb2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:02.002860 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:02.002699    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/378521cd-46d8-43bc-9125-22190aa68eb2-maas-api-tls\") pod \"maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9\" (UID: \"378521cd-46d8-43bc-9125-22190aa68eb2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:02.002860 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:02.002742    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7sf6\" (UniqueName: \"kubernetes.io/projected/378521cd-46d8-43bc-9125-22190aa68eb2-kube-api-access-m7sf6\") pod \"maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9\" (UID: \"378521cd-46d8-43bc-9125-22190aa68eb2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:02.002976 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:26:02.002855    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-serving-cert: secret "maas-api-e2e-derive-ceda7ab4-serving-cert" not found
Jul 09 02:26:02.002976 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:26:02.002930    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/378521cd-46d8-43bc-9125-22190aa68eb2-maas-api-tls podName:378521cd-46d8-43bc-9125-22190aa68eb2 nodeName:}" failed. No retries permitted until 2026-07-09 02:26:02.502908946 +0000 UTC m=+1587.784833066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/378521cd-46d8-43bc-9125-22190aa68eb2-maas-api-tls") pod "maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9" (UID: "378521cd-46d8-43bc-9125-22190aa68eb2") : secret "maas-api-e2e-derive-ceda7ab4-serving-cert" not found
Jul 09 02:26:02.003457 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:02.003433    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/378521cd-46d8-43bc-9125-22190aa68eb2-openshift-service-ca\") pod \"maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9\" (UID: \"378521cd-46d8-43bc-9125-22190aa68eb2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:02.012994 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:02.012966    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7sf6\" (UniqueName: \"kubernetes.io/projected/378521cd-46d8-43bc-9125-22190aa68eb2-kube-api-access-m7sf6\") pod \"maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9\" (UID: \"378521cd-46d8-43bc-9125-22190aa68eb2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:02.507798 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:02.507762    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/378521cd-46d8-43bc-9125-22190aa68eb2-maas-api-tls\") pod \"maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9\" (UID: \"378521cd-46d8-43bc-9125-22190aa68eb2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:02.510170 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:02.510144    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/378521cd-46d8-43bc-9125-22190aa68eb2-maas-api-tls\") pod \"maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9\" (UID: \"378521cd-46d8-43bc-9125-22190aa68eb2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:02.802445 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:02.802352    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:02.919484 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:02.919455    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:02.936421 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:02.936397    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"]
Jul 09 02:26:02.938907 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:26:02.938877    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod378521cd_46d8_43bc_9125_22190aa68eb2.slice/crio-72c3bf8ba1e3bbdbbb3647679ad81107d6d2faea378f057f4a029d015f4219f0 WatchSource:0}: Error finding container 72c3bf8ba1e3bbdbbb3647679ad81107d6d2faea378f057f4a029d015f4219f0: Status 404 returned error can't find the container with id 72c3bf8ba1e3bbdbbb3647679ad81107d6d2faea378f057f4a029d015f4219f0
Jul 09 02:26:03.169448 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:03.169411    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9" event={"ID":"378521cd-46d8-43bc-9125-22190aa68eb2","Type":"ContainerStarted","Data":"72c3bf8ba1e3bbdbbb3647679ad81107d6d2faea378f057f4a029d015f4219f0"}
Jul 09 02:26:03.169746 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:03.169730    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:03.170796 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:03.170773    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:04.176411 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:04.176321    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9" event={"ID":"378521cd-46d8-43bc-9125-22190aa68eb2","Type":"ContainerStarted","Data":"2ee108a5b4ece2e1506636364494aeb17c0c377e100899420707f37f6208183b"}
Jul 09 02:26:04.176411 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:04.176391    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:04.193544 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:04.193498    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9" podStartSLOduration=2.865923762 podStartE2EDuration="3.193482914s" totalImagesPullingTime="327.559152ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:26:04.192295915 +0000 UTC m=+1589.474220052" watchObservedRunningTime="2026-07-09 02:26:04.193482914 +0000 UTC m=+1589.475407049"
Jul 09 02:26:06.321043 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:06.321008    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"]
Jul 09 02:26:06.321456 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:06.321238    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns" podUID="ec4225ae-a3e4-4f4c-ae12-00edd2df466b" containerName="istio-proxy" containerID="cri-o://dda2566f073b44e15e38d5ac993a8a2b1387573e062f475e6db3ea4d539b226f" gracePeriod=30
Jul 09 02:26:06.544205 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:06.544173    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"]
Jul 09 02:26:06.544404 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:06.544383    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9" podUID="378521cd-46d8-43bc-9125-22190aa68eb2" containerName="maas-api" containerID="cri-o://2ee108a5b4ece2e1506636364494aeb17c0c377e100899420707f37f6208183b" gracePeriod=30
Jul 09 02:26:06.791901 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:06.791875    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:06.850683 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:06.850652    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7sf6\" (UniqueName: \"kubernetes.io/projected/378521cd-46d8-43bc-9125-22190aa68eb2-kube-api-access-m7sf6\") pod \"378521cd-46d8-43bc-9125-22190aa68eb2\" (UID: \"378521cd-46d8-43bc-9125-22190aa68eb2\") "
Jul 09 02:26:06.850912 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:06.850692    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/378521cd-46d8-43bc-9125-22190aa68eb2-openshift-service-ca\") pod \"378521cd-46d8-43bc-9125-22190aa68eb2\" (UID: \"378521cd-46d8-43bc-9125-22190aa68eb2\") "
Jul 09 02:26:06.850912 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:06.850733    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/378521cd-46d8-43bc-9125-22190aa68eb2-maas-api-tls\") pod \"378521cd-46d8-43bc-9125-22190aa68eb2\" (UID: \"378521cd-46d8-43bc-9125-22190aa68eb2\") "
Jul 09 02:26:06.851153 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:06.851122    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/378521cd-46d8-43bc-9125-22190aa68eb2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "378521cd-46d8-43bc-9125-22190aa68eb2" (UID: "378521cd-46d8-43bc-9125-22190aa68eb2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:26:06.852856 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:06.852829    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/378521cd-46d8-43bc-9125-22190aa68eb2-kube-api-access-m7sf6" (OuterVolumeSpecName: "kube-api-access-m7sf6") pod "378521cd-46d8-43bc-9125-22190aa68eb2" (UID: "378521cd-46d8-43bc-9125-22190aa68eb2"). InnerVolumeSpecName "kube-api-access-m7sf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:26:06.852978 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:06.852879    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/378521cd-46d8-43bc-9125-22190aa68eb2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "378521cd-46d8-43bc-9125-22190aa68eb2" (UID: "378521cd-46d8-43bc-9125-22190aa68eb2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:26:06.952608 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:06.952503    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7sf6\" (UniqueName: \"kubernetes.io/projected/378521cd-46d8-43bc-9125-22190aa68eb2-kube-api-access-m7sf6\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:26:06.952608 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:06.952532    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/378521cd-46d8-43bc-9125-22190aa68eb2-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:26:06.952608 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:06.952542    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/378521cd-46d8-43bc-9125-22190aa68eb2-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:26:07.192854 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:07.192819    2556 generic.go:356] "Generic (PLEG): container finished" podID="378521cd-46d8-43bc-9125-22190aa68eb2" containerID="2ee108a5b4ece2e1506636364494aeb17c0c377e100899420707f37f6208183b" exitCode=0
Jul 09 02:26:07.193053 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:07.192861    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"
Jul 09 02:26:07.193053 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:07.192893    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9" event={"ID":"378521cd-46d8-43bc-9125-22190aa68eb2","Type":"ContainerDied","Data":"2ee108a5b4ece2e1506636364494aeb17c0c377e100899420707f37f6208183b"}
Jul 09 02:26:07.193053 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:07.192944    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9" event={"ID":"378521cd-46d8-43bc-9125-22190aa68eb2","Type":"ContainerDied","Data":"72c3bf8ba1e3bbdbbb3647679ad81107d6d2faea378f057f4a029d015f4219f0"}
Jul 09 02:26:07.193053 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:07.192972    2556 scope.go:117] "RemoveContainer" containerID="2ee108a5b4ece2e1506636364494aeb17c0c377e100899420707f37f6208183b"
Jul 09 02:26:07.202537 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:07.202519    2556 scope.go:117] "RemoveContainer" containerID="2ee108a5b4ece2e1506636364494aeb17c0c377e100899420707f37f6208183b"
Jul 09 02:26:07.202850 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:26:07.202797    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ee108a5b4ece2e1506636364494aeb17c0c377e100899420707f37f6208183b\": container with ID starting with 2ee108a5b4ece2e1506636364494aeb17c0c377e100899420707f37f6208183b not found: ID does not exist" containerID="2ee108a5b4ece2e1506636364494aeb17c0c377e100899420707f37f6208183b"
Jul 09 02:26:07.202850 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:07.202827    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ee108a5b4ece2e1506636364494aeb17c0c377e100899420707f37f6208183b"} err="failed to get container status \"2ee108a5b4ece2e1506636364494aeb17c0c377e100899420707f37f6208183b\": rpc error: code = NotFound desc = could not find container \"2ee108a5b4ece2e1506636364494aeb17c0c377e100899420707f37f6208183b\": container with ID starting with 2ee108a5b4ece2e1506636364494aeb17c0c377e100899420707f37f6208183b not found: ID does not exist"
Jul 09 02:26:07.218901 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:07.218876    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"]
Jul 09 02:26:07.223546 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:07.223520    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ceda7ab4-59d57f49bd-djld9"]
Jul 09 02:26:07.275099 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:07.275066    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="378521cd-46d8-43bc-9125-22190aa68eb2" path="/var/lib/kubelet/pods/378521cd-46d8-43bc-9125-22190aa68eb2/volumes"
Jul 09 02:26:11.571524 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.571501    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:11.594419 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.594388    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz98b\" (UniqueName: \"kubernetes.io/projected/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-kube-api-access-pz98b\") pod \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") "
Jul 09 02:26:11.594552 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.594424    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-token\") pod \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") "
Jul 09 02:26:11.594552 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.594457    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-credential-socket\") pod \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") "
Jul 09 02:26:11.594643 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.594603    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istiod-ca-cert\") pod \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") "
Jul 09 02:26:11.594780 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.594753    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec4225ae-a3e4-4f4c-ae12-00edd2df466b" (UID: "ec4225ae-a3e4-4f4c-ae12-00edd2df466b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:26:11.594780 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.594767    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-workload-socket\") pod \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") "
Jul 09 02:26:11.594983 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.594937    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec4225ae-a3e4-4f4c-ae12-00edd2df466b" (UID: "ec4225ae-a3e4-4f4c-ae12-00edd2df466b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:26:11.594983 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.594948    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec4225ae-a3e4-4f4c-ae12-00edd2df466b" (UID: "ec4225ae-a3e4-4f4c-ae12-00edd2df466b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:26:11.595185 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.595164    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-workload-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:26:11.595257 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.595189    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-credential-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:26:11.595257 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.595199    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istiod-ca-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:26:11.596515 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.596493    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-kube-api-access-pz98b" (OuterVolumeSpecName: "kube-api-access-pz98b") pod "ec4225ae-a3e4-4f4c-ae12-00edd2df466b" (UID: "ec4225ae-a3e4-4f4c-ae12-00edd2df466b"). InnerVolumeSpecName "kube-api-access-pz98b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:26:11.596515 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.596509    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec4225ae-a3e4-4f4c-ae12-00edd2df466b" (UID: "ec4225ae-a3e4-4f4c-ae12-00edd2df466b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:26:11.696325 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.696298    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-data\") pod \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") "
Jul 09 02:26:11.696517 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.696355    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-workload-certs\") pod \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") "
Jul 09 02:26:11.696517 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.696377    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-envoy\") pod \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") "
Jul 09 02:26:11.696517 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.696430    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-podinfo\") pod \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\" (UID: \"ec4225ae-a3e4-4f4c-ae12-00edd2df466b\") "
Jul 09 02:26:11.696710 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.696586    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec4225ae-a3e4-4f4c-ae12-00edd2df466b" (UID: "ec4225ae-a3e4-4f4c-ae12-00edd2df466b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:26:11.696710 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.696652    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec4225ae-a3e4-4f4c-ae12-00edd2df466b" (UID: "ec4225ae-a3e4-4f4c-ae12-00edd2df466b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:26:11.696710 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.696695    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-data\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:26:11.696819 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.696713    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz98b\" (UniqueName: \"kubernetes.io/projected/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-kube-api-access-pz98b\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:26:11.696819 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.696728    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:26:11.698481 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.698450    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec4225ae-a3e4-4f4c-ae12-00edd2df466b" (UID: "ec4225ae-a3e4-4f4c-ae12-00edd2df466b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 02:26:11.698606 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.698532    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec4225ae-a3e4-4f4c-ae12-00edd2df466b" (UID: "ec4225ae-a3e4-4f4c-ae12-00edd2df466b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:26:11.797835 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.797804    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-podinfo\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:26:11.797835 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.797831    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-workload-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:26:11.797835 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:11.797840    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec4225ae-a3e4-4f4c-ae12-00edd2df466b-istio-envoy\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:26:12.220482 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:12.220446    2556 generic.go:356] "Generic (PLEG): container finished" podID="ec4225ae-a3e4-4f4c-ae12-00edd2df466b" containerID="dda2566f073b44e15e38d5ac993a8a2b1387573e062f475e6db3ea4d539b226f" exitCode=0
Jul 09 02:26:12.220676 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:12.220488    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"
Jul 09 02:26:12.220676 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:12.220516    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns" event={"ID":"ec4225ae-a3e4-4f4c-ae12-00edd2df466b","Type":"ContainerDied","Data":"dda2566f073b44e15e38d5ac993a8a2b1387573e062f475e6db3ea4d539b226f"}
Jul 09 02:26:12.220676 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:12.220574    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns" event={"ID":"ec4225ae-a3e4-4f4c-ae12-00edd2df466b","Type":"ContainerDied","Data":"a190cebcc78d3040472228703bc7f821d93e01468048a3e03dc0f37c00916506"}
Jul 09 02:26:12.220676 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:12.220623    2556 scope.go:117] "RemoveContainer" containerID="dda2566f073b44e15e38d5ac993a8a2b1387573e062f475e6db3ea4d539b226f"
Jul 09 02:26:12.229808 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:12.229786    2556 scope.go:117] "RemoveContainer" containerID="dda2566f073b44e15e38d5ac993a8a2b1387573e062f475e6db3ea4d539b226f"
Jul 09 02:26:12.230048 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:26:12.230030    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dda2566f073b44e15e38d5ac993a8a2b1387573e062f475e6db3ea4d539b226f\": container with ID starting with dda2566f073b44e15e38d5ac993a8a2b1387573e062f475e6db3ea4d539b226f not found: ID does not exist" containerID="dda2566f073b44e15e38d5ac993a8a2b1387573e062f475e6db3ea4d539b226f"
Jul 09 02:26:12.230109 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:12.230056    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dda2566f073b44e15e38d5ac993a8a2b1387573e062f475e6db3ea4d539b226f"} err="failed to get container status \"dda2566f073b44e15e38d5ac993a8a2b1387573e062f475e6db3ea4d539b226f\": rpc error: code = NotFound desc = could not find container \"dda2566f073b44e15e38d5ac993a8a2b1387573e062f475e6db3ea4d539b226f\": container with ID starting with dda2566f073b44e15e38d5ac993a8a2b1387573e062f475e6db3ea4d539b226f not found: ID does not exist"
Jul 09 02:26:12.240784 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:12.240761    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"]
Jul 09 02:26:12.246661 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:12.246639    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ceda7ab4-openshift-default-7b54898567-dm5ns"]
Jul 09 02:26:13.274747 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:26:13.274714    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec4225ae-a3e4-4f4c-ae12-00edd2df466b" path="/var/lib/kubelet/pods/ec4225ae-a3e4-4f4c-ae12-00edd2df466b/volumes"
Jul 09 02:27:48.779328 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.779296    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"]
Jul 09 02:27:48.779931 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.779909    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="378521cd-46d8-43bc-9125-22190aa68eb2" containerName="maas-api"
Jul 09 02:27:48.779931 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.779929    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="378521cd-46d8-43bc-9125-22190aa68eb2" containerName="maas-api"
Jul 09 02:27:48.780058 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.779942    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec4225ae-a3e4-4f4c-ae12-00edd2df466b" containerName="istio-proxy"
Jul 09 02:27:48.780058 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.779950    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec4225ae-a3e4-4f4c-ae12-00edd2df466b" containerName="istio-proxy"
Jul 09 02:27:48.780162 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.780088    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="378521cd-46d8-43bc-9125-22190aa68eb2" containerName="maas-api"
Jul 09 02:27:48.780162 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.780101    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec4225ae-a3e4-4f4c-ae12-00edd2df466b" containerName="istio-proxy"
Jul 09 02:27:48.783090 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.783068    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:48.785795 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.785778    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-44fb823d-openshift-default-dockercfg-s6bfw\""
Jul 09 02:27:48.800853 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.800828    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"]
Jul 09 02:27:48.905636 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.905602    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvgnh\" (UniqueName: \"kubernetes.io/projected/65194813-088a-49fd-b473-eb854d78e97b-kube-api-access-tvgnh\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:48.905816 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.905640    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65194813-088a-49fd-b473-eb854d78e97b-istio-token\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:48.905816 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.905663    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65194813-088a-49fd-b473-eb854d78e97b-istiod-ca-cert\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:48.905816 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.905715    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-workload-socket\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:48.905816 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.905765    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65194813-088a-49fd-b473-eb854d78e97b-istio-podinfo\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:48.905955 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.905822    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-istio-envoy\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:48.905955 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.905871    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-istio-data\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:48.905955 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.905911    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-workload-certs\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:48.905955 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:48.905950    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-credential-socket\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.006992 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.006956    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvgnh\" (UniqueName: \"kubernetes.io/projected/65194813-088a-49fd-b473-eb854d78e97b-kube-api-access-tvgnh\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.006992 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.006997    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65194813-088a-49fd-b473-eb854d78e97b-istio-token\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.007323 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.007016    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65194813-088a-49fd-b473-eb854d78e97b-istiod-ca-cert\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.007323 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.007127    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-workload-socket\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.007323 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.007178    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65194813-088a-49fd-b473-eb854d78e97b-istio-podinfo\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.007503 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.007347    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-istio-envoy\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.007503 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.007388    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-istio-data\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.007503 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.007414    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-workload-certs\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.007503 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.007464    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-credential-socket\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.007754 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.007623    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-workload-socket\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.007847 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.007823    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-istio-data\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.007897 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.007841    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-workload-certs\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.007897 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.007852    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-credential-socket\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.008002 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.007912    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65194813-088a-49fd-b473-eb854d78e97b-istiod-ca-cert\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.009793 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.009764    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-istio-envoy\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.010125 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.010108    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65194813-088a-49fd-b473-eb854d78e97b-istio-podinfo\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.015001 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.014974    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65194813-088a-49fd-b473-eb854d78e97b-istio-token\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.015001 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.014985    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvgnh\" (UniqueName: \"kubernetes.io/projected/65194813-088a-49fd-b473-eb854d78e97b-kube-api-access-tvgnh\") pod \"e2e-mt-44fb823d-openshift-default-576db79995-wbmrp\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") " pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.093470 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.093439    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:49.241064 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.241038    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"]
Jul 09 02:27:49.243370 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:27:49.243330    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65194813_088a_49fd_b473_eb854d78e97b.slice/crio-bf104cb6676a6ce6ad3aac391fabf0041ec4f771a263011a2128ba38f339c5cc WatchSource:0}: Error finding container bf104cb6676a6ce6ad3aac391fabf0041ec4f771a263011a2128ba38f339c5cc: Status 404 returned error can't find the container with id bf104cb6676a6ce6ad3aac391fabf0041ec4f771a263011a2128ba38f339c5cc
Jul 09 02:27:49.247422 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.247342    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:27:49.247551 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.247532    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:27:49.247679 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.247656    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:27:49.701766 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.701732    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp" event={"ID":"65194813-088a-49fd-b473-eb854d78e97b","Type":"ContainerStarted","Data":"acee76a2f822bbdf8dc84d7ccdad5bdcfb6eaf960db6f223bc137def303f09a4"}
Jul 09 02:27:49.701986 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.701787    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp" event={"ID":"65194813-088a-49fd-b473-eb854d78e97b","Type":"ContainerStarted","Data":"bf104cb6676a6ce6ad3aac391fabf0041ec4f771a263011a2128ba38f339c5cc"}
Jul 09 02:27:49.720684 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:49.720633    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp" podStartSLOduration=1.720615848 podStartE2EDuration="1.720615848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:27:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:27:49.7189756 +0000 UTC m=+1695.000899736" watchObservedRunningTime="2026-07-09 02:27:49.720615848 +0000 UTC m=+1695.002539986"
Jul 09 02:27:50.093630 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:50.093598    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:50.099093 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:50.099066    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:50.707192 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:50.707161    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:50.708080 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:50.708058    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:27:51.798132 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:51.798095    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"]
Jul 09 02:27:51.802761 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:51.802740    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:27:51.805206 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:51.805187    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-44fb823d-serving-cert\""
Jul 09 02:27:51.812805 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:51.812779    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"]
Jul 09 02:27:51.937109 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:51.937077    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkj9l\" (UniqueName: \"kubernetes.io/projected/ad02faa2-b699-4947-aa50-3b2287d5a0bb-kube-api-access-xkj9l\") pod \"maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp\" (UID: \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:27:51.937109 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:51.937114    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad02faa2-b699-4947-aa50-3b2287d5a0bb-maas-api-tls\") pod \"maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp\" (UID: \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:27:51.937329 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:51.937215    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad02faa2-b699-4947-aa50-3b2287d5a0bb-openshift-service-ca\") pod \"maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp\" (UID: \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:27:52.038044 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:52.037996    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad02faa2-b699-4947-aa50-3b2287d5a0bb-openshift-service-ca\") pod \"maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp\" (UID: \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:27:52.038211 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:52.038082    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkj9l\" (UniqueName: \"kubernetes.io/projected/ad02faa2-b699-4947-aa50-3b2287d5a0bb-kube-api-access-xkj9l\") pod \"maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp\" (UID: \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:27:52.038211 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:52.038114    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad02faa2-b699-4947-aa50-3b2287d5a0bb-maas-api-tls\") pod \"maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp\" (UID: \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:27:52.038829 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:52.038811    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad02faa2-b699-4947-aa50-3b2287d5a0bb-openshift-service-ca\") pod \"maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp\" (UID: \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:27:52.040516 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:52.040497    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad02faa2-b699-4947-aa50-3b2287d5a0bb-maas-api-tls\") pod \"maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp\" (UID: \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:27:52.046082 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:52.046055    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkj9l\" (UniqueName: \"kubernetes.io/projected/ad02faa2-b699-4947-aa50-3b2287d5a0bb-kube-api-access-xkj9l\") pod \"maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp\" (UID: \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:27:52.117404 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:52.117364    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:27:52.253960 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:52.253933    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"]
Jul 09 02:27:52.256075 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:27:52.256045    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad02faa2_b699_4947_aa50_3b2287d5a0bb.slice/crio-f0bffd56253f37d01842b4b87c398b9c3ff44c7b3c2607cb5bb3fa1514003453 WatchSource:0}: Error finding container f0bffd56253f37d01842b4b87c398b9c3ff44c7b3c2607cb5bb3fa1514003453: Status 404 returned error can't find the container with id f0bffd56253f37d01842b4b87c398b9c3ff44c7b3c2607cb5bb3fa1514003453
Jul 09 02:27:52.718132 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:52.718094    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp" event={"ID":"ad02faa2-b699-4947-aa50-3b2287d5a0bb","Type":"ContainerStarted","Data":"f0bffd56253f37d01842b4b87c398b9c3ff44c7b3c2607cb5bb3fa1514003453"}
Jul 09 02:27:53.724227 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:53.724171    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp" event={"ID":"ad02faa2-b699-4947-aa50-3b2287d5a0bb","Type":"ContainerStarted","Data":"8ca1290da6575981e34fad8fc261d471e9cac7de10dcd078bca6dea65216a519"}
Jul 09 02:27:53.724727 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:53.724263    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:27:53.741796 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:53.741753    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp" podStartSLOduration=2.21853856 podStartE2EDuration="2.741738604s" totalImagesPullingTime="523.200044ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:27:53.739401242 +0000 UTC m=+1699.021325381" watchObservedRunningTime="2026-07-09 02:27:53.741738604 +0000 UTC m=+1699.023662773"
Jul 09 02:27:59.740937 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:27:59.740890    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:28:03.743594 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:03.743544    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"]
Jul 09 02:28:03.744331 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:03.744298    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp" podUID="ad02faa2-b699-4947-aa50-3b2287d5a0bb" containerName="maas-api" containerID="cri-o://8ca1290da6575981e34fad8fc261d471e9cac7de10dcd078bca6dea65216a519" gracePeriod=30
Jul 09 02:28:04.001316 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.001248    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:28:04.074204 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.074170    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad02faa2-b699-4947-aa50-3b2287d5a0bb-openshift-service-ca\") pod \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\" (UID: \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\") "
Jul 09 02:28:04.074399 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.074286    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad02faa2-b699-4947-aa50-3b2287d5a0bb-maas-api-tls\") pod \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\" (UID: \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\") "
Jul 09 02:28:04.074399 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.074337    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkj9l\" (UniqueName: \"kubernetes.io/projected/ad02faa2-b699-4947-aa50-3b2287d5a0bb-kube-api-access-xkj9l\") pod \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\" (UID: \"ad02faa2-b699-4947-aa50-3b2287d5a0bb\") "
Jul 09 02:28:04.074549 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.074520    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad02faa2-b699-4947-aa50-3b2287d5a0bb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad02faa2-b699-4947-aa50-3b2287d5a0bb" (UID: "ad02faa2-b699-4947-aa50-3b2287d5a0bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:28:04.074707 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.074686    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad02faa2-b699-4947-aa50-3b2287d5a0bb-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:28:04.076430 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.076407    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad02faa2-b699-4947-aa50-3b2287d5a0bb-kube-api-access-xkj9l" (OuterVolumeSpecName: "kube-api-access-xkj9l") pod "ad02faa2-b699-4947-aa50-3b2287d5a0bb" (UID: "ad02faa2-b699-4947-aa50-3b2287d5a0bb"). InnerVolumeSpecName "kube-api-access-xkj9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:28:04.076528 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.076485    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad02faa2-b699-4947-aa50-3b2287d5a0bb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad02faa2-b699-4947-aa50-3b2287d5a0bb" (UID: "ad02faa2-b699-4947-aa50-3b2287d5a0bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:28:04.175436 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.175388    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkj9l\" (UniqueName: \"kubernetes.io/projected/ad02faa2-b699-4947-aa50-3b2287d5a0bb-kube-api-access-xkj9l\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:28:04.175436 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.175432    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad02faa2-b699-4947-aa50-3b2287d5a0bb-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:28:04.782003 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.781973    2556 generic.go:356] "Generic (PLEG): container finished" podID="ad02faa2-b699-4947-aa50-3b2287d5a0bb" containerID="8ca1290da6575981e34fad8fc261d471e9cac7de10dcd078bca6dea65216a519" exitCode=0
Jul 09 02:28:04.783421 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.782025    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"
Jul 09 02:28:04.783421 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.782024    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp" event={"ID":"ad02faa2-b699-4947-aa50-3b2287d5a0bb","Type":"ContainerDied","Data":"8ca1290da6575981e34fad8fc261d471e9cac7de10dcd078bca6dea65216a519"}
Jul 09 02:28:04.783421 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.782085    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp" event={"ID":"ad02faa2-b699-4947-aa50-3b2287d5a0bb","Type":"ContainerDied","Data":"f0bffd56253f37d01842b4b87c398b9c3ff44c7b3c2607cb5bb3fa1514003453"}
Jul 09 02:28:04.783421 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.782116    2556 scope.go:117] "RemoveContainer" containerID="8ca1290da6575981e34fad8fc261d471e9cac7de10dcd078bca6dea65216a519"
Jul 09 02:28:04.792546 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.792531    2556 scope.go:117] "RemoveContainer" containerID="8ca1290da6575981e34fad8fc261d471e9cac7de10dcd078bca6dea65216a519"
Jul 09 02:28:04.792925 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:28:04.792906    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ca1290da6575981e34fad8fc261d471e9cac7de10dcd078bca6dea65216a519\": container with ID starting with 8ca1290da6575981e34fad8fc261d471e9cac7de10dcd078bca6dea65216a519 not found: ID does not exist" containerID="8ca1290da6575981e34fad8fc261d471e9cac7de10dcd078bca6dea65216a519"
Jul 09 02:28:04.792983 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.792935    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ca1290da6575981e34fad8fc261d471e9cac7de10dcd078bca6dea65216a519"} err="failed to get container status \"8ca1290da6575981e34fad8fc261d471e9cac7de10dcd078bca6dea65216a519\": rpc error: code = NotFound desc = could not find container \"8ca1290da6575981e34fad8fc261d471e9cac7de10dcd078bca6dea65216a519\": container with ID starting with 8ca1290da6575981e34fad8fc261d471e9cac7de10dcd078bca6dea65216a519 not found: ID does not exist"
Jul 09 02:28:04.806377 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.806352    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"]
Jul 09 02:28:04.808452 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:04.808428    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44fb823d-6b777b97d6-6spbp"]
Jul 09 02:28:05.274640 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:05.274607    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad02faa2-b699-4947-aa50-3b2287d5a0bb" path="/var/lib/kubelet/pods/ad02faa2-b699-4947-aa50-3b2287d5a0bb/volumes"
Jul 09 02:28:05.708755 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:05.708716    2556 patch_prober.go:28] interesting pod/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 09 02:28:05.708935 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:05.708780    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp" podUID="65194813-088a-49fd-b473-eb854d78e97b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 09 02:28:05.788920 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:05.788884    2556 generic.go:356] "Generic (PLEG): container finished" podID="65194813-088a-49fd-b473-eb854d78e97b" containerID="acee76a2f822bbdf8dc84d7ccdad5bdcfb6eaf960db6f223bc137def303f09a4" exitCode=0
Jul 09 02:28:05.789353 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:05.788958    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp" event={"ID":"65194813-088a-49fd-b473-eb854d78e97b","Type":"ContainerDied","Data":"acee76a2f822bbdf8dc84d7ccdad5bdcfb6eaf960db6f223bc137def303f09a4"}
Jul 09 02:28:05.789465 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:05.789444    2556 scope.go:117] "RemoveContainer" containerID="acee76a2f822bbdf8dc84d7ccdad5bdcfb6eaf960db6f223bc137def303f09a4"
Jul 09 02:28:05.790594 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:05.790546    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:28:05.790691 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:05.790637    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:28:05.790691 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:05.790671    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:28:06.799602 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:06.798590    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp" event={"ID":"65194813-088a-49fd-b473-eb854d78e97b","Type":"ContainerStarted","Data":"db1d4b54b00172c21b2deca9dc2e2ac936e85c98434705f454557982c5759598"}
Jul 09 02:28:07.093840 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:07.093810    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:28:07.094082 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:07.094058    2556 patch_prober.go:28] interesting pod/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 09 02:28:07.094132 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:07.094108    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp" podUID="65194813-088a-49fd-b473-eb854d78e97b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 09 02:28:08.094064 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:08.094028    2556 patch_prober.go:28] interesting pod/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 09 02:28:08.094461 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:08.094085    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp" podUID="65194813-088a-49fd-b473-eb854d78e97b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 09 02:28:09.094625 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:09.094591    2556 patch_prober.go:28] interesting pod/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 09 02:28:09.095017 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:09.094649    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp" podUID="65194813-088a-49fd-b473-eb854d78e97b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 09 02:28:10.094168 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:10.094129    2556 patch_prober.go:28] interesting pod/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 09 02:28:10.094393 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:10.094193    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp" podUID="65194813-088a-49fd-b473-eb854d78e97b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 09 02:28:10.193539 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:10.193503    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"]
Jul 09 02:28:10.194008 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:10.193699    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp" podUID="65194813-088a-49fd-b473-eb854d78e97b" containerName="istio-proxy" containerID="cri-o://db1d4b54b00172c21b2deca9dc2e2ac936e85c98434705f454557982c5759598" gracePeriod=30
Jul 09 02:28:16.242647 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.242624    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:28:16.302700 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.302616    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65194813-088a-49fd-b473-eb854d78e97b-istio-token\") pod \"65194813-088a-49fd-b473-eb854d78e97b\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") "
Jul 09 02:28:16.302700 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.302675    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-istio-data\") pod \"65194813-088a-49fd-b473-eb854d78e97b\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") "
Jul 09 02:28:16.302926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.302701    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65194813-088a-49fd-b473-eb854d78e97b-istiod-ca-cert\") pod \"65194813-088a-49fd-b473-eb854d78e97b\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") "
Jul 09 02:28:16.302926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.302743    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65194813-088a-49fd-b473-eb854d78e97b-istio-podinfo\") pod \"65194813-088a-49fd-b473-eb854d78e97b\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") "
Jul 09 02:28:16.302926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.302774    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-workload-socket\") pod \"65194813-088a-49fd-b473-eb854d78e97b\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") "
Jul 09 02:28:16.302926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.302802    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-istio-envoy\") pod \"65194813-088a-49fd-b473-eb854d78e97b\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") "
Jul 09 02:28:16.302926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.302854    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-workload-certs\") pod \"65194813-088a-49fd-b473-eb854d78e97b\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") "
Jul 09 02:28:16.302926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.302898    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-credential-socket\") pod \"65194813-088a-49fd-b473-eb854d78e97b\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") "
Jul 09 02:28:16.303228 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.302929    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvgnh\" (UniqueName: \"kubernetes.io/projected/65194813-088a-49fd-b473-eb854d78e97b-kube-api-access-tvgnh\") pod \"65194813-088a-49fd-b473-eb854d78e97b\" (UID: \"65194813-088a-49fd-b473-eb854d78e97b\") "
Jul 09 02:28:16.303228 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.303049    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65194813-088a-49fd-b473-eb854d78e97b" (UID: "65194813-088a-49fd-b473-eb854d78e97b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:28:16.303228 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.303133    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65194813-088a-49fd-b473-eb854d78e97b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65194813-088a-49fd-b473-eb854d78e97b" (UID: "65194813-088a-49fd-b473-eb854d78e97b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:28:16.303474 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.303313    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65194813-088a-49fd-b473-eb854d78e97b-istiod-ca-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:28:16.303474 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.303333    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-workload-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:28:16.303474 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.303368    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65194813-088a-49fd-b473-eb854d78e97b" (UID: "65194813-088a-49fd-b473-eb854d78e97b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:28:16.303474 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.303384    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65194813-088a-49fd-b473-eb854d78e97b" (UID: "65194813-088a-49fd-b473-eb854d78e97b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:28:16.303728 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.303678    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-istio-data" (OuterVolumeSpecName: "istio-data") pod "65194813-088a-49fd-b473-eb854d78e97b" (UID: "65194813-088a-49fd-b473-eb854d78e97b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:28:16.304811 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.304788    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65194813-088a-49fd-b473-eb854d78e97b-istio-token" (OuterVolumeSpecName: "istio-token") pod "65194813-088a-49fd-b473-eb854d78e97b" (UID: "65194813-088a-49fd-b473-eb854d78e97b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:28:16.304990 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.304975    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65194813-088a-49fd-b473-eb854d78e97b-kube-api-access-tvgnh" (OuterVolumeSpecName: "kube-api-access-tvgnh") pod "65194813-088a-49fd-b473-eb854d78e97b" (UID: "65194813-088a-49fd-b473-eb854d78e97b"). InnerVolumeSpecName "kube-api-access-tvgnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:28:16.305245 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.305228    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65194813-088a-49fd-b473-eb854d78e97b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65194813-088a-49fd-b473-eb854d78e97b" (UID: "65194813-088a-49fd-b473-eb854d78e97b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 02:28:16.305293 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.305252    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65194813-088a-49fd-b473-eb854d78e97b" (UID: "65194813-088a-49fd-b473-eb854d78e97b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:28:16.404552 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.404478    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-credential-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:28:16.404552 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.404521    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvgnh\" (UniqueName: \"kubernetes.io/projected/65194813-088a-49fd-b473-eb854d78e97b-kube-api-access-tvgnh\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:28:16.404552 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.404535    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65194813-088a-49fd-b473-eb854d78e97b-istio-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:28:16.404552 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.404547    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-istio-data\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:28:16.404552 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.404580    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65194813-088a-49fd-b473-eb854d78e97b-istio-podinfo\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:28:16.404552 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.404593    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-istio-envoy\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:28:16.404907 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.404604    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65194813-088a-49fd-b473-eb854d78e97b-workload-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:28:16.852900 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.852864    2556 generic.go:356] "Generic (PLEG): container finished" podID="65194813-088a-49fd-b473-eb854d78e97b" containerID="db1d4b54b00172c21b2deca9dc2e2ac936e85c98434705f454557982c5759598" exitCode=0
Jul 09 02:28:16.853096 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.852909    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp" event={"ID":"65194813-088a-49fd-b473-eb854d78e97b","Type":"ContainerDied","Data":"db1d4b54b00172c21b2deca9dc2e2ac936e85c98434705f454557982c5759598"}
Jul 09 02:28:16.853096 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.852924    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"
Jul 09 02:28:16.853096 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.852985    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp" event={"ID":"65194813-088a-49fd-b473-eb854d78e97b","Type":"ContainerDied","Data":"bf104cb6676a6ce6ad3aac391fabf0041ec4f771a263011a2128ba38f339c5cc"}
Jul 09 02:28:16.853096 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.853027    2556 scope.go:117] "RemoveContainer" containerID="db1d4b54b00172c21b2deca9dc2e2ac936e85c98434705f454557982c5759598"
Jul 09 02:28:16.863733 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.863715    2556 scope.go:117] "RemoveContainer" containerID="acee76a2f822bbdf8dc84d7ccdad5bdcfb6eaf960db6f223bc137def303f09a4"
Jul 09 02:28:16.871866 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.871846    2556 scope.go:117] "RemoveContainer" containerID="db1d4b54b00172c21b2deca9dc2e2ac936e85c98434705f454557982c5759598"
Jul 09 02:28:16.872125 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:28:16.872101    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db1d4b54b00172c21b2deca9dc2e2ac936e85c98434705f454557982c5759598\": container with ID starting with db1d4b54b00172c21b2deca9dc2e2ac936e85c98434705f454557982c5759598 not found: ID does not exist" containerID="db1d4b54b00172c21b2deca9dc2e2ac936e85c98434705f454557982c5759598"
Jul 09 02:28:16.872217 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.872132    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db1d4b54b00172c21b2deca9dc2e2ac936e85c98434705f454557982c5759598"} err="failed to get container status \"db1d4b54b00172c21b2deca9dc2e2ac936e85c98434705f454557982c5759598\": rpc error: code = NotFound desc = could not find container \"db1d4b54b00172c21b2deca9dc2e2ac936e85c98434705f454557982c5759598\": container with ID starting with db1d4b54b00172c21b2deca9dc2e2ac936e85c98434705f454557982c5759598 not found: ID does not exist"
Jul 09 02:28:16.872217 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.872150    2556 scope.go:117] "RemoveContainer" containerID="acee76a2f822bbdf8dc84d7ccdad5bdcfb6eaf960db6f223bc137def303f09a4"
Jul 09 02:28:16.872402 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:28:16.872384    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acee76a2f822bbdf8dc84d7ccdad5bdcfb6eaf960db6f223bc137def303f09a4\": container with ID starting with acee76a2f822bbdf8dc84d7ccdad5bdcfb6eaf960db6f223bc137def303f09a4 not found: ID does not exist" containerID="acee76a2f822bbdf8dc84d7ccdad5bdcfb6eaf960db6f223bc137def303f09a4"
Jul 09 02:28:16.872445 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.872408    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acee76a2f822bbdf8dc84d7ccdad5bdcfb6eaf960db6f223bc137def303f09a4"} err="failed to get container status \"acee76a2f822bbdf8dc84d7ccdad5bdcfb6eaf960db6f223bc137def303f09a4\": rpc error: code = NotFound desc = could not find container \"acee76a2f822bbdf8dc84d7ccdad5bdcfb6eaf960db6f223bc137def303f09a4\": container with ID starting with acee76a2f822bbdf8dc84d7ccdad5bdcfb6eaf960db6f223bc137def303f09a4 not found: ID does not exist"
Jul 09 02:28:16.876464 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.876442    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"]
Jul 09 02:28:16.880340 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:16.880317    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-44fb823d-openshift-default-576db79995-wbmrp"]
Jul 09 02:28:17.274424 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:17.274344    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65194813-088a-49fd-b473-eb854d78e97b" path="/var/lib/kubelet/pods/65194813-088a-49fd-b473-eb854d78e97b/volumes"
Jul 09 02:28:30.077673 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.077640    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"]
Jul 09 02:28:30.078271 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.078242    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad02faa2-b699-4947-aa50-3b2287d5a0bb" containerName="maas-api"
Jul 09 02:28:30.078271 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.078260    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad02faa2-b699-4947-aa50-3b2287d5a0bb" containerName="maas-api"
Jul 09 02:28:30.078413 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.078300    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65194813-088a-49fd-b473-eb854d78e97b" containerName="istio-proxy"
Jul 09 02:28:30.078413 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.078309    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="65194813-088a-49fd-b473-eb854d78e97b" containerName="istio-proxy"
Jul 09 02:28:30.078413 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.078325    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65194813-088a-49fd-b473-eb854d78e97b" containerName="istio-proxy"
Jul 09 02:28:30.078413 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.078334    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="65194813-088a-49fd-b473-eb854d78e97b" containerName="istio-proxy"
Jul 09 02:28:30.078646 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.078426    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="65194813-088a-49fd-b473-eb854d78e97b" containerName="istio-proxy"
Jul 09 02:28:30.078646 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.078440    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad02faa2-b699-4947-aa50-3b2287d5a0bb" containerName="maas-api"
Jul 09 02:28:30.078646 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.078450    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="65194813-088a-49fd-b473-eb854d78e97b" containerName="istio-proxy"
Jul 09 02:28:30.081765 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.081744    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.084259 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.084235    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7d9bdee4-openshift-default-dockercfg-chcf8\""
Jul 09 02:28:30.094938 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.094833    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"]
Jul 09 02:28:30.235593 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.235540    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-data\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.235794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.235599    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hljls\" (UniqueName: \"kubernetes.io/projected/70cb664a-2b4c-4b8c-801f-612cd784a54c-kube-api-access-hljls\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.235794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.235688    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-workload-socket\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.235794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.235734    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-token\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.235794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.235785    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-podinfo\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.236019 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.235829    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70cb664a-2b4c-4b8c-801f-612cd784a54c-istiod-ca-cert\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.236019 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.235870    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-envoy\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.236019 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.235961    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-workload-certs\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.236019 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.235998    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-credential-socket\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.337265 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.337170    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-workload-certs\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.337265 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.337216    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-credential-socket\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.337265 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.337285    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-data\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.337635 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.337313    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hljls\" (UniqueName: \"kubernetes.io/projected/70cb664a-2b4c-4b8c-801f-612cd784a54c-kube-api-access-hljls\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.337635 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.337337    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-workload-socket\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.337635 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.337368    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-token\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.337635 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.337401    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-podinfo\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.337635 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.337428    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70cb664a-2b4c-4b8c-801f-612cd784a54c-istiod-ca-cert\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.337635 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.337466    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-envoy\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.337953 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.337732    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-workload-certs\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.337953 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.337833    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-data\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.337953 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.337881    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-workload-socket\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.338108 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.337998    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-credential-socket\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.338180 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.338161    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70cb664a-2b4c-4b8c-801f-612cd784a54c-istiod-ca-cert\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.339846 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.339818    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-envoy\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.339975 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.339957    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-podinfo\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.344917 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.344898    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hljls\" (UniqueName: \"kubernetes.io/projected/70cb664a-2b4c-4b8c-801f-612cd784a54c-kube-api-access-hljls\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.345032 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.345012    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-token\") pod \"e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") " pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.395241 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.395208    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:30.529293 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.529266    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"]
Jul 09 02:28:30.530907 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:28:30.530880    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70cb664a_2b4c_4b8c_801f_612cd784a54c.slice/crio-ec30f7d1303c454883f359607c74bbc316386c2c8f1e74bbc6b7edcdfaeef2c3 WatchSource:0}: Error finding container ec30f7d1303c454883f359607c74bbc316386c2c8f1e74bbc6b7edcdfaeef2c3: Status 404 returned error can't find the container with id ec30f7d1303c454883f359607c74bbc316386c2c8f1e74bbc6b7edcdfaeef2c3
Jul 09 02:28:30.533049 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.533016    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:28:30.533140 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.533080    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:28:30.533140 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.533107    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:28:30.923145 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.923107    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct" event={"ID":"70cb664a-2b4c-4b8c-801f-612cd784a54c","Type":"ContainerStarted","Data":"1296796f8ad76b921e499b5abdd4fc734f8c90bc3b2615f9f483a409540ad1ce"}
Jul 09 02:28:30.923333 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.923159    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct" event={"ID":"70cb664a-2b4c-4b8c-801f-612cd784a54c","Type":"ContainerStarted","Data":"ec30f7d1303c454883f359607c74bbc316386c2c8f1e74bbc6b7edcdfaeef2c3"}
Jul 09 02:28:30.946327 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:30.946263    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct" podStartSLOduration=0.946247427 podStartE2EDuration="946.247427ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:28:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:28:30.944014061 +0000 UTC m=+1736.225938210" watchObservedRunningTime="2026-07-09 02:28:30.946247427 +0000 UTC m=+1736.228171562"
Jul 09 02:28:31.396127 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:31.396095    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:31.400825 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:31.400800    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:31.928615 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:31.928582    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:31.929661 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:31.929645    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:32.878714 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:32.878680    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"]
Jul 09 02:28:32.881277 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:32.881257    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:28:32.883826 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:32.883801    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7d9bdee4-serving-cert\""
Jul 09 02:28:32.895370 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:32.895346    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"]
Jul 09 02:28:33.064335 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:33.064288    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-maas-api-tls\") pod \"maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6\" (UID: \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:28:33.064519 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:33.064473    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-openshift-service-ca\") pod \"maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6\" (UID: \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:28:33.064659 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:33.064522    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw7dl\" (UniqueName: \"kubernetes.io/projected/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-kube-api-access-kw7dl\") pod \"maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6\" (UID: \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:28:33.166078 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:33.165987    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-maas-api-tls\") pod \"maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6\" (UID: \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:28:33.166228 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:33.166117    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-openshift-service-ca\") pod \"maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6\" (UID: \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:28:33.166228 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:28:33.166131    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-serving-cert: secret "maas-api-e2e-mt-7d9bdee4-serving-cert" not found
Jul 09 02:28:33.166228 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:33.166150    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw7dl\" (UniqueName: \"kubernetes.io/projected/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-kube-api-access-kw7dl\") pod \"maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6\" (UID: \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:28:33.166228 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:28:33.166188    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-maas-api-tls podName:5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0 nodeName:}" failed. No retries permitted until 2026-07-09 02:28:33.666172625 +0000 UTC m=+1738.948096740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-maas-api-tls") pod "maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6" (UID: "5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0") : secret "maas-api-e2e-mt-7d9bdee4-serving-cert" not found
Jul 09 02:28:33.166822 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:33.166804    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-openshift-service-ca\") pod \"maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6\" (UID: \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:28:33.175073 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:33.175051    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw7dl\" (UniqueName: \"kubernetes.io/projected/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-kube-api-access-kw7dl\") pod \"maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6\" (UID: \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:28:33.672379 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:33.672341    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-maas-api-tls\") pod \"maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6\" (UID: \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:28:33.674823 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:33.674799    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-maas-api-tls\") pod \"maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6\" (UID: \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:28:33.795409 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:33.795368    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:28:33.927448 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:33.927426    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"]
Jul 09 02:28:33.929664 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:28:33.929635    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb3e58a_9ab4_404b_b2d6_42d2f4ca55b0.slice/crio-30a252c26bc1e95387270a7c963099c584752ac4a5129f3370ed5969ee82c791 WatchSource:0}: Error finding container 30a252c26bc1e95387270a7c963099c584752ac4a5129f3370ed5969ee82c791: Status 404 returned error can't find the container with id 30a252c26bc1e95387270a7c963099c584752ac4a5129f3370ed5969ee82c791
Jul 09 02:28:33.941584 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:33.941542    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6" event={"ID":"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0","Type":"ContainerStarted","Data":"30a252c26bc1e95387270a7c963099c584752ac4a5129f3370ed5969ee82c791"}
Jul 09 02:28:34.948211 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:34.948176    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6" event={"ID":"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0","Type":"ContainerStarted","Data":"20fc35321c00ae00b1d2b49be89ac85eed6f361aeddb3bf883adbe2e94be8810"}
Jul 09 02:28:34.948625 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:34.948281    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:28:40.959389 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:40.959357    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:28:40.977808 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:40.977756    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6" podStartSLOduration=8.612465164 podStartE2EDuration="8.977740654s" totalImagesPullingTime="365.27549ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:28:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:28:34.988086426 +0000 UTC m=+1740.270010561" watchObservedRunningTime="2026-07-09 02:28:40.977740654 +0000 UTC m=+1746.259664790"
Jul 09 02:28:46.009615 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:46.009509    2556 generic.go:356] "Generic (PLEG): container finished" podID="70cb664a-2b4c-4b8c-801f-612cd784a54c" containerID="1296796f8ad76b921e499b5abdd4fc734f8c90bc3b2615f9f483a409540ad1ce" exitCode=0
Jul 09 02:28:46.009615 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:46.009581    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct" event={"ID":"70cb664a-2b4c-4b8c-801f-612cd784a54c","Type":"ContainerDied","Data":"1296796f8ad76b921e499b5abdd4fc734f8c90bc3b2615f9f483a409540ad1ce"}
Jul 09 02:28:46.010087 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:46.010070    2556 scope.go:117] "RemoveContainer" containerID="1296796f8ad76b921e499b5abdd4fc734f8c90bc3b2615f9f483a409540ad1ce"
Jul 09 02:28:46.011144 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:46.011115    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:28:46.011219 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:46.011201    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:28:46.011256 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:46.011248    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:28:46.929022 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:46.928979    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:47.016456 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:47.016414    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct" event={"ID":"70cb664a-2b4c-4b8c-801f-612cd784a54c","Type":"ContainerStarted","Data":"86e10acd1801e9d5cc51868e39e74f19ea9d8f45fa1154e017fdd1caa9ff8e49"}
Jul 09 02:28:47.396186 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:47.396143    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:47.397270 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:47.397249    2556 patch_prober.go:28] interesting pod/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 09 02:28:47.397338 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:47.397296    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct" podUID="70cb664a-2b4c-4b8c-801f-612cd784a54c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 09 02:28:48.395727 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:48.395688    2556 patch_prober.go:28] interesting pod/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 09 02:28:48.396218 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:48.395763    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct" podUID="70cb664a-2b4c-4b8c-801f-612cd784a54c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 09 02:28:49.395770 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:49.395734    2556 patch_prober.go:28] interesting pod/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 09 02:28:49.396160 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:49.395798    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct" podUID="70cb664a-2b4c-4b8c-801f-612cd784a54c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 09 02:28:50.396141 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:50.396103    2556 patch_prober.go:28] interesting pod/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 09 02:28:50.396580 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:50.396158    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct" podUID="70cb664a-2b4c-4b8c-801f-612cd784a54c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 09 02:28:51.399703 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:51.399674    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:51.400118 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:51.400095    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:51.400704 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:51.400686    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:28:59.867996 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:59.867957    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"]
Jul 09 02:28:59.868409 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:28:59.868228    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6" podUID="5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0" containerName="maas-api" containerID="cri-o://20fc35321c00ae00b1d2b49be89ac85eed6f361aeddb3bf883adbe2e94be8810" gracePeriod=30
Jul 09 02:29:00.094372 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:00.094329    2556 generic.go:356] "Generic (PLEG): container finished" podID="5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0" containerID="20fc35321c00ae00b1d2b49be89ac85eed6f361aeddb3bf883adbe2e94be8810" exitCode=0
Jul 09 02:29:00.094511 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:00.094404    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6" event={"ID":"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0","Type":"ContainerDied","Data":"20fc35321c00ae00b1d2b49be89ac85eed6f361aeddb3bf883adbe2e94be8810"}
Jul 09 02:29:00.112701 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:00.112675    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:29:00.247053 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:00.246971    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw7dl\" (UniqueName: \"kubernetes.io/projected/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-kube-api-access-kw7dl\") pod \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\" (UID: \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\") "
Jul 09 02:29:00.247053 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:00.247022    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-openshift-service-ca\") pod \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\" (UID: \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\") "
Jul 09 02:29:00.247278 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:00.247058    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-maas-api-tls\") pod \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\" (UID: \"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0\") "
Jul 09 02:29:00.247439 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:00.247409    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0" (UID: "5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:29:00.249185 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:00.249161    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0" (UID: "5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:29:00.249254 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:00.249209    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-kube-api-access-kw7dl" (OuterVolumeSpecName: "kube-api-access-kw7dl") pod "5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0" (UID: "5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0"). InnerVolumeSpecName "kube-api-access-kw7dl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:29:00.347704 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:00.347668    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw7dl\" (UniqueName: \"kubernetes.io/projected/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-kube-api-access-kw7dl\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:29:00.347704 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:00.347699    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:29:00.347704 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:00.347709    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:29:01.101017 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:01.100984    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"
Jul 09 02:29:01.101477 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:01.101023    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6" event={"ID":"5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0","Type":"ContainerDied","Data":"30a252c26bc1e95387270a7c963099c584752ac4a5129f3370ed5969ee82c791"}
Jul 09 02:29:01.101477 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:01.101081    2556 scope.go:117] "RemoveContainer" containerID="20fc35321c00ae00b1d2b49be89ac85eed6f361aeddb3bf883adbe2e94be8810"
Jul 09 02:29:01.121983 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:01.121956    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"]
Jul 09 02:29:01.125834 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:01.125813    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d9bdee4-d7fb8bc55-8cxm6"]
Jul 09 02:29:01.274157 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:01.274128    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0" path="/var/lib/kubelet/pods/5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0/volumes"
Jul 09 02:29:54.163150 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:54.163114    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"]
Jul 09 02:29:54.163633 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:54.163321    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct" podUID="70cb664a-2b4c-4b8c-801f-612cd784a54c" containerName="istio-proxy" containerID="cri-o://86e10acd1801e9d5cc51868e39e74f19ea9d8f45fa1154e017fdd1caa9ff8e49" gracePeriod=30
Jul 09 02:29:59.393219 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.393179    2556 generic.go:356] "Generic (PLEG): container finished" podID="70cb664a-2b4c-4b8c-801f-612cd784a54c" containerID="86e10acd1801e9d5cc51868e39e74f19ea9d8f45fa1154e017fdd1caa9ff8e49" exitCode=0
Jul 09 02:29:59.393654 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.393243    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct" event={"ID":"70cb664a-2b4c-4b8c-801f-612cd784a54c","Type":"ContainerDied","Data":"86e10acd1801e9d5cc51868e39e74f19ea9d8f45fa1154e017fdd1caa9ff8e49"}
Jul 09 02:29:59.393654 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.393292    2556 scope.go:117] "RemoveContainer" containerID="1296796f8ad76b921e499b5abdd4fc734f8c90bc3b2615f9f483a409540ad1ce"
Jul 09 02:29:59.418130 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.418111    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:29:59.498424 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.498337    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-token\") pod \"70cb664a-2b4c-4b8c-801f-612cd784a54c\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") "
Jul 09 02:29:59.498607 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.498430    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-envoy\") pod \"70cb664a-2b4c-4b8c-801f-612cd784a54c\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") "
Jul 09 02:29:59.498607 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.498524    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70cb664a-2b4c-4b8c-801f-612cd784a54c-istiod-ca-cert\") pod \"70cb664a-2b4c-4b8c-801f-612cd784a54c\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") "
Jul 09 02:29:59.498607 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.498583    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-data\") pod \"70cb664a-2b4c-4b8c-801f-612cd784a54c\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") "
Jul 09 02:29:59.498794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.498617    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hljls\" (UniqueName: \"kubernetes.io/projected/70cb664a-2b4c-4b8c-801f-612cd784a54c-kube-api-access-hljls\") pod \"70cb664a-2b4c-4b8c-801f-612cd784a54c\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") "
Jul 09 02:29:59.498794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.498650    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-credential-socket\") pod \"70cb664a-2b4c-4b8c-801f-612cd784a54c\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") "
Jul 09 02:29:59.498794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.498672    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-workload-socket\") pod \"70cb664a-2b4c-4b8c-801f-612cd784a54c\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") "
Jul 09 02:29:59.498794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.498699    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-podinfo\") pod \"70cb664a-2b4c-4b8c-801f-612cd784a54c\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") "
Jul 09 02:29:59.498794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.498770    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-workload-certs\") pod \"70cb664a-2b4c-4b8c-801f-612cd784a54c\" (UID: \"70cb664a-2b4c-4b8c-801f-612cd784a54c\") "
Jul 09 02:29:59.499052 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.498909    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70cb664a-2b4c-4b8c-801f-612cd784a54c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70cb664a-2b4c-4b8c-801f-612cd784a54c" (UID: "70cb664a-2b4c-4b8c-801f-612cd784a54c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:29:59.499052 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.498906    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70cb664a-2b4c-4b8c-801f-612cd784a54c" (UID: "70cb664a-2b4c-4b8c-801f-612cd784a54c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:29:59.499052 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.498981    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70cb664a-2b4c-4b8c-801f-612cd784a54c" (UID: "70cb664a-2b4c-4b8c-801f-612cd784a54c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:29:59.499218 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.499114    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-credential-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:29:59.499218 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.499134    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-workload-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:29:59.499218 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.499147    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70cb664a-2b4c-4b8c-801f-612cd784a54c-istiod-ca-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:29:59.499218 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.499182    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70cb664a-2b4c-4b8c-801f-612cd784a54c" (UID: "70cb664a-2b4c-4b8c-801f-612cd784a54c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:29:59.499703 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.499677    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-data" (OuterVolumeSpecName: "istio-data") pod "70cb664a-2b4c-4b8c-801f-612cd784a54c" (UID: "70cb664a-2b4c-4b8c-801f-612cd784a54c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:29:59.500810 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.500790    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70cb664a-2b4c-4b8c-801f-612cd784a54c-kube-api-access-hljls" (OuterVolumeSpecName: "kube-api-access-hljls") pod "70cb664a-2b4c-4b8c-801f-612cd784a54c" (UID: "70cb664a-2b4c-4b8c-801f-612cd784a54c"). InnerVolumeSpecName "kube-api-access-hljls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:29:59.500931 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.500913    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70cb664a-2b4c-4b8c-801f-612cd784a54c" (UID: "70cb664a-2b4c-4b8c-801f-612cd784a54c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 02:29:59.501081 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.501054    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-token" (OuterVolumeSpecName: "istio-token") pod "70cb664a-2b4c-4b8c-801f-612cd784a54c" (UID: "70cb664a-2b4c-4b8c-801f-612cd784a54c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:29:59.501081 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.501069    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70cb664a-2b4c-4b8c-801f-612cd784a54c" (UID: "70cb664a-2b4c-4b8c-801f-612cd784a54c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:29:59.599992 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.599955    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:29:59.599992 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.599986    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-envoy\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:29:59.599992 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.599995    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-data\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:29:59.600220 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.600003    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hljls\" (UniqueName: \"kubernetes.io/projected/70cb664a-2b4c-4b8c-801f-612cd784a54c-kube-api-access-hljls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:29:59.600220 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.600013    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70cb664a-2b4c-4b8c-801f-612cd784a54c-istio-podinfo\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:29:59.600220 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:29:59.600022    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70cb664a-2b4c-4b8c-801f-612cd784a54c-workload-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:30:00.399953 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:00.399924    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"
Jul 09 02:30:00.400393 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:00.399919    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct" event={"ID":"70cb664a-2b4c-4b8c-801f-612cd784a54c","Type":"ContainerDied","Data":"ec30f7d1303c454883f359607c74bbc316386c2c8f1e74bbc6b7edcdfaeef2c3"}
Jul 09 02:30:00.400393 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:00.400067    2556 scope.go:117] "RemoveContainer" containerID="86e10acd1801e9d5cc51868e39e74f19ea9d8f45fa1154e017fdd1caa9ff8e49"
Jul 09 02:30:00.431532 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:00.431508    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"]
Jul 09 02:30:00.435141 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:00.435118    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7d9bdee4-openshift-default-555d77d69f-vntct"]
Jul 09 02:30:01.274845 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:01.274801    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70cb664a-2b4c-4b8c-801f-612cd784a54c" path="/var/lib/kubelet/pods/70cb664a-2b4c-4b8c-801f-612cd784a54c/volumes"
Jul 09 02:30:48.856642 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.856607    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"]
Jul 09 02:30:48.857247 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.857197    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0" containerName="maas-api"
Jul 09 02:30:48.857247 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.857211    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0" containerName="maas-api"
Jul 09 02:30:48.857247 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.857223    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70cb664a-2b4c-4b8c-801f-612cd784a54c" containerName="istio-proxy"
Jul 09 02:30:48.857247 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.857232    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="70cb664a-2b4c-4b8c-801f-612cd784a54c" containerName="istio-proxy"
Jul 09 02:30:48.857458 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.857353    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="70cb664a-2b4c-4b8c-801f-612cd784a54c" containerName="istio-proxy"
Jul 09 02:30:48.857458 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.857369    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="70cb664a-2b4c-4b8c-801f-612cd784a54c" containerName="istio-proxy"
Jul 09 02:30:48.857458 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.857379    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eb3e58a-9ab4-404b-b2d6-42d2f4ca55b0" containerName="maas-api"
Jul 09 02:30:48.860852 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.860833    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:48.863245 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.863224    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d099dd-openshift-default-dockercfg-lbdq2\""
Jul 09 02:30:48.870680 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.870656    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"]
Jul 09 02:30:48.967979 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.967938    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-workload-certs\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:48.967979 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.967986    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-data\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:48.968270 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.968013    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istiod-ca-cert\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:48.968270 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.968112    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blqhs\" (UniqueName: \"kubernetes.io/projected/f37b4d89-ae09-46af-be5b-8ffa4836c2da-kube-api-access-blqhs\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:48.968270 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.968165    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-envoy\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:48.968270 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.968193    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-credential-socket\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:48.968270 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.968230    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-workload-socket\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:48.968552 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.968327    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-token\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:48.968552 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:48.968360    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-podinfo\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.069630 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.069590    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-token\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.069630 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.069637    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-podinfo\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.069909 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.069685    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-workload-certs\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.069909 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.069703    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-data\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.069909 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.069722    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istiod-ca-cert\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.069909 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.069751    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blqhs\" (UniqueName: \"kubernetes.io/projected/f37b4d89-ae09-46af-be5b-8ffa4836c2da-kube-api-access-blqhs\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.069909 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.069776    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-envoy\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.069909 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.069791    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-credential-socket\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.069909 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.069815    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-workload-socket\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.070244 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.070127    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-data\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.070284 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.070247    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-workload-socket\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.070450 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.070423    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-credential-socket\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.070675 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.070652    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-workload-certs\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.070790 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.070694    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istiod-ca-cert\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.072519 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.072171    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-envoy\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.072734 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.072701    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-podinfo\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.084238 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.084210    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-token\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.084396 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.084310    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blqhs\" (UniqueName: \"kubernetes.io/projected/f37b4d89-ae09-46af-be5b-8ffa4836c2da-kube-api-access-blqhs\") pod \"e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") " pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.173137 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.173048    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:49.319125 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.319100    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"]
Jul 09 02:30:49.320703 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:30:49.320677    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37b4d89_ae09_46af_be5b_8ffa4836c2da.slice/crio-46a77cd625a9f2f0a75b8f568d4c28aa5c77358e3427c6028e6a2a82c7217175 WatchSource:0}: Error finding container 46a77cd625a9f2f0a75b8f568d4c28aa5c77358e3427c6028e6a2a82c7217175: Status 404 returned error can't find the container with id 46a77cd625a9f2f0a75b8f568d4c28aa5c77358e3427c6028e6a2a82c7217175
Jul 09 02:30:49.322838 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.322804    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:30:49.322925 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.322871    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:30:49.322925 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.322906    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:30:49.647482 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.647445    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq" event={"ID":"f37b4d89-ae09-46af-be5b-8ffa4836c2da","Type":"ContainerStarted","Data":"65a6087e4c3539ff36c58905c3e30236f6f594ebb6ecd03a2db0d78963a74b04"}
Jul 09 02:30:49.647690 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.647504    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq" event={"ID":"f37b4d89-ae09-46af-be5b-8ffa4836c2da","Type":"ContainerStarted","Data":"46a77cd625a9f2f0a75b8f568d4c28aa5c77358e3427c6028e6a2a82c7217175"}
Jul 09 02:30:49.666371 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:49.666303    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq" podStartSLOduration=1.666285359 podStartE2EDuration="1.666285359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:30:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:30:49.665862344 +0000 UTC m=+1874.947786506" watchObservedRunningTime="2026-07-09 02:30:49.666285359 +0000 UTC m=+1874.948209497"
Jul 09 02:30:50.173254 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:50.173211    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:50.178139 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:50.178117    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:50.652925 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:50.652892    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:50.653805 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:50.653789    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:30:51.718349 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:51.718318    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"]
Jul 09 02:30:51.718806 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:51.718739    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70cb664a-2b4c-4b8c-801f-612cd784a54c" containerName="istio-proxy"
Jul 09 02:30:51.718806 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:51.718751    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="70cb664a-2b4c-4b8c-801f-612cd784a54c" containerName="istio-proxy"
Jul 09 02:30:51.722149 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:51.722130    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:30:51.724680 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:51.724659    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d099dd-serving-cert\""
Jul 09 02:30:51.733145 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:51.733121    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"]
Jul 09 02:30:51.795269 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:51.795235    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06d193b7-d418-42c0-ab35-98e155c89560-maas-api-tls\") pod \"maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g\" (UID: \"06d193b7-d418-42c0-ab35-98e155c89560\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:30:51.795269 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:51.795272    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v6p5\" (UniqueName: \"kubernetes.io/projected/06d193b7-d418-42c0-ab35-98e155c89560-kube-api-access-8v6p5\") pod \"maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g\" (UID: \"06d193b7-d418-42c0-ab35-98e155c89560\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:30:51.795524 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:51.795409    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d193b7-d418-42c0-ab35-98e155c89560-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g\" (UID: \"06d193b7-d418-42c0-ab35-98e155c89560\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:30:51.896950 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:51.896910    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v6p5\" (UniqueName: \"kubernetes.io/projected/06d193b7-d418-42c0-ab35-98e155c89560-kube-api-access-8v6p5\") pod \"maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g\" (UID: \"06d193b7-d418-42c0-ab35-98e155c89560\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:30:51.897166 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:51.897008    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d193b7-d418-42c0-ab35-98e155c89560-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g\" (UID: \"06d193b7-d418-42c0-ab35-98e155c89560\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:30:51.897166 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:51.897066    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06d193b7-d418-42c0-ab35-98e155c89560-maas-api-tls\") pod \"maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g\" (UID: \"06d193b7-d418-42c0-ab35-98e155c89560\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:30:51.897294 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:30:51.897184    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-serving-cert: secret "maas-api-e2e-inf-a-d099dd-serving-cert" not found
Jul 09 02:30:51.897294 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:30:51.897260    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06d193b7-d418-42c0-ab35-98e155c89560-maas-api-tls podName:06d193b7-d418-42c0-ab35-98e155c89560 nodeName:}" failed. No retries permitted until 2026-07-09 02:30:52.397238109 +0000 UTC m=+1877.679162227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/06d193b7-d418-42c0-ab35-98e155c89560-maas-api-tls") pod "maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g" (UID: "06d193b7-d418-42c0-ab35-98e155c89560") : secret "maas-api-e2e-inf-a-d099dd-serving-cert" not found
Jul 09 02:30:51.897755 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:51.897738    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d193b7-d418-42c0-ab35-98e155c89560-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g\" (UID: \"06d193b7-d418-42c0-ab35-98e155c89560\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:30:51.906871 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:51.906845    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v6p5\" (UniqueName: \"kubernetes.io/projected/06d193b7-d418-42c0-ab35-98e155c89560-kube-api-access-8v6p5\") pod \"maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g\" (UID: \"06d193b7-d418-42c0-ab35-98e155c89560\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:30:52.402327 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:52.402290    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06d193b7-d418-42c0-ab35-98e155c89560-maas-api-tls\") pod \"maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g\" (UID: \"06d193b7-d418-42c0-ab35-98e155c89560\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:30:52.404727 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:52.404702    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06d193b7-d418-42c0-ab35-98e155c89560-maas-api-tls\") pod \"maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g\" (UID: \"06d193b7-d418-42c0-ab35-98e155c89560\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:30:52.635112 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:52.635073    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:30:52.766954 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:52.766929    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"]
Jul 09 02:30:52.769189 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:30:52.769166    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d193b7_d418_42c0_ab35_98e155c89560.slice/crio-f05047bbd68c22cb9e3278fb93985d1804645a27d490a121df8807ba8c612d4b WatchSource:0}: Error finding container f05047bbd68c22cb9e3278fb93985d1804645a27d490a121df8807ba8c612d4b: Status 404 returned error can't find the container with id f05047bbd68c22cb9e3278fb93985d1804645a27d490a121df8807ba8c612d4b
Jul 09 02:30:52.770690 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:52.770673    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 02:30:53.669785 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:53.669746    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g" event={"ID":"06d193b7-d418-42c0-ab35-98e155c89560","Type":"ContainerStarted","Data":"1c399d49f826ee16d60a546be2780071707b7daa172d6e2d6b16c589c7789c39"}
Jul 09 02:30:53.669985 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:53.669798    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g" event={"ID":"06d193b7-d418-42c0-ab35-98e155c89560","Type":"ContainerStarted","Data":"f05047bbd68c22cb9e3278fb93985d1804645a27d490a121df8807ba8c612d4b"}
Jul 09 02:30:53.669985 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:53.669860    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:30:53.688419 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:53.688364    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g" podStartSLOduration=2.234673546 podStartE2EDuration="2.688347936s" totalImagesPullingTime="453.67439ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:30:53.686898176 +0000 UTC m=+1878.968822344" watchObservedRunningTime="2026-07-09 02:30:53.688347936 +0000 UTC m=+1878.970272116"
Jul 09 02:30:59.680525 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:30:59.680491    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:31:02.815676 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:02.815637    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"]
Jul 09 02:31:02.826858 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:02.826830    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:31:02.831286 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:02.830297    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"]
Jul 09 02:31:02.831286 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:02.830525    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-5a89bf-serving-cert\""
Jul 09 02:31:02.909454 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:02.909413    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fecd3f6-e213-4151-8059-546723e10d9c-maas-api-tls\") pod \"maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r\" (UID: \"1fecd3f6-e213-4151-8059-546723e10d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:31:02.909672 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:02.909477    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fecd3f6-e213-4151-8059-546723e10d9c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r\" (UID: \"1fecd3f6-e213-4151-8059-546723e10d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:31:02.909745 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:02.909671    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9pwb\" (UniqueName: \"kubernetes.io/projected/1fecd3f6-e213-4151-8059-546723e10d9c-kube-api-access-d9pwb\") pod \"maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r\" (UID: \"1fecd3f6-e213-4151-8059-546723e10d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:31:03.010865 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:03.010824    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9pwb\" (UniqueName: \"kubernetes.io/projected/1fecd3f6-e213-4151-8059-546723e10d9c-kube-api-access-d9pwb\") pod \"maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r\" (UID: \"1fecd3f6-e213-4151-8059-546723e10d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:31:03.011192 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:03.011163    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fecd3f6-e213-4151-8059-546723e10d9c-maas-api-tls\") pod \"maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r\" (UID: \"1fecd3f6-e213-4151-8059-546723e10d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:31:03.011322 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:03.011241    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fecd3f6-e213-4151-8059-546723e10d9c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r\" (UID: \"1fecd3f6-e213-4151-8059-546723e10d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:31:03.011413 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:31:03.011392    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-serving-cert: secret "maas-api-e2e-inf-b-5a89bf-serving-cert" not found
Jul 09 02:31:03.011491 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:31:03.011478    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fecd3f6-e213-4151-8059-546723e10d9c-maas-api-tls podName:1fecd3f6-e213-4151-8059-546723e10d9c nodeName:}" failed. No retries permitted until 2026-07-09 02:31:03.511457323 +0000 UTC m=+1888.793381441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1fecd3f6-e213-4151-8059-546723e10d9c-maas-api-tls") pod "maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r" (UID: "1fecd3f6-e213-4151-8059-546723e10d9c") : secret "maas-api-e2e-inf-b-5a89bf-serving-cert" not found
Jul 09 02:31:03.012112 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:03.012087    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fecd3f6-e213-4151-8059-546723e10d9c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r\" (UID: \"1fecd3f6-e213-4151-8059-546723e10d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:31:03.020129 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:03.020103    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9pwb\" (UniqueName: \"kubernetes.io/projected/1fecd3f6-e213-4151-8059-546723e10d9c-kube-api-access-d9pwb\") pod \"maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r\" (UID: \"1fecd3f6-e213-4151-8059-546723e10d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:31:03.517447 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:03.517413    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fecd3f6-e213-4151-8059-546723e10d9c-maas-api-tls\") pod \"maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r\" (UID: \"1fecd3f6-e213-4151-8059-546723e10d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:31:03.520013 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:03.519985    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fecd3f6-e213-4151-8059-546723e10d9c-maas-api-tls\") pod \"maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r\" (UID: \"1fecd3f6-e213-4151-8059-546723e10d9c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:31:03.744065 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:03.744026    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:31:03.906537 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:03.906510    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"]
Jul 09 02:31:03.908584 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:31:03.908538    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fecd3f6_e213_4151_8059_546723e10d9c.slice/crio-01a7a08523be643df3415f6181975d21fd968fc8ce5a0876287fee7adc2ff183 WatchSource:0}: Error finding container 01a7a08523be643df3415f6181975d21fd968fc8ce5a0876287fee7adc2ff183: Status 404 returned error can't find the container with id 01a7a08523be643df3415f6181975d21fd968fc8ce5a0876287fee7adc2ff183
Jul 09 02:31:04.746823 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:04.746770    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r" event={"ID":"1fecd3f6-e213-4151-8059-546723e10d9c","Type":"ContainerStarted","Data":"b0e3755ae72de745280d7961cc66a3a3145346120cee076780f6e6191add906c"}
Jul 09 02:31:04.747034 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:04.746840    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r" event={"ID":"1fecd3f6-e213-4151-8059-546723e10d9c","Type":"ContainerStarted","Data":"01a7a08523be643df3415f6181975d21fd968fc8ce5a0876287fee7adc2ff183"}
Jul 09 02:31:04.747034 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:04.746872    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:31:04.764008 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:04.763957    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r" podStartSLOduration=2.338455238 podStartE2EDuration="2.763941814s" totalImagesPullingTime="425.486576ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:31:04.762871196 +0000 UTC m=+1890.044795333" watchObservedRunningTime="2026-07-09 02:31:04.763941814 +0000 UTC m=+1890.045865944"
Jul 09 02:31:06.694762 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:06.694720    2556 patch_prober.go:28] interesting pod/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 02:31:06.695179 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:06.694797    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq" podUID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 02:31:08.769613 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:08.769579    2556 generic.go:356] "Generic (PLEG): container finished" podID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" containerID="65a6087e4c3539ff36c58905c3e30236f6f594ebb6ecd03a2db0d78963a74b04" exitCode=0
Jul 09 02:31:08.770037 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:08.769652    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq" event={"ID":"f37b4d89-ae09-46af-be5b-8ffa4836c2da","Type":"ContainerDied","Data":"65a6087e4c3539ff36c58905c3e30236f6f594ebb6ecd03a2db0d78963a74b04"}
Jul 09 02:31:08.770037 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:08.770020    2556 scope.go:117] "RemoveContainer" containerID="65a6087e4c3539ff36c58905c3e30236f6f594ebb6ecd03a2db0d78963a74b04"
Jul 09 02:31:08.771046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:08.771017    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:31:08.771139 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:08.771086    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:31:08.771139 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:08.771124    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:31:09.776516 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:09.776481    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq" event={"ID":"f37b4d89-ae09-46af-be5b-8ffa4836c2da","Type":"ContainerStarted","Data":"e9ca5197969084395f6fbef1736d5df8d9b58f50df1fc58c988307cfe3a8674d"}
Jul 09 02:31:10.173278 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:10.173239    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:31:10.173509 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:10.173485    2556 patch_prober.go:28] interesting pod/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 09 02:31:10.173581 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:10.173539    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq" podUID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 09 02:31:10.757323 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:10.757289    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:31:11.174050 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:11.174015    2556 patch_prober.go:28] interesting pod/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 09 02:31:11.174466 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:11.174083    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq" podUID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 09 02:31:12.174251 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:12.174211    2556 patch_prober.go:28] interesting pod/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 09 02:31:12.174694 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:12.174275    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq" podUID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 09 02:31:13.174420 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:13.174379    2556 patch_prober.go:28] interesting pod/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 09 02:31:13.174852 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:13.174438    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq" podUID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 09 02:31:14.177990 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:14.177960    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:31:14.178446 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:14.178227    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:31:14.179067 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:31:14.179050    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:32:07.441088 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:07.441052    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"]
Jul 09 02:32:07.441616 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:07.441328    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g" podUID="06d193b7-d418-42c0-ab35-98e155c89560" containerName="maas-api" containerID="cri-o://1c399d49f826ee16d60a546be2780071707b7daa172d6e2d6b16c589c7789c39" gracePeriod=30
Jul 09 02:32:07.693994 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:07.693935    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:32:07.759220 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:07.759188    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d193b7-d418-42c0-ab35-98e155c89560-openshift-service-ca\") pod \"06d193b7-d418-42c0-ab35-98e155c89560\" (UID: \"06d193b7-d418-42c0-ab35-98e155c89560\") "
Jul 09 02:32:07.759388 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:07.759299    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06d193b7-d418-42c0-ab35-98e155c89560-maas-api-tls\") pod \"06d193b7-d418-42c0-ab35-98e155c89560\" (UID: \"06d193b7-d418-42c0-ab35-98e155c89560\") "
Jul 09 02:32:07.759388 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:07.759342    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v6p5\" (UniqueName: \"kubernetes.io/projected/06d193b7-d418-42c0-ab35-98e155c89560-kube-api-access-8v6p5\") pod \"06d193b7-d418-42c0-ab35-98e155c89560\" (UID: \"06d193b7-d418-42c0-ab35-98e155c89560\") "
Jul 09 02:32:07.759655 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:07.759631    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06d193b7-d418-42c0-ab35-98e155c89560-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "06d193b7-d418-42c0-ab35-98e155c89560" (UID: "06d193b7-d418-42c0-ab35-98e155c89560"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:32:07.761390 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:07.761364    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06d193b7-d418-42c0-ab35-98e155c89560-kube-api-access-8v6p5" (OuterVolumeSpecName: "kube-api-access-8v6p5") pod "06d193b7-d418-42c0-ab35-98e155c89560" (UID: "06d193b7-d418-42c0-ab35-98e155c89560"). InnerVolumeSpecName "kube-api-access-8v6p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:32:07.761501 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:07.761397    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06d193b7-d418-42c0-ab35-98e155c89560-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "06d193b7-d418-42c0-ab35-98e155c89560" (UID: "06d193b7-d418-42c0-ab35-98e155c89560"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:32:07.860956 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:07.860925    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06d193b7-d418-42c0-ab35-98e155c89560-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:07.860956 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:07.860955    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v6p5\" (UniqueName: \"kubernetes.io/projected/06d193b7-d418-42c0-ab35-98e155c89560-kube-api-access-8v6p5\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:07.861164 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:07.860967    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d193b7-d418-42c0-ab35-98e155c89560-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:08.086322 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:08.086237    2556 generic.go:356] "Generic (PLEG): container finished" podID="06d193b7-d418-42c0-ab35-98e155c89560" containerID="1c399d49f826ee16d60a546be2780071707b7daa172d6e2d6b16c589c7789c39" exitCode=0
Jul 09 02:32:08.086322 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:08.086287    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"
Jul 09 02:32:08.086516 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:08.086287    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g" event={"ID":"06d193b7-d418-42c0-ab35-98e155c89560","Type":"ContainerDied","Data":"1c399d49f826ee16d60a546be2780071707b7daa172d6e2d6b16c589c7789c39"}
Jul 09 02:32:08.086516 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:08.086415    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g" event={"ID":"06d193b7-d418-42c0-ab35-98e155c89560","Type":"ContainerDied","Data":"f05047bbd68c22cb9e3278fb93985d1804645a27d490a121df8807ba8c612d4b"}
Jul 09 02:32:08.086516 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:08.086450    2556 scope.go:117] "RemoveContainer" containerID="1c399d49f826ee16d60a546be2780071707b7daa172d6e2d6b16c589c7789c39"
Jul 09 02:32:08.095683 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:08.095662    2556 scope.go:117] "RemoveContainer" containerID="1c399d49f826ee16d60a546be2780071707b7daa172d6e2d6b16c589c7789c39"
Jul 09 02:32:08.095956 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:32:08.095937    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c399d49f826ee16d60a546be2780071707b7daa172d6e2d6b16c589c7789c39\": container with ID starting with 1c399d49f826ee16d60a546be2780071707b7daa172d6e2d6b16c589c7789c39 not found: ID does not exist" containerID="1c399d49f826ee16d60a546be2780071707b7daa172d6e2d6b16c589c7789c39"
Jul 09 02:32:08.096007 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:08.095965    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c399d49f826ee16d60a546be2780071707b7daa172d6e2d6b16c589c7789c39"} err="failed to get container status \"1c399d49f826ee16d60a546be2780071707b7daa172d6e2d6b16c589c7789c39\": rpc error: code = NotFound desc = could not find container \"1c399d49f826ee16d60a546be2780071707b7daa172d6e2d6b16c589c7789c39\": container with ID starting with 1c399d49f826ee16d60a546be2780071707b7daa172d6e2d6b16c589c7789c39 not found: ID does not exist"
Jul 09 02:32:08.109150 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:08.109126    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"]
Jul 09 02:32:08.112297 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:08.112277    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d099dd-5ddfc98d9c-sjl6g"]
Jul 09 02:32:09.275947 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:09.275906    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06d193b7-d418-42c0-ab35-98e155c89560" path="/var/lib/kubelet/pods/06d193b7-d418-42c0-ab35-98e155c89560/volumes"
Jul 09 02:32:49.465348 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:49.465313    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"]
Jul 09 02:32:49.465890 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:49.465527    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq" podUID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" containerName="istio-proxy" containerID="cri-o://e9ca5197969084395f6fbef1736d5df8d9b58f50df1fc58c988307cfe3a8674d" gracePeriod=30
Jul 09 02:32:50.608402 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:50.608367    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"]
Jul 09 02:32:50.608869 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:50.608635    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r" podUID="1fecd3f6-e213-4151-8059-546723e10d9c" containerName="maas-api" containerID="cri-o://b0e3755ae72de745280d7961cc66a3a3145346120cee076780f6e6191add906c" gracePeriod=30
Jul 09 02:32:50.752582 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:50.752522    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r" podUID="1fecd3f6-e213-4151-8059-546723e10d9c" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.52:8443/health\": dial tcp 10.133.0.52:8443: connect: connection refused"
Jul 09 02:32:51.059702 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.059679    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:32:51.168467 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.168374    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9pwb\" (UniqueName: \"kubernetes.io/projected/1fecd3f6-e213-4151-8059-546723e10d9c-kube-api-access-d9pwb\") pod \"1fecd3f6-e213-4151-8059-546723e10d9c\" (UID: \"1fecd3f6-e213-4151-8059-546723e10d9c\") "
Jul 09 02:32:51.168467 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.168413    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fecd3f6-e213-4151-8059-546723e10d9c-openshift-service-ca\") pod \"1fecd3f6-e213-4151-8059-546723e10d9c\" (UID: \"1fecd3f6-e213-4151-8059-546723e10d9c\") "
Jul 09 02:32:51.168467 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.168439    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fecd3f6-e213-4151-8059-546723e10d9c-maas-api-tls\") pod \"1fecd3f6-e213-4151-8059-546723e10d9c\" (UID: \"1fecd3f6-e213-4151-8059-546723e10d9c\") "
Jul 09 02:32:51.168846 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.168817    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fecd3f6-e213-4151-8059-546723e10d9c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1fecd3f6-e213-4151-8059-546723e10d9c" (UID: "1fecd3f6-e213-4151-8059-546723e10d9c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:32:51.170675 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.170650    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fecd3f6-e213-4151-8059-546723e10d9c-kube-api-access-d9pwb" (OuterVolumeSpecName: "kube-api-access-d9pwb") pod "1fecd3f6-e213-4151-8059-546723e10d9c" (UID: "1fecd3f6-e213-4151-8059-546723e10d9c"). InnerVolumeSpecName "kube-api-access-d9pwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:32:51.170752 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.170699    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fecd3f6-e213-4151-8059-546723e10d9c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1fecd3f6-e213-4151-8059-546723e10d9c" (UID: "1fecd3f6-e213-4151-8059-546723e10d9c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:32:51.269137 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.269109    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9pwb\" (UniqueName: \"kubernetes.io/projected/1fecd3f6-e213-4151-8059-546723e10d9c-kube-api-access-d9pwb\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:51.269137 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.269131    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fecd3f6-e213-4151-8059-546723e10d9c-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:51.269137 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.269141    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1fecd3f6-e213-4151-8059-546723e10d9c-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:51.302235 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.302197    2556 generic.go:356] "Generic (PLEG): container finished" podID="1fecd3f6-e213-4151-8059-546723e10d9c" containerID="b0e3755ae72de745280d7961cc66a3a3145346120cee076780f6e6191add906c" exitCode=0
Jul 09 02:32:51.302405 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.302241    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"
Jul 09 02:32:51.302405 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.302279    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r" event={"ID":"1fecd3f6-e213-4151-8059-546723e10d9c","Type":"ContainerDied","Data":"b0e3755ae72de745280d7961cc66a3a3145346120cee076780f6e6191add906c"}
Jul 09 02:32:51.302405 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.302329    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r" event={"ID":"1fecd3f6-e213-4151-8059-546723e10d9c","Type":"ContainerDied","Data":"01a7a08523be643df3415f6181975d21fd968fc8ce5a0876287fee7adc2ff183"}
Jul 09 02:32:51.302405 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.302363    2556 scope.go:117] "RemoveContainer" containerID="b0e3755ae72de745280d7961cc66a3a3145346120cee076780f6e6191add906c"
Jul 09 02:32:51.311032 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.311017    2556 scope.go:117] "RemoveContainer" containerID="b0e3755ae72de745280d7961cc66a3a3145346120cee076780f6e6191add906c"
Jul 09 02:32:51.311280 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:32:51.311264    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0e3755ae72de745280d7961cc66a3a3145346120cee076780f6e6191add906c\": container with ID starting with b0e3755ae72de745280d7961cc66a3a3145346120cee076780f6e6191add906c not found: ID does not exist" containerID="b0e3755ae72de745280d7961cc66a3a3145346120cee076780f6e6191add906c"
Jul 09 02:32:51.311343 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.311288    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0e3755ae72de745280d7961cc66a3a3145346120cee076780f6e6191add906c"} err="failed to get container status \"b0e3755ae72de745280d7961cc66a3a3145346120cee076780f6e6191add906c\": rpc error: code = NotFound desc = could not find container \"b0e3755ae72de745280d7961cc66a3a3145346120cee076780f6e6191add906c\": container with ID starting with b0e3755ae72de745280d7961cc66a3a3145346120cee076780f6e6191add906c not found: ID does not exist"
Jul 09 02:32:51.318469 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.318447    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"]
Jul 09 02:32:51.320341 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:51.320322    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-5a89bf-6d4fcb98f7-jw25r"]
Jul 09 02:32:53.274030 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:53.273997    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fecd3f6-e213-4151-8059-546723e10d9c" path="/var/lib/kubelet/pods/1fecd3f6-e213-4151-8059-546723e10d9c/volumes"
Jul 09 02:32:54.720104 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.720080    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:32:54.804922 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.804851    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istiod-ca-cert\") pod \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") "
Jul 09 02:32:54.804922 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.804893    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-workload-socket\") pod \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") "
Jul 09 02:32:54.804922 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.804923    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-token\") pod \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") "
Jul 09 02:32:54.805222 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.804969    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-podinfo\") pod \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") "
Jul 09 02:32:54.805222 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.805014    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-credential-socket\") pod \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") "
Jul 09 02:32:54.805519 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.805467    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f37b4d89-ae09-46af-be5b-8ffa4836c2da" (UID: "f37b4d89-ae09-46af-be5b-8ffa4836c2da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:32:54.805699 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.805676    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f37b4d89-ae09-46af-be5b-8ffa4836c2da" (UID: "f37b4d89-ae09-46af-be5b-8ffa4836c2da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:32:54.805769 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.805687    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f37b4d89-ae09-46af-be5b-8ffa4836c2da" (UID: "f37b4d89-ae09-46af-be5b-8ffa4836c2da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:32:54.807639 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.805780    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-envoy\") pod \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") "
Jul 09 02:32:54.807786 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.807689    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-data\") pod \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") "
Jul 09 02:32:54.807786 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.807760    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-workload-certs\") pod \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") "
Jul 09 02:32:54.807916 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.807817    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blqhs\" (UniqueName: \"kubernetes.io/projected/f37b4d89-ae09-46af-be5b-8ffa4836c2da-kube-api-access-blqhs\") pod \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\" (UID: \"f37b4d89-ae09-46af-be5b-8ffa4836c2da\") "
Jul 09 02:32:54.808039 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.808002    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f37b4d89-ae09-46af-be5b-8ffa4836c2da" (UID: "f37b4d89-ae09-46af-be5b-8ffa4836c2da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 02:32:54.808440 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.808357    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-podinfo\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:54.808440 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.808379    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-credential-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:54.808440 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.808392    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istiod-ca-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:54.808440 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.808406    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-workload-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:54.808440 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.808410    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f37b4d89-ae09-46af-be5b-8ffa4836c2da" (UID: "f37b4d89-ae09-46af-be5b-8ffa4836c2da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:32:54.808771 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.808664    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f37b4d89-ae09-46af-be5b-8ffa4836c2da" (UID: "f37b4d89-ae09-46af-be5b-8ffa4836c2da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:32:54.808870 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.808843    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-data" (OuterVolumeSpecName: "istio-data") pod "f37b4d89-ae09-46af-be5b-8ffa4836c2da" (UID: "f37b4d89-ae09-46af-be5b-8ffa4836c2da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:32:54.815082 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.815042    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-token" (OuterVolumeSpecName: "istio-token") pod "f37b4d89-ae09-46af-be5b-8ffa4836c2da" (UID: "f37b4d89-ae09-46af-be5b-8ffa4836c2da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:32:54.816646 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.816621    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f37b4d89-ae09-46af-be5b-8ffa4836c2da-kube-api-access-blqhs" (OuterVolumeSpecName: "kube-api-access-blqhs") pod "f37b4d89-ae09-46af-be5b-8ffa4836c2da" (UID: "f37b4d89-ae09-46af-be5b-8ffa4836c2da"). InnerVolumeSpecName "kube-api-access-blqhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:32:54.909363 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.909330    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blqhs\" (UniqueName: \"kubernetes.io/projected/f37b4d89-ae09-46af-be5b-8ffa4836c2da-kube-api-access-blqhs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:54.909363 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.909359    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:54.909363 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.909369    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-envoy\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:54.909622 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.909377    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-istio-data\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:54.909622 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:54.909385    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37b4d89-ae09-46af-be5b-8ffa4836c2da-workload-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:32:55.326158 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:55.326121    2556 generic.go:356] "Generic (PLEG): container finished" podID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" containerID="e9ca5197969084395f6fbef1736d5df8d9b58f50df1fc58c988307cfe3a8674d" exitCode=0
Jul 09 02:32:55.326351 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:55.326219    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"
Jul 09 02:32:55.326351 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:55.326239    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq" event={"ID":"f37b4d89-ae09-46af-be5b-8ffa4836c2da","Type":"ContainerDied","Data":"e9ca5197969084395f6fbef1736d5df8d9b58f50df1fc58c988307cfe3a8674d"}
Jul 09 02:32:55.326351 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:55.326294    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq" event={"ID":"f37b4d89-ae09-46af-be5b-8ffa4836c2da","Type":"ContainerDied","Data":"46a77cd625a9f2f0a75b8f568d4c28aa5c77358e3427c6028e6a2a82c7217175"}
Jul 09 02:32:55.326351 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:55.326319    2556 scope.go:117] "RemoveContainer" containerID="e9ca5197969084395f6fbef1736d5df8d9b58f50df1fc58c988307cfe3a8674d"
Jul 09 02:32:55.335134 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:55.335117    2556 scope.go:117] "RemoveContainer" containerID="65a6087e4c3539ff36c58905c3e30236f6f594ebb6ecd03a2db0d78963a74b04"
Jul 09 02:32:55.343353 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:55.343332    2556 scope.go:117] "RemoveContainer" containerID="e9ca5197969084395f6fbef1736d5df8d9b58f50df1fc58c988307cfe3a8674d"
Jul 09 02:32:55.343630 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:32:55.343611    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9ca5197969084395f6fbef1736d5df8d9b58f50df1fc58c988307cfe3a8674d\": container with ID starting with e9ca5197969084395f6fbef1736d5df8d9b58f50df1fc58c988307cfe3a8674d not found: ID does not exist" containerID="e9ca5197969084395f6fbef1736d5df8d9b58f50df1fc58c988307cfe3a8674d"
Jul 09 02:32:55.343707 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:55.343642    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9ca5197969084395f6fbef1736d5df8d9b58f50df1fc58c988307cfe3a8674d"} err="failed to get container status \"e9ca5197969084395f6fbef1736d5df8d9b58f50df1fc58c988307cfe3a8674d\": rpc error: code = NotFound desc = could not find container \"e9ca5197969084395f6fbef1736d5df8d9b58f50df1fc58c988307cfe3a8674d\": container with ID starting with e9ca5197969084395f6fbef1736d5df8d9b58f50df1fc58c988307cfe3a8674d not found: ID does not exist"
Jul 09 02:32:55.343707 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:55.343667    2556 scope.go:117] "RemoveContainer" containerID="65a6087e4c3539ff36c58905c3e30236f6f594ebb6ecd03a2db0d78963a74b04"
Jul 09 02:32:55.343960 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:32:55.343939    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65a6087e4c3539ff36c58905c3e30236f6f594ebb6ecd03a2db0d78963a74b04\": container with ID starting with 65a6087e4c3539ff36c58905c3e30236f6f594ebb6ecd03a2db0d78963a74b04 not found: ID does not exist" containerID="65a6087e4c3539ff36c58905c3e30236f6f594ebb6ecd03a2db0d78963a74b04"
Jul 09 02:32:55.344009 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:55.343971    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a6087e4c3539ff36c58905c3e30236f6f594ebb6ecd03a2db0d78963a74b04"} err="failed to get container status \"65a6087e4c3539ff36c58905c3e30236f6f594ebb6ecd03a2db0d78963a74b04\": rpc error: code = NotFound desc = could not find container \"65a6087e4c3539ff36c58905c3e30236f6f594ebb6ecd03a2db0d78963a74b04\": container with ID starting with 65a6087e4c3539ff36c58905c3e30236f6f594ebb6ecd03a2db0d78963a74b04 not found: ID does not exist"
Jul 09 02:32:55.345340 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:55.345312    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"]
Jul 09 02:32:55.348125 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:55.348106    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d099dd-openshift-default-86bf79796f-74jlq"]
Jul 09 02:32:57.274288 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.274255    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" path="/var/lib/kubelet/pods/f37b4d89-ae09-46af-be5b-8ffa4836c2da/volumes"
Jul 09 02:32:57.519382 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.519337    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"]
Jul 09 02:32:57.519803 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.519786    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d193b7-d418-42c0-ab35-98e155c89560" containerName="maas-api"
Jul 09 02:32:57.519803 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.519806    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d193b7-d418-42c0-ab35-98e155c89560" containerName="maas-api"
Jul 09 02:32:57.519958 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.519817    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" containerName="istio-proxy"
Jul 09 02:32:57.519958 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.519823    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" containerName="istio-proxy"
Jul 09 02:32:57.519958 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.519837    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fecd3f6-e213-4151-8059-546723e10d9c" containerName="maas-api"
Jul 09 02:32:57.519958 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.519843    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fecd3f6-e213-4151-8059-546723e10d9c" containerName="maas-api"
Jul 09 02:32:57.519958 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.519852    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" containerName="istio-proxy"
Jul 09 02:32:57.519958 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.519858    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" containerName="istio-proxy"
Jul 09 02:32:57.519958 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.519930    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" containerName="istio-proxy"
Jul 09 02:32:57.519958 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.519938    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="06d193b7-d418-42c0-ab35-98e155c89560" containerName="maas-api"
Jul 09 02:32:57.519958 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.519946    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fecd3f6-e213-4151-8059-546723e10d9c" containerName="maas-api"
Jul 09 02:32:57.524498 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.524451    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.527146 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.527127    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-50b65a-openshift-default-dockercfg-24mct\""
Jul 09 02:32:57.534575 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.534535    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"]
Jul 09 02:32:57.633928 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.633890    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-workload-socket\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.634133 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.633995    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-data\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.634133 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.634039    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-workload-certs\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.634133 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.634087    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istiod-ca-cert\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.634308 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.634161    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-token\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.634308 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.634212    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-envoy\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.634308 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.634259    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-podinfo\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.634308 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.634293    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-credential-socket\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.634494 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.634319    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9hq4\" (UniqueName: \"kubernetes.io/projected/2c8ecba0-f6f9-4144-bc0c-f893b170f097-kube-api-access-w9hq4\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.735876 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.735845    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-envoy\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.736094 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.735885    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-podinfo\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.736094 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.735905    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-credential-socket\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.736094 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.736019    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9hq4\" (UniqueName: \"kubernetes.io/projected/2c8ecba0-f6f9-4144-bc0c-f893b170f097-kube-api-access-w9hq4\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.736094 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.736072    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-workload-socket\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.736312 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.736106    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-data\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.736312 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.736133    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-workload-certs\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.736312 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.736180    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istiod-ca-cert\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.736312 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.736290    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-token\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.736529 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.736402    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-credential-socket\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.736529 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.736518    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-workload-certs\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.736681 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.736603    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-data\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.736736 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.736717    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-workload-socket\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.737069 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.737048    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istiod-ca-cert\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.738242 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.738222    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-envoy\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.738667 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.738645    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-podinfo\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.744259 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.744242    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-token\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.744636 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.744616    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9hq4\" (UniqueName: \"kubernetes.io/projected/2c8ecba0-f6f9-4144-bc0c-f893b170f097-kube-api-access-w9hq4\") pod \"e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") " pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.836245 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.836165    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:57.973337 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.973312    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"]
Jul 09 02:32:57.975180 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:32:57.975154    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c8ecba0_f6f9_4144_bc0c_f893b170f097.slice/crio-408a402fc20b4aae6127fccade11fa05f014b0ec2c7885b299ed128fb1eaea9d WatchSource:0}: Error finding container 408a402fc20b4aae6127fccade11fa05f014b0ec2c7885b299ed128fb1eaea9d: Status 404 returned error can't find the container with id 408a402fc20b4aae6127fccade11fa05f014b0ec2c7885b299ed128fb1eaea9d
Jul 09 02:32:57.977292 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.977260    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:32:57.977390 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.977342    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:32:57.977452 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:57.977387    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:32:58.342475 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:58.342431    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5" event={"ID":"2c8ecba0-f6f9-4144-bc0c-f893b170f097","Type":"ContainerStarted","Data":"afc9aba15fa4ccf9f61503bdef49c918da2eee57c37f242725e6f0268b65aad8"}
Jul 09 02:32:58.342904 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:58.342500    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5" event={"ID":"2c8ecba0-f6f9-4144-bc0c-f893b170f097","Type":"ContainerStarted","Data":"408a402fc20b4aae6127fccade11fa05f014b0ec2c7885b299ed128fb1eaea9d"}
Jul 09 02:32:58.362384 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:58.362322    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5" podStartSLOduration=1.362306403 podStartE2EDuration="1.362306403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:32:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:32:58.359748163 +0000 UTC m=+2003.641672307" watchObservedRunningTime="2026-07-09 02:32:58.362306403 +0000 UTC m=+2003.644230539"
Jul 09 02:32:58.837104 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:58.837071    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:32:59.842314 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:32:59.842283    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:33:00.301766 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.300312    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"]
Jul 09 02:33:00.302395 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.302369    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f37b4d89-ae09-46af-be5b-8ffa4836c2da" containerName="istio-proxy"
Jul 09 02:33:00.306794 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.306768    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:00.307526 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.307500    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"]
Jul 09 02:33:00.309543 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.309524    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-50b65a-serving-cert\""
Jul 09 02:33:00.353349 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.353319    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:33:00.354338 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.354320    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:33:00.461103 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.461069    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-maas-api-tls\") pod \"maas-api-e2e-api-a-50b65a-6467f8465-8brjw\" (UID: \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:00.461283 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.461107    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5cxt\" (UniqueName: \"kubernetes.io/projected/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-kube-api-access-v5cxt\") pod \"maas-api-e2e-api-a-50b65a-6467f8465-8brjw\" (UID: \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:00.461283 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.461227    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-openshift-service-ca\") pod \"maas-api-e2e-api-a-50b65a-6467f8465-8brjw\" (UID: \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:00.562015 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.561926    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5cxt\" (UniqueName: \"kubernetes.io/projected/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-kube-api-access-v5cxt\") pod \"maas-api-e2e-api-a-50b65a-6467f8465-8brjw\" (UID: \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:00.562015 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.562003    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-openshift-service-ca\") pod \"maas-api-e2e-api-a-50b65a-6467f8465-8brjw\" (UID: \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:00.562219 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.562063    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-maas-api-tls\") pod \"maas-api-e2e-api-a-50b65a-6467f8465-8brjw\" (UID: \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:00.562667 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.562649    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-openshift-service-ca\") pod \"maas-api-e2e-api-a-50b65a-6467f8465-8brjw\" (UID: \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:00.564388 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.564368    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-maas-api-tls\") pod \"maas-api-e2e-api-a-50b65a-6467f8465-8brjw\" (UID: \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:00.572432 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.572399    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5cxt\" (UniqueName: \"kubernetes.io/projected/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-kube-api-access-v5cxt\") pod \"maas-api-e2e-api-a-50b65a-6467f8465-8brjw\" (UID: \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:00.618584 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.618543    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:00.752414 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:00.752353    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"]
Jul 09 02:33:00.754454 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:33:00.754430    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abd3ba1_822f_4196_84fd_e02b6dcdf5ac.slice/crio-351fa9c3b0cde2035d1baa5c1eb09eefe1bd4509b8a6c963d6f43642119a9e9b WatchSource:0}: Error finding container 351fa9c3b0cde2035d1baa5c1eb09eefe1bd4509b8a6c963d6f43642119a9e9b: Status 404 returned error can't find the container with id 351fa9c3b0cde2035d1baa5c1eb09eefe1bd4509b8a6c963d6f43642119a9e9b
Jul 09 02:33:01.360072 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:01.360033    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw" event={"ID":"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac","Type":"ContainerStarted","Data":"176199f4ae49edeb3763306087737aba5c5508db640f164ab2baf2ad7198d21a"}
Jul 09 02:33:01.360467 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:01.360089    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw" event={"ID":"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac","Type":"ContainerStarted","Data":"351fa9c3b0cde2035d1baa5c1eb09eefe1bd4509b8a6c963d6f43642119a9e9b"}
Jul 09 02:33:01.360467 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:01.360112    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:07.371943 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:07.371913    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:07.390693 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:07.390647    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw" podStartSLOduration=6.902438265 podStartE2EDuration="7.390629551s" totalImagesPullingTime="488.191286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:33:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:33:01.39945868 +0000 UTC m=+2006.681382818" watchObservedRunningTime="2026-07-09 02:33:07.390629551 +0000 UTC m=+2012.672553687"
Jul 09 02:33:08.461348 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.461308    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"]
Jul 09 02:33:08.465824 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.465805    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:08.468376 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.468348    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-f9c58b-serving-cert\""
Jul 09 02:33:08.476282 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.476255    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"]
Jul 09 02:33:08.652806 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.652767    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-maas-api-tls\") pod \"maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm\" (UID: \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:08.652806 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.652810    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-openshift-service-ca\") pod \"maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm\" (UID: \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:08.653071 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.652898    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbxc4\" (UniqueName: \"kubernetes.io/projected/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-kube-api-access-jbxc4\") pod \"maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm\" (UID: \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:08.754145 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.754048    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-maas-api-tls\") pod \"maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm\" (UID: \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:08.754145 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.754094    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-openshift-service-ca\") pod \"maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm\" (UID: \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:08.754145 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.754140    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbxc4\" (UniqueName: \"kubernetes.io/projected/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-kube-api-access-jbxc4\") pod \"maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm\" (UID: \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:08.754900 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.754878    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-openshift-service-ca\") pod \"maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm\" (UID: \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:08.756660 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.756643    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-maas-api-tls\") pod \"maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm\" (UID: \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:08.763775 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.763753    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbxc4\" (UniqueName: \"kubernetes.io/projected/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-kube-api-access-jbxc4\") pod \"maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm\" (UID: \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:08.779504 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.779484    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:08.948787 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:08.948728    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"]
Jul 09 02:33:08.953188 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:33:08.953156    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168afa53_7d7f_40ac_9ab4_5f7fa12fed9d.slice/crio-5711c4b24fc63371ef1af9e10337025ce134e99e3794778075f4c0d5aa6c29b0 WatchSource:0}: Error finding container 5711c4b24fc63371ef1af9e10337025ce134e99e3794778075f4c0d5aa6c29b0: Status 404 returned error can't find the container with id 5711c4b24fc63371ef1af9e10337025ce134e99e3794778075f4c0d5aa6c29b0
Jul 09 02:33:09.403946 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:09.403912    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm" event={"ID":"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d","Type":"ContainerStarted","Data":"5711c4b24fc63371ef1af9e10337025ce134e99e3794778075f4c0d5aa6c29b0"}
Jul 09 02:33:10.410685 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:10.410652    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm" event={"ID":"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d","Type":"ContainerStarted","Data":"d8486948c716b12759937c6e6b6deb2f1bb2a45e68b01d8bc436703908ea27aa"}
Jul 09 02:33:10.411072 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:10.410714    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:10.428401 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:10.428334    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm" podStartSLOduration=2.024738949 podStartE2EDuration="2.428313975s" totalImagesPullingTime="403.575026ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:33:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:33:10.426641042 +0000 UTC m=+2015.708565189" watchObservedRunningTime="2026-07-09 02:33:10.428313975 +0000 UTC m=+2015.710238111"
Jul 09 02:33:15.467749 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:15.467054    2556 patch_prober.go:28] interesting pod/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": read tcp 10.133.0.2:51334->10.133.0.53:15021: read: connection reset by peer" start-of-body=
Jul 09 02:33:15.467749 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:15.467132    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5" podUID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": read tcp 10.133.0.2:51334->10.133.0.53:15021: read: connection reset by peer"
Jul 09 02:33:16.421633 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:16.421606    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:16.445231 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:16.445195    2556 generic.go:356] "Generic (PLEG): container finished" podID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" containerID="afc9aba15fa4ccf9f61503bdef49c918da2eee57c37f242725e6f0268b65aad8" exitCode=0
Jul 09 02:33:16.445403 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:16.445258    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5" event={"ID":"2c8ecba0-f6f9-4144-bc0c-f893b170f097","Type":"ContainerDied","Data":"afc9aba15fa4ccf9f61503bdef49c918da2eee57c37f242725e6f0268b65aad8"}
Jul 09 02:33:16.445701 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:16.445681    2556 scope.go:117] "RemoveContainer" containerID="afc9aba15fa4ccf9f61503bdef49c918da2eee57c37f242725e6f0268b65aad8"
Jul 09 02:33:16.447632 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:16.447586    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:33:16.447955 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:16.447924    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:33:16.448234 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:16.448193    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:33:17.452626 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:17.452591    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5" event={"ID":"2c8ecba0-f6f9-4144-bc0c-f893b170f097","Type":"ContainerStarted","Data":"e342be6b96674101e84b72b5c66a048704cfff75c50541e30ae945d0c3f56e6b"}
Jul 09 02:33:17.837009 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:17.836906    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:33:17.837194 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:17.837035    2556 patch_prober.go:28] interesting pod/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 09 02:33:17.837194 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:17.837080    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5" podUID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 09 02:33:18.836886 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:18.836843    2556 patch_prober.go:28] interesting pod/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 09 02:33:18.837405 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:18.836910    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5" podUID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 09 02:33:19.837121 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:19.837080    2556 patch_prober.go:28] interesting pod/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 09 02:33:19.837767 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:19.837736    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5" podUID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 09 02:33:20.836987 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:20.836948    2556 patch_prober.go:28] interesting pod/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 09 02:33:20.837298 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:20.837265    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5" podUID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 09 02:33:21.510922 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.510891    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"]
Jul 09 02:33:21.511107 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.511082    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw" podUID="5abd3ba1-822f-4196-84fd-e02b6dcdf5ac" containerName="maas-api" containerID="cri-o://176199f4ae49edeb3763306087737aba5c5508db640f164ab2baf2ad7198d21a" gracePeriod=30
Jul 09 02:33:21.773535 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.773475    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:21.840059 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.840024    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:33:21.840417 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.840283    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:33:21.841056 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.841039    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:33:21.877342 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.877311    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5cxt\" (UniqueName: \"kubernetes.io/projected/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-kube-api-access-v5cxt\") pod \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\" (UID: \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\") "
Jul 09 02:33:21.877514 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.877386    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-maas-api-tls\") pod \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\" (UID: \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\") "
Jul 09 02:33:21.877514 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.877421    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-openshift-service-ca\") pod \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\" (UID: \"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac\") "
Jul 09 02:33:21.877880 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.877851    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5abd3ba1-822f-4196-84fd-e02b6dcdf5ac" (UID: "5abd3ba1-822f-4196-84fd-e02b6dcdf5ac"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:33:21.879760 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.879737    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5abd3ba1-822f-4196-84fd-e02b6dcdf5ac" (UID: "5abd3ba1-822f-4196-84fd-e02b6dcdf5ac"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:33:21.879957 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.879934    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-kube-api-access-v5cxt" (OuterVolumeSpecName: "kube-api-access-v5cxt") pod "5abd3ba1-822f-4196-84fd-e02b6dcdf5ac" (UID: "5abd3ba1-822f-4196-84fd-e02b6dcdf5ac"). InnerVolumeSpecName "kube-api-access-v5cxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:33:21.978953 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.978920    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:21.978953 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.978947    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5cxt\" (UniqueName: \"kubernetes.io/projected/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-kube-api-access-v5cxt\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:21.978953 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:21.978957    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:22.479646 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:22.479610    2556 generic.go:356] "Generic (PLEG): container finished" podID="5abd3ba1-822f-4196-84fd-e02b6dcdf5ac" containerID="176199f4ae49edeb3763306087737aba5c5508db640f164ab2baf2ad7198d21a" exitCode=0
Jul 09 02:33:22.479861 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:22.479665    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"
Jul 09 02:33:22.479861 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:22.479695    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw" event={"ID":"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac","Type":"ContainerDied","Data":"176199f4ae49edeb3763306087737aba5c5508db640f164ab2baf2ad7198d21a"}
Jul 09 02:33:22.479861 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:22.479756    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw" event={"ID":"5abd3ba1-822f-4196-84fd-e02b6dcdf5ac","Type":"ContainerDied","Data":"351fa9c3b0cde2035d1baa5c1eb09eefe1bd4509b8a6c963d6f43642119a9e9b"}
Jul 09 02:33:22.479861 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:22.479787    2556 scope.go:117] "RemoveContainer" containerID="176199f4ae49edeb3763306087737aba5c5508db640f164ab2baf2ad7198d21a"
Jul 09 02:33:22.488949 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:22.488933    2556 scope.go:117] "RemoveContainer" containerID="176199f4ae49edeb3763306087737aba5c5508db640f164ab2baf2ad7198d21a"
Jul 09 02:33:22.489190 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:33:22.489170    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"176199f4ae49edeb3763306087737aba5c5508db640f164ab2baf2ad7198d21a\": container with ID starting with 176199f4ae49edeb3763306087737aba5c5508db640f164ab2baf2ad7198d21a not found: ID does not exist" containerID="176199f4ae49edeb3763306087737aba5c5508db640f164ab2baf2ad7198d21a"
Jul 09 02:33:22.489240 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:22.489197    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"176199f4ae49edeb3763306087737aba5c5508db640f164ab2baf2ad7198d21a"} err="failed to get container status \"176199f4ae49edeb3763306087737aba5c5508db640f164ab2baf2ad7198d21a\": rpc error: code = NotFound desc = could not find container \"176199f4ae49edeb3763306087737aba5c5508db640f164ab2baf2ad7198d21a\": container with ID starting with 176199f4ae49edeb3763306087737aba5c5508db640f164ab2baf2ad7198d21a not found: ID does not exist"
Jul 09 02:33:22.501223 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:22.501196    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"]
Jul 09 02:33:22.504792 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:22.504767    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-50b65a-6467f8465-8brjw"]
Jul 09 02:33:23.275699 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:23.275665    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5abd3ba1-822f-4196-84fd-e02b6dcdf5ac" path="/var/lib/kubelet/pods/5abd3ba1-822f-4196-84fd-e02b6dcdf5ac/volumes"
Jul 09 02:33:27.343151 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:27.343118    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"]
Jul 09 02:33:27.343630 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:27.343371    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5" podUID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" containerName="istio-proxy" containerID="cri-o://e342be6b96674101e84b72b5c66a048704cfff75c50541e30ae945d0c3f56e6b" gracePeriod=30
Jul 09 02:33:28.720594 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:28.720539    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"]
Jul 09 02:33:28.721033 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:28.720837    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm" podUID="168afa53-7d7f-40ac-9ab4-5f7fa12fed9d" containerName="maas-api" containerID="cri-o://d8486948c716b12759937c6e6b6deb2f1bb2a45e68b01d8bc436703908ea27aa" gracePeriod=30
Jul 09 02:33:28.968809 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:28.968781    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:29.045815 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.045733    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-openshift-service-ca\") pod \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\" (UID: \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\") "
Jul 09 02:33:29.045815 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.045812    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-maas-api-tls\") pod \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\" (UID: \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\") "
Jul 09 02:33:29.045991 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.045849    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbxc4\" (UniqueName: \"kubernetes.io/projected/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-kube-api-access-jbxc4\") pod \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\" (UID: \"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d\") "
Jul 09 02:33:29.046090 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.046069    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "168afa53-7d7f-40ac-9ab4-5f7fa12fed9d" (UID: "168afa53-7d7f-40ac-9ab4-5f7fa12fed9d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:33:29.047911 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.047885    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-kube-api-access-jbxc4" (OuterVolumeSpecName: "kube-api-access-jbxc4") pod "168afa53-7d7f-40ac-9ab4-5f7fa12fed9d" (UID: "168afa53-7d7f-40ac-9ab4-5f7fa12fed9d"). InnerVolumeSpecName "kube-api-access-jbxc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:33:29.048021 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.047972    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "168afa53-7d7f-40ac-9ab4-5f7fa12fed9d" (UID: "168afa53-7d7f-40ac-9ab4-5f7fa12fed9d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:33:29.146736 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.146703    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:29.146736 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.146729    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbxc4\" (UniqueName: \"kubernetes.io/projected/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-kube-api-access-jbxc4\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:29.146954 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.146762    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:29.519377 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.519346    2556 generic.go:356] "Generic (PLEG): container finished" podID="168afa53-7d7f-40ac-9ab4-5f7fa12fed9d" containerID="d8486948c716b12759937c6e6b6deb2f1bb2a45e68b01d8bc436703908ea27aa" exitCode=0
Jul 09 02:33:29.519600 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.519389    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"
Jul 09 02:33:29.519600 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.519432    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm" event={"ID":"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d","Type":"ContainerDied","Data":"d8486948c716b12759937c6e6b6deb2f1bb2a45e68b01d8bc436703908ea27aa"}
Jul 09 02:33:29.519600 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.519486    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm" event={"ID":"168afa53-7d7f-40ac-9ab4-5f7fa12fed9d","Type":"ContainerDied","Data":"5711c4b24fc63371ef1af9e10337025ce134e99e3794778075f4c0d5aa6c29b0"}
Jul 09 02:33:29.519600 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.519517    2556 scope.go:117] "RemoveContainer" containerID="d8486948c716b12759937c6e6b6deb2f1bb2a45e68b01d8bc436703908ea27aa"
Jul 09 02:33:29.528024 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.528006    2556 scope.go:117] "RemoveContainer" containerID="d8486948c716b12759937c6e6b6deb2f1bb2a45e68b01d8bc436703908ea27aa"
Jul 09 02:33:29.528223 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:33:29.528205    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8486948c716b12759937c6e6b6deb2f1bb2a45e68b01d8bc436703908ea27aa\": container with ID starting with d8486948c716b12759937c6e6b6deb2f1bb2a45e68b01d8bc436703908ea27aa not found: ID does not exist" containerID="d8486948c716b12759937c6e6b6deb2f1bb2a45e68b01d8bc436703908ea27aa"
Jul 09 02:33:29.528275 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.528230    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8486948c716b12759937c6e6b6deb2f1bb2a45e68b01d8bc436703908ea27aa"} err="failed to get container status \"d8486948c716b12759937c6e6b6deb2f1bb2a45e68b01d8bc436703908ea27aa\": rpc error: code = NotFound desc = could not find container \"d8486948c716b12759937c6e6b6deb2f1bb2a45e68b01d8bc436703908ea27aa\": container with ID starting with d8486948c716b12759937c6e6b6deb2f1bb2a45e68b01d8bc436703908ea27aa not found: ID does not exist"
Jul 09 02:33:29.535666 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.535643    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"]
Jul 09 02:33:29.539364 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:29.539343    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f9c58b-bbf5458dd-mf9gm"]
Jul 09 02:33:31.273862 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:31.273825    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="168afa53-7d7f-40ac-9ab4-5f7fa12fed9d" path="/var/lib/kubelet/pods/168afa53-7d7f-40ac-9ab4-5f7fa12fed9d/volumes"
Jul 09 02:33:32.539256 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.539226    2556 generic.go:356] "Generic (PLEG): container finished" podID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" containerID="e342be6b96674101e84b72b5c66a048704cfff75c50541e30ae945d0c3f56e6b" exitCode=0
Jul 09 02:33:32.539725 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.539297    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5" event={"ID":"2c8ecba0-f6f9-4144-bc0c-f893b170f097","Type":"ContainerDied","Data":"e342be6b96674101e84b72b5c66a048704cfff75c50541e30ae945d0c3f56e6b"}
Jul 09 02:33:32.539725 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.539360    2556 scope.go:117] "RemoveContainer" containerID="afc9aba15fa4ccf9f61503bdef49c918da2eee57c37f242725e6f0268b65aad8"
Jul 09 02:33:32.597756 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.597733    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:33:32.683690 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.683615    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-envoy\") pod \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") "
Jul 09 02:33:32.683690 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.683649    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-workload-certs\") pod \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") "
Jul 09 02:33:32.683933 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.683703    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-data\") pod \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") "
Jul 09 02:33:32.683933 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.683728    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-podinfo\") pod \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") "
Jul 09 02:33:32.683933 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.683755    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-credential-socket\") pod \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") "
Jul 09 02:33:32.683933 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.683841    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-token\") pod \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") "
Jul 09 02:33:32.683933 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.683901    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9hq4\" (UniqueName: \"kubernetes.io/projected/2c8ecba0-f6f9-4144-bc0c-f893b170f097-kube-api-access-w9hq4\") pod \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") "
Jul 09 02:33:32.684192 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.683957    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istiod-ca-cert\") pod \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") "
Jul 09 02:33:32.684192 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.683985    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-workload-socket\") pod \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\" (UID: \"2c8ecba0-f6f9-4144-bc0c-f893b170f097\") "
Jul 09 02:33:32.684192 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.684170    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c8ecba0-f6f9-4144-bc0c-f893b170f097" (UID: "2c8ecba0-f6f9-4144-bc0c-f893b170f097"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:33:32.684424 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.684399    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c8ecba0-f6f9-4144-bc0c-f893b170f097" (UID: "2c8ecba0-f6f9-4144-bc0c-f893b170f097"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:33:32.684621 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.684382    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c8ecba0-f6f9-4144-bc0c-f893b170f097" (UID: "2c8ecba0-f6f9-4144-bc0c-f893b170f097"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:33:32.684621 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.684573    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c8ecba0-f6f9-4144-bc0c-f893b170f097" (UID: "2c8ecba0-f6f9-4144-bc0c-f893b170f097"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:33:32.684769 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.684738    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c8ecba0-f6f9-4144-bc0c-f893b170f097" (UID: "2c8ecba0-f6f9-4144-bc0c-f893b170f097"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:33:32.684940 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.684922    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-workload-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:32.684940 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.684940    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-credential-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:32.686077 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.686057    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c8ecba0-f6f9-4144-bc0c-f893b170f097" (UID: "2c8ecba0-f6f9-4144-bc0c-f893b170f097"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:33:32.686163 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.686073    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c8ecba0-f6f9-4144-bc0c-f893b170f097" (UID: "2c8ecba0-f6f9-4144-bc0c-f893b170f097"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:33:32.686278 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.686257    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c8ecba0-f6f9-4144-bc0c-f893b170f097" (UID: "2c8ecba0-f6f9-4144-bc0c-f893b170f097"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 02:33:32.686325 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.686300    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c8ecba0-f6f9-4144-bc0c-f893b170f097-kube-api-access-w9hq4" (OuterVolumeSpecName: "kube-api-access-w9hq4") pod "2c8ecba0-f6f9-4144-bc0c-f893b170f097" (UID: "2c8ecba0-f6f9-4144-bc0c-f893b170f097"). InnerVolumeSpecName "kube-api-access-w9hq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:33:32.786038 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.785998    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9hq4\" (UniqueName: \"kubernetes.io/projected/2c8ecba0-f6f9-4144-bc0c-f893b170f097-kube-api-access-w9hq4\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:32.786038 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.786030    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istiod-ca-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:32.786038 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.786042    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-envoy\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:32.786289 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.786056    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-workload-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:32.786289 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.786066    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-data\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:32.786289 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.786076    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-podinfo\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:32.786289 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:32.786086    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c8ecba0-f6f9-4144-bc0c-f893b170f097-istio-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:33:33.545280 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:33.545188    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5" event={"ID":"2c8ecba0-f6f9-4144-bc0c-f893b170f097","Type":"ContainerDied","Data":"408a402fc20b4aae6127fccade11fa05f014b0ec2c7885b299ed128fb1eaea9d"}
Jul 09 02:33:33.545280 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:33.545217    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"
Jul 09 02:33:33.545280 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:33.545250    2556 scope.go:117] "RemoveContainer" containerID="e342be6b96674101e84b72b5c66a048704cfff75c50541e30ae945d0c3f56e6b"
Jul 09 02:33:33.567011 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:33.566975    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"]
Jul 09 02:33:33.570895 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:33.570868    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-50b65a-openshift-default-6bd948fd45-p9zv5"]
Jul 09 02:33:35.188754 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.188722    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"]
Jul 09 02:33:35.189251 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.189097    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5abd3ba1-822f-4196-84fd-e02b6dcdf5ac" containerName="maas-api"
Jul 09 02:33:35.189251 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.189109    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5abd3ba1-822f-4196-84fd-e02b6dcdf5ac" containerName="maas-api"
Jul 09 02:33:35.189251 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.189119    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" containerName="istio-proxy"
Jul 09 02:33:35.189251 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.189125    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" containerName="istio-proxy"
Jul 09 02:33:35.189251 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.189157    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="168afa53-7d7f-40ac-9ab4-5f7fa12fed9d" containerName="maas-api"
Jul 09 02:33:35.189251 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.189163    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="168afa53-7d7f-40ac-9ab4-5f7fa12fed9d" containerName="maas-api"
Jul 09 02:33:35.189251 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.189221    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="168afa53-7d7f-40ac-9ab4-5f7fa12fed9d" containerName="maas-api"
Jul 09 02:33:35.189251 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.189229    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" containerName="istio-proxy"
Jul 09 02:33:35.189251 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.189236    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" containerName="istio-proxy"
Jul 09 02:33:35.189251 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.189244    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5abd3ba1-822f-4196-84fd-e02b6dcdf5ac" containerName="maas-api"
Jul 09 02:33:35.192603 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.192583    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.195195 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.195172    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-7124ed-openshift-default-dockercfg-rwhrl\""
Jul 09 02:33:35.202803 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.202782    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"]
Jul 09 02:33:35.274998 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.274947    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" path="/var/lib/kubelet/pods/2c8ecba0-f6f9-4144-bc0c-f893b170f097/volumes"
Jul 09 02:33:35.312398 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.312366    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-workload-socket\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.312623 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.312415    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-workload-certs\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.312623 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.312445    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-envoy\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.312623 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.312507    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/382dd524-20c3-41b6-a14b-97eb52e8a889-istiod-ca-cert\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.312623 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.312540    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-credential-socket\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.312623 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.312578    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl899\" (UniqueName: \"kubernetes.io/projected/382dd524-20c3-41b6-a14b-97eb52e8a889-kube-api-access-wl899\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.312623 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.312620    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-podinfo\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.312916 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.312666    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-token\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.312916 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.312740    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-data\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.413319 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.413293    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-workload-certs\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.413393 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.413337    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-envoy\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.413393 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.413383    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/382dd524-20c3-41b6-a14b-97eb52e8a889-istiod-ca-cert\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.413499 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.413416    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-credential-socket\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.413499 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.413441    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl899\" (UniqueName: \"kubernetes.io/projected/382dd524-20c3-41b6-a14b-97eb52e8a889-kube-api-access-wl899\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.413499 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.413468    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-podinfo\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.414021 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.413514    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-token\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.414021 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.413597    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-data\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.414021 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.413649    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-workload-socket\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.414021 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.413728    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-workload-certs\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.414021 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.413956    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-workload-socket\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.414282 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.414132    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/382dd524-20c3-41b6-a14b-97eb52e8a889-istiod-ca-cert\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.414341 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.414304    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-data\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.414753 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.414730    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-credential-socket\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.416207 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.416174    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-envoy\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.417186 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.417097    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-podinfo\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.422403 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.422384    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-token\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.422716 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.422544    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl899\" (UniqueName: \"kubernetes.io/projected/382dd524-20c3-41b6-a14b-97eb52e8a889-kube-api-access-wl899\") pod \"e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") " pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.505494 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.505381    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:35.660494 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.660464    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"]
Jul 09 02:33:35.662280 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:33:35.662259    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382dd524_20c3_41b6_a14b_97eb52e8a889.slice/crio-20f63e88dbb2d4bcb6a675ec3b40070020e7abdb76327ae19710aa6eb1cebc9d WatchSource:0}: Error finding container 20f63e88dbb2d4bcb6a675ec3b40070020e7abdb76327ae19710aa6eb1cebc9d: Status 404 returned error can't find the container with id 20f63e88dbb2d4bcb6a675ec3b40070020e7abdb76327ae19710aa6eb1cebc9d
Jul 09 02:33:35.664685 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.664651    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:33:35.664766 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.664721    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:33:35.664766 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:35.664753    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:33:36.565271 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:36.565222    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg" event={"ID":"382dd524-20c3-41b6-a14b-97eb52e8a889","Type":"ContainerStarted","Data":"1de22dea74228c2e0cdbaa7dbc06ee9f3b5f290bc38e75b4c2c91b064bd14701"}
Jul 09 02:33:36.565713 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:36.565317    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg" event={"ID":"382dd524-20c3-41b6-a14b-97eb52e8a889","Type":"ContainerStarted","Data":"20f63e88dbb2d4bcb6a675ec3b40070020e7abdb76327ae19710aa6eb1cebc9d"}
Jul 09 02:33:36.587018 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:36.586963    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg" podStartSLOduration=1.5869458029999999 podStartE2EDuration="1.586945803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:33:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:33:36.5842992 +0000 UTC m=+2041.866223341" watchObservedRunningTime="2026-07-09 02:33:36.586945803 +0000 UTC m=+2041.868869939"
Jul 09 02:33:37.506308 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:37.506274    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:37.510687 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:37.510663    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:37.570487 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:37.570458    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:37.571410 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:37.571391    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:38.514266 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.514225    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"]
Jul 09 02:33:38.514824 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.514801    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" containerName="istio-proxy"
Jul 09 02:33:38.514824 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.514826    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c8ecba0-f6f9-4144-bc0c-f893b170f097" containerName="istio-proxy"
Jul 09 02:33:38.517100 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.517078    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:33:38.519700 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.519676    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-7124ed-serving-cert\""
Jul 09 02:33:38.526855 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.526826    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"]
Jul 09 02:33:38.647640 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.647604    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-maas-api-tls\") pod \"maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw\" (UID: \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:33:38.648026 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.647664    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw\" (UID: \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:33:38.648026 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.647703    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjd7q\" (UniqueName: \"kubernetes.io/projected/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-kube-api-access-sjd7q\") pod \"maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw\" (UID: \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:33:38.749117 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.749072    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw\" (UID: \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:33:38.749327 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.749131    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjd7q\" (UniqueName: \"kubernetes.io/projected/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-kube-api-access-sjd7q\") pod \"maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw\" (UID: \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:33:38.749327 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.749244    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-maas-api-tls\") pod \"maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw\" (UID: \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:33:38.749831 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.749800    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw\" (UID: \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:33:38.751641 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.751623    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-maas-api-tls\") pod \"maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw\" (UID: \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:33:38.756483 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.756466    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjd7q\" (UniqueName: \"kubernetes.io/projected/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-kube-api-access-sjd7q\") pod \"maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw\" (UID: \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:33:38.830670 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.830542    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:33:38.967275 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:38.967239    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"]
Jul 09 02:33:38.969498 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:33:38.969457    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c05f8c0_8be5_4a73_b9c4_4fad1a890978.slice/crio-83eeaa2e20f3ac9ba1883320a136b7d5787e775ba7b78c25e49c09ace639d83e WatchSource:0}: Error finding container 83eeaa2e20f3ac9ba1883320a136b7d5787e775ba7b78c25e49c09ace639d83e: Status 404 returned error can't find the container with id 83eeaa2e20f3ac9ba1883320a136b7d5787e775ba7b78c25e49c09ace639d83e
Jul 09 02:33:39.581764 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:39.581669    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw" event={"ID":"2c05f8c0-8be5-4a73-b9c4-4fad1a890978","Type":"ContainerStarted","Data":"4ed816cf5692c3439ba9dcfe18fa9a8f617e8f6ddb6f8c92a046f6f7fb6b80a5"}
Jul 09 02:33:39.581764 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:39.581723    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw" event={"ID":"2c05f8c0-8be5-4a73-b9c4-4fad1a890978","Type":"ContainerStarted","Data":"83eeaa2e20f3ac9ba1883320a136b7d5787e775ba7b78c25e49c09ace639d83e"}
Jul 09 02:33:39.581956 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:39.581772    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:33:39.597327 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:39.597278    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw" podStartSLOduration=1.268886729 podStartE2EDuration="1.59726175s" totalImagesPullingTime="328.375021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:33:39.596827893 +0000 UTC m=+2044.878752060" watchObservedRunningTime="2026-07-09 02:33:39.59726175 +0000 UTC m=+2044.879185886"
Jul 09 02:33:45.591770 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:45.591739    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:33:46.873072 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:46.873036    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"]
Jul 09 02:33:46.876425 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:46.876405    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:33:46.878978 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:46.878955    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-c6afad-serving-cert\""
Jul 09 02:33:46.885674 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:46.885340    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"]
Jul 09 02:33:46.947139 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:46.947083    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00c76524-f051-4301-87a4-ef2d2acce9a8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4\" (UID: \"00c76524-f051-4301-87a4-ef2d2acce9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:33:46.947347 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:46.947236    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29rsh\" (UniqueName: \"kubernetes.io/projected/00c76524-f051-4301-87a4-ef2d2acce9a8-kube-api-access-29rsh\") pod \"maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4\" (UID: \"00c76524-f051-4301-87a4-ef2d2acce9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:33:46.947347 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:46.947280    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00c76524-f051-4301-87a4-ef2d2acce9a8-maas-api-tls\") pod \"maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4\" (UID: \"00c76524-f051-4301-87a4-ef2d2acce9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:33:47.047886 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:47.047848    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00c76524-f051-4301-87a4-ef2d2acce9a8-maas-api-tls\") pod \"maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4\" (UID: \"00c76524-f051-4301-87a4-ef2d2acce9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:33:47.048204 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:33:47.048024    2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-serving-cert: secret "maas-api-e2e-shared-b-c6afad-serving-cert" not found
Jul 09 02:33:47.048290 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:33:47.048280    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00c76524-f051-4301-87a4-ef2d2acce9a8-maas-api-tls podName:00c76524-f051-4301-87a4-ef2d2acce9a8 nodeName:}" failed. No retries permitted until 2026-07-09 02:33:47.548255625 +0000 UTC m=+2052.830179758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/00c76524-f051-4301-87a4-ef2d2acce9a8-maas-api-tls") pod "maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4" (UID: "00c76524-f051-4301-87a4-ef2d2acce9a8") : secret "maas-api-e2e-shared-b-c6afad-serving-cert" not found
Jul 09 02:33:47.048395 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:47.048373    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00c76524-f051-4301-87a4-ef2d2acce9a8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4\" (UID: \"00c76524-f051-4301-87a4-ef2d2acce9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:33:47.048610 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:47.048590    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29rsh\" (UniqueName: \"kubernetes.io/projected/00c76524-f051-4301-87a4-ef2d2acce9a8-kube-api-access-29rsh\") pod \"maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4\" (UID: \"00c76524-f051-4301-87a4-ef2d2acce9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:33:47.049358 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:47.049331    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00c76524-f051-4301-87a4-ef2d2acce9a8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4\" (UID: \"00c76524-f051-4301-87a4-ef2d2acce9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:33:47.059265 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:47.059239    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29rsh\" (UniqueName: \"kubernetes.io/projected/00c76524-f051-4301-87a4-ef2d2acce9a8-kube-api-access-29rsh\") pod \"maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4\" (UID: \"00c76524-f051-4301-87a4-ef2d2acce9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:33:47.553495 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:47.553460    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00c76524-f051-4301-87a4-ef2d2acce9a8-maas-api-tls\") pod \"maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4\" (UID: \"00c76524-f051-4301-87a4-ef2d2acce9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:33:47.555972 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:47.555953    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00c76524-f051-4301-87a4-ef2d2acce9a8-maas-api-tls\") pod \"maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4\" (UID: \"00c76524-f051-4301-87a4-ef2d2acce9a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:33:47.789745 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:47.789707    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:33:47.978481 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:47.978453    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"]
Jul 09 02:33:47.980492 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:33:47.980464    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c76524_f051_4301_87a4_ef2d2acce9a8.slice/crio-e2d658d15f920315f03248abf648a24f7682733b811642ac6c2257f880f20102 WatchSource:0}: Error finding container e2d658d15f920315f03248abf648a24f7682733b811642ac6c2257f880f20102: Status 404 returned error can't find the container with id e2d658d15f920315f03248abf648a24f7682733b811642ac6c2257f880f20102
Jul 09 02:33:48.636748 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:48.636706    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4" event={"ID":"00c76524-f051-4301-87a4-ef2d2acce9a8","Type":"ContainerStarted","Data":"cc80714513939437ed2fbb30523fe009e3c3f9f6d33405ac3a1c0e0ed42fbfda"}
Jul 09 02:33:48.636972 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:48.636779    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4" event={"ID":"00c76524-f051-4301-87a4-ef2d2acce9a8","Type":"ContainerStarted","Data":"e2d658d15f920315f03248abf648a24f7682733b811642ac6c2257f880f20102"}
Jul 09 02:33:48.637654 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:48.637631    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:33:48.658019 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:48.657966    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4" podStartSLOduration=2.340764466 podStartE2EDuration="2.657950859s" totalImagesPullingTime="317.186393ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 02:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:33:48.656079637 +0000 UTC m=+2053.938003775" watchObservedRunningTime="2026-07-09 02:33:48.657950859 +0000 UTC m=+2053.939875017"
Jul 09 02:33:52.571853 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:52.571818    2556 patch_prober.go:28] interesting pod/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 09 02:33:52.572285 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:52.571889    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg" podUID="382dd524-20c3-41b6-a14b-97eb52e8a889" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 09 02:33:52.661848 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:52.661814    2556 generic.go:356] "Generic (PLEG): container finished" podID="382dd524-20c3-41b6-a14b-97eb52e8a889" containerID="1de22dea74228c2e0cdbaa7dbc06ee9f3b5f290bc38e75b4c2c91b064bd14701" exitCode=0
Jul 09 02:33:52.662032 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:52.661892    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg" event={"ID":"382dd524-20c3-41b6-a14b-97eb52e8a889","Type":"ContainerDied","Data":"1de22dea74228c2e0cdbaa7dbc06ee9f3b5f290bc38e75b4c2c91b064bd14701"}
Jul 09 02:33:52.662309 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:52.662294    2556 scope.go:117] "RemoveContainer" containerID="1de22dea74228c2e0cdbaa7dbc06ee9f3b5f290bc38e75b4c2c91b064bd14701"
Jul 09 02:33:52.663311 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:52.663285    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:33:52.663365 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:52.663356    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:33:52.663401 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:52.663387    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 02:33:53.669110 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:53.669075    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg" event={"ID":"382dd524-20c3-41b6-a14b-97eb52e8a889","Type":"ContainerStarted","Data":"a436f1a11b1620d21c5429dde9d6dc39372816e7824389d32ad15b86958f988c"}
Jul 09 02:33:54.505823 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:54.505786    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:54.506072 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:54.506049    2556 patch_prober.go:28] interesting pod/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 09 02:33:54.506160 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:54.506105    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg" podUID="382dd524-20c3-41b6-a14b-97eb52e8a889" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 09 02:33:55.506723 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:55.506684    2556 patch_prober.go:28] interesting pod/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 09 02:33:55.507134 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:55.506742    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg" podUID="382dd524-20c3-41b6-a14b-97eb52e8a889" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 09 02:33:55.655063 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:55.655035    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:33:56.506519 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:56.506481    2556 patch_prober.go:28] interesting pod/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 09 02:33:56.506732 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:56.506534    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg" podUID="382dd524-20c3-41b6-a14b-97eb52e8a889" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 09 02:33:57.505882 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:57.505794    2556 patch_prober.go:28] interesting pod/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 09 02:33:57.505882 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:57.505859    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg" podUID="382dd524-20c3-41b6-a14b-97eb52e8a889" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 09 02:33:58.509651 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:58.509622    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:58.510114 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:58.510097    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:33:58.510840 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:33:58.510820    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:39:55.731654 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:55.731617    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"]
Jul 09 02:39:55.732166 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:55.731870    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw" podUID="2c05f8c0-8be5-4a73-b9c4-4fad1a890978" containerName="maas-api" containerID="cri-o://4ed816cf5692c3439ba9dcfe18fa9a8f617e8f6ddb6f8c92a046f6f7fb6b80a5" gracePeriod=30
Jul 09 02:39:55.981271 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:55.981244    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:39:56.130793 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.130763    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjd7q\" (UniqueName: \"kubernetes.io/projected/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-kube-api-access-sjd7q\") pod \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\" (UID: \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\") "
Jul 09 02:39:56.130969 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.130819    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-maas-api-tls\") pod \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\" (UID: \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\") "
Jul 09 02:39:56.130969 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.130866    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-openshift-service-ca\") pod \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\" (UID: \"2c05f8c0-8be5-4a73-b9c4-4fad1a890978\") "
Jul 09 02:39:56.131313 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.131276    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2c05f8c0-8be5-4a73-b9c4-4fad1a890978" (UID: "2c05f8c0-8be5-4a73-b9c4-4fad1a890978"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:39:56.132872 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.132845    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-kube-api-access-sjd7q" (OuterVolumeSpecName: "kube-api-access-sjd7q") pod "2c05f8c0-8be5-4a73-b9c4-4fad1a890978" (UID: "2c05f8c0-8be5-4a73-b9c4-4fad1a890978"). InnerVolumeSpecName "kube-api-access-sjd7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:39:56.132958 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.132877    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2c05f8c0-8be5-4a73-b9c4-4fad1a890978" (UID: "2c05f8c0-8be5-4a73-b9c4-4fad1a890978"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:39:56.232245 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.232210    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjd7q\" (UniqueName: \"kubernetes.io/projected/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-kube-api-access-sjd7q\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:39:56.232245 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.232237    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:39:56.232245 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.232247    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c05f8c0-8be5-4a73-b9c4-4fad1a890978-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:39:56.540417 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.540332    2556 generic.go:356] "Generic (PLEG): container finished" podID="2c05f8c0-8be5-4a73-b9c4-4fad1a890978" containerID="4ed816cf5692c3439ba9dcfe18fa9a8f617e8f6ddb6f8c92a046f6f7fb6b80a5" exitCode=0
Jul 09 02:39:56.540417 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.540381    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"
Jul 09 02:39:56.540417 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.540400    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw" event={"ID":"2c05f8c0-8be5-4a73-b9c4-4fad1a890978","Type":"ContainerDied","Data":"4ed816cf5692c3439ba9dcfe18fa9a8f617e8f6ddb6f8c92a046f6f7fb6b80a5"}
Jul 09 02:39:56.540668 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.540451    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw" event={"ID":"2c05f8c0-8be5-4a73-b9c4-4fad1a890978","Type":"ContainerDied","Data":"83eeaa2e20f3ac9ba1883320a136b7d5787e775ba7b78c25e49c09ace639d83e"}
Jul 09 02:39:56.540668 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.540481    2556 scope.go:117] "RemoveContainer" containerID="4ed816cf5692c3439ba9dcfe18fa9a8f617e8f6ddb6f8c92a046f6f7fb6b80a5"
Jul 09 02:39:56.549654 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.549637    2556 scope.go:117] "RemoveContainer" containerID="4ed816cf5692c3439ba9dcfe18fa9a8f617e8f6ddb6f8c92a046f6f7fb6b80a5"
Jul 09 02:39:56.549899 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:39:56.549878    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ed816cf5692c3439ba9dcfe18fa9a8f617e8f6ddb6f8c92a046f6f7fb6b80a5\": container with ID starting with 4ed816cf5692c3439ba9dcfe18fa9a8f617e8f6ddb6f8c92a046f6f7fb6b80a5 not found: ID does not exist" containerID="4ed816cf5692c3439ba9dcfe18fa9a8f617e8f6ddb6f8c92a046f6f7fb6b80a5"
Jul 09 02:39:56.549971 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.549907    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed816cf5692c3439ba9dcfe18fa9a8f617e8f6ddb6f8c92a046f6f7fb6b80a5"} err="failed to get container status \"4ed816cf5692c3439ba9dcfe18fa9a8f617e8f6ddb6f8c92a046f6f7fb6b80a5\": rpc error: code = NotFound desc = could not find container \"4ed816cf5692c3439ba9dcfe18fa9a8f617e8f6ddb6f8c92a046f6f7fb6b80a5\": container with ID starting with 4ed816cf5692c3439ba9dcfe18fa9a8f617e8f6ddb6f8c92a046f6f7fb6b80a5 not found: ID does not exist"
Jul 09 02:39:56.561417 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.561393    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"]
Jul 09 02:39:56.564624 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:56.564600    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7124ed-bcfcb694-jrfnw"]
Jul 09 02:39:57.274213 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:39:57.274139    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c05f8c0-8be5-4a73-b9c4-4fad1a890978" path="/var/lib/kubelet/pods/2c05f8c0-8be5-4a73-b9c4-4fad1a890978/volumes"
Jul 09 02:40:01.921647 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:01.921613    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"]
Jul 09 02:40:01.922095 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:01.921852    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg" podUID="382dd524-20c3-41b6-a14b-97eb52e8a889" containerName="istio-proxy" containerID="cri-o://a436f1a11b1620d21c5429dde9d6dc39372816e7824389d32ad15b86958f988c" gracePeriod=30
Jul 09 02:40:02.897455 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:02.897421    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"]
Jul 09 02:40:02.897715 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:02.897688    2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4" podUID="00c76524-f051-4301-87a4-ef2d2acce9a8" containerName="maas-api" containerID="cri-o://cc80714513939437ed2fbb30523fe009e3c3f9f6d33405ac3a1c0e0ed42fbfda" gracePeriod=30
Jul 09 02:40:03.153868 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.153793    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:40:03.302765 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.302729    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00c76524-f051-4301-87a4-ef2d2acce9a8-openshift-service-ca\") pod \"00c76524-f051-4301-87a4-ef2d2acce9a8\" (UID: \"00c76524-f051-4301-87a4-ef2d2acce9a8\") "
Jul 09 02:40:03.302959 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.302790    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29rsh\" (UniqueName: \"kubernetes.io/projected/00c76524-f051-4301-87a4-ef2d2acce9a8-kube-api-access-29rsh\") pod \"00c76524-f051-4301-87a4-ef2d2acce9a8\" (UID: \"00c76524-f051-4301-87a4-ef2d2acce9a8\") "
Jul 09 02:40:03.302959 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.302912    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00c76524-f051-4301-87a4-ef2d2acce9a8-maas-api-tls\") pod \"00c76524-f051-4301-87a4-ef2d2acce9a8\" (UID: \"00c76524-f051-4301-87a4-ef2d2acce9a8\") "
Jul 09 02:40:03.303122 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.303098    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00c76524-f051-4301-87a4-ef2d2acce9a8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "00c76524-f051-4301-87a4-ef2d2acce9a8" (UID: "00c76524-f051-4301-87a4-ef2d2acce9a8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:40:03.303215 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.303200    2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00c76524-f051-4301-87a4-ef2d2acce9a8-openshift-service-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:40:03.304877 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.304855    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00c76524-f051-4301-87a4-ef2d2acce9a8-kube-api-access-29rsh" (OuterVolumeSpecName: "kube-api-access-29rsh") pod "00c76524-f051-4301-87a4-ef2d2acce9a8" (UID: "00c76524-f051-4301-87a4-ef2d2acce9a8"). InnerVolumeSpecName "kube-api-access-29rsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:40:03.304938 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.304926    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00c76524-f051-4301-87a4-ef2d2acce9a8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "00c76524-f051-4301-87a4-ef2d2acce9a8" (UID: "00c76524-f051-4301-87a4-ef2d2acce9a8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 02:40:03.404496 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.404381    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29rsh\" (UniqueName: \"kubernetes.io/projected/00c76524-f051-4301-87a4-ef2d2acce9a8-kube-api-access-29rsh\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:40:03.404496 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.404414    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00c76524-f051-4301-87a4-ef2d2acce9a8-maas-api-tls\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:40:03.578851 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.578813    2556 generic.go:356] "Generic (PLEG): container finished" podID="00c76524-f051-4301-87a4-ef2d2acce9a8" containerID="cc80714513939437ed2fbb30523fe009e3c3f9f6d33405ac3a1c0e0ed42fbfda" exitCode=0
Jul 09 02:40:03.579030 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.578861    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"
Jul 09 02:40:03.579030 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.578894    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4" event={"ID":"00c76524-f051-4301-87a4-ef2d2acce9a8","Type":"ContainerDied","Data":"cc80714513939437ed2fbb30523fe009e3c3f9f6d33405ac3a1c0e0ed42fbfda"}
Jul 09 02:40:03.579030 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.578950    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4" event={"ID":"00c76524-f051-4301-87a4-ef2d2acce9a8","Type":"ContainerDied","Data":"e2d658d15f920315f03248abf648a24f7682733b811642ac6c2257f880f20102"}
Jul 09 02:40:03.579030 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.578974    2556 scope.go:117] "RemoveContainer" containerID="cc80714513939437ed2fbb30523fe009e3c3f9f6d33405ac3a1c0e0ed42fbfda"
Jul 09 02:40:03.588355 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.588327    2556 scope.go:117] "RemoveContainer" containerID="cc80714513939437ed2fbb30523fe009e3c3f9f6d33405ac3a1c0e0ed42fbfda"
Jul 09 02:40:03.588595 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:40:03.588577    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc80714513939437ed2fbb30523fe009e3c3f9f6d33405ac3a1c0e0ed42fbfda\": container with ID starting with cc80714513939437ed2fbb30523fe009e3c3f9f6d33405ac3a1c0e0ed42fbfda not found: ID does not exist" containerID="cc80714513939437ed2fbb30523fe009e3c3f9f6d33405ac3a1c0e0ed42fbfda"
Jul 09 02:40:03.588651 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.588602    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc80714513939437ed2fbb30523fe009e3c3f9f6d33405ac3a1c0e0ed42fbfda"} err="failed to get container status \"cc80714513939437ed2fbb30523fe009e3c3f9f6d33405ac3a1c0e0ed42fbfda\": rpc error: code = NotFound desc = could not find container \"cc80714513939437ed2fbb30523fe009e3c3f9f6d33405ac3a1c0e0ed42fbfda\": container with ID starting with cc80714513939437ed2fbb30523fe009e3c3f9f6d33405ac3a1c0e0ed42fbfda not found: ID does not exist"
Jul 09 02:40:03.603035 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.603012    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"]
Jul 09 02:40:03.605429 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:03.605399    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-c6afad-8575dbf4f9-49nd4"]
Jul 09 02:40:05.276148 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:05.276113    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00c76524-f051-4301-87a4-ef2d2acce9a8" path="/var/lib/kubelet/pods/00c76524-f051-4301-87a4-ef2d2acce9a8/volumes"
Jul 09 02:40:07.185488 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.185422    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:40:07.341480 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.341442    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-podinfo\") pod \"382dd524-20c3-41b6-a14b-97eb52e8a889\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") "
Jul 09 02:40:07.341480 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.341484    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-credential-socket\") pod \"382dd524-20c3-41b6-a14b-97eb52e8a889\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") "
Jul 09 02:40:07.341737 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.341528    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-workload-certs\") pod \"382dd524-20c3-41b6-a14b-97eb52e8a889\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") "
Jul 09 02:40:07.341737 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.341651    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-token\") pod \"382dd524-20c3-41b6-a14b-97eb52e8a889\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") "
Jul 09 02:40:07.341737 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.341690    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-workload-socket\") pod \"382dd524-20c3-41b6-a14b-97eb52e8a889\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") "
Jul 09 02:40:07.341737 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.341722    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/382dd524-20c3-41b6-a14b-97eb52e8a889-istiod-ca-cert\") pod \"382dd524-20c3-41b6-a14b-97eb52e8a889\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") "
Jul 09 02:40:07.341926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.341767    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-data\") pod \"382dd524-20c3-41b6-a14b-97eb52e8a889\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") "
Jul 09 02:40:07.341926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.341788    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "382dd524-20c3-41b6-a14b-97eb52e8a889" (UID: "382dd524-20c3-41b6-a14b-97eb52e8a889"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:40:07.341926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.341856    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wl899\" (UniqueName: \"kubernetes.io/projected/382dd524-20c3-41b6-a14b-97eb52e8a889-kube-api-access-wl899\") pod \"382dd524-20c3-41b6-a14b-97eb52e8a889\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") "
Jul 09 02:40:07.341926 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.341900    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-envoy\") pod \"382dd524-20c3-41b6-a14b-97eb52e8a889\" (UID: \"382dd524-20c3-41b6-a14b-97eb52e8a889\") "
Jul 09 02:40:07.342147 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.341952    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "382dd524-20c3-41b6-a14b-97eb52e8a889" (UID: "382dd524-20c3-41b6-a14b-97eb52e8a889"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:40:07.342147 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.341962    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "382dd524-20c3-41b6-a14b-97eb52e8a889" (UID: "382dd524-20c3-41b6-a14b-97eb52e8a889"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:40:07.342262 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.342162    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382dd524-20c3-41b6-a14b-97eb52e8a889-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "382dd524-20c3-41b6-a14b-97eb52e8a889" (UID: "382dd524-20c3-41b6-a14b-97eb52e8a889"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 02:40:07.342262 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.342236    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-credential-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:40:07.342262 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.342255    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-workload-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:40:07.342416 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.342270    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-workload-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:40:07.342416 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.342282    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/382dd524-20c3-41b6-a14b-97eb52e8a889-istiod-ca-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:40:07.342778 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.342755    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-data" (OuterVolumeSpecName: "istio-data") pod "382dd524-20c3-41b6-a14b-97eb52e8a889" (UID: "382dd524-20c3-41b6-a14b-97eb52e8a889"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:40:07.343888 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.343866    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-token" (OuterVolumeSpecName: "istio-token") pod "382dd524-20c3-41b6-a14b-97eb52e8a889" (UID: "382dd524-20c3-41b6-a14b-97eb52e8a889"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:40:07.344049 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.344029    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/382dd524-20c3-41b6-a14b-97eb52e8a889-kube-api-access-wl899" (OuterVolumeSpecName: "kube-api-access-wl899") pod "382dd524-20c3-41b6-a14b-97eb52e8a889" (UID: "382dd524-20c3-41b6-a14b-97eb52e8a889"). InnerVolumeSpecName "kube-api-access-wl899". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 02:40:07.344317 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.344294    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "382dd524-20c3-41b6-a14b-97eb52e8a889" (UID: "382dd524-20c3-41b6-a14b-97eb52e8a889"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 02:40:07.344317 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.344296    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "382dd524-20c3-41b6-a14b-97eb52e8a889" (UID: "382dd524-20c3-41b6-a14b-97eb52e8a889"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 02:40:07.443119 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.443037    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-envoy\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:40:07.443119 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.443070    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-podinfo\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:40:07.443119 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.443082    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:40:07.443119 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.443090    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/382dd524-20c3-41b6-a14b-97eb52e8a889-istio-data\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:40:07.443119 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.443098    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wl899\" (UniqueName: \"kubernetes.io/projected/382dd524-20c3-41b6-a14b-97eb52e8a889-kube-api-access-wl899\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\""
Jul 09 02:40:07.601842 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.601809    2556 generic.go:356] "Generic (PLEG): container finished" podID="382dd524-20c3-41b6-a14b-97eb52e8a889" containerID="a436f1a11b1620d21c5429dde9d6dc39372816e7824389d32ad15b86958f988c" exitCode=0
Jul 09 02:40:07.602046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.601860    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg" event={"ID":"382dd524-20c3-41b6-a14b-97eb52e8a889","Type":"ContainerDied","Data":"a436f1a11b1620d21c5429dde9d6dc39372816e7824389d32ad15b86958f988c"}
Jul 09 02:40:07.602046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.601863    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"
Jul 09 02:40:07.602046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.601902    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg" event={"ID":"382dd524-20c3-41b6-a14b-97eb52e8a889","Type":"ContainerDied","Data":"20f63e88dbb2d4bcb6a675ec3b40070020e7abdb76327ae19710aa6eb1cebc9d"}
Jul 09 02:40:07.602046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.601924    2556 scope.go:117] "RemoveContainer" containerID="a436f1a11b1620d21c5429dde9d6dc39372816e7824389d32ad15b86958f988c"
Jul 09 02:40:07.611013 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.610991    2556 scope.go:117] "RemoveContainer" containerID="1de22dea74228c2e0cdbaa7dbc06ee9f3b5f290bc38e75b4c2c91b064bd14701"
Jul 09 02:40:07.618893 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.618875    2556 scope.go:117] "RemoveContainer" containerID="a436f1a11b1620d21c5429dde9d6dc39372816e7824389d32ad15b86958f988c"
Jul 09 02:40:07.619124 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:40:07.619108    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a436f1a11b1620d21c5429dde9d6dc39372816e7824389d32ad15b86958f988c\": container with ID starting with a436f1a11b1620d21c5429dde9d6dc39372816e7824389d32ad15b86958f988c not found: ID does not exist" containerID="a436f1a11b1620d21c5429dde9d6dc39372816e7824389d32ad15b86958f988c"
Jul 09 02:40:07.619179 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.619131    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a436f1a11b1620d21c5429dde9d6dc39372816e7824389d32ad15b86958f988c"} err="failed to get container status \"a436f1a11b1620d21c5429dde9d6dc39372816e7824389d32ad15b86958f988c\": rpc error: code = NotFound desc = could not find container \"a436f1a11b1620d21c5429dde9d6dc39372816e7824389d32ad15b86958f988c\": container with ID starting with a436f1a11b1620d21c5429dde9d6dc39372816e7824389d32ad15b86958f988c not found: ID does not exist"
Jul 09 02:40:07.619179 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.619146    2556 scope.go:117] "RemoveContainer" containerID="1de22dea74228c2e0cdbaa7dbc06ee9f3b5f290bc38e75b4c2c91b064bd14701"
Jul 09 02:40:07.619335 ip-10-0-137-63 kubenswrapper[2556]: E0709 02:40:07.619321    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1de22dea74228c2e0cdbaa7dbc06ee9f3b5f290bc38e75b4c2c91b064bd14701\": container with ID starting with 1de22dea74228c2e0cdbaa7dbc06ee9f3b5f290bc38e75b4c2c91b064bd14701 not found: ID does not exist" containerID="1de22dea74228c2e0cdbaa7dbc06ee9f3b5f290bc38e75b4c2c91b064bd14701"
Jul 09 02:40:07.619375 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.619338    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1de22dea74228c2e0cdbaa7dbc06ee9f3b5f290bc38e75b4c2c91b064bd14701"} err="failed to get container status \"1de22dea74228c2e0cdbaa7dbc06ee9f3b5f290bc38e75b4c2c91b064bd14701\": rpc error: code = NotFound desc = could not find container \"1de22dea74228c2e0cdbaa7dbc06ee9f3b5f290bc38e75b4c2c91b064bd14701\": container with ID starting with 1de22dea74228c2e0cdbaa7dbc06ee9f3b5f290bc38e75b4c2c91b064bd14701 not found: ID does not exist"
Jul 09 02:40:07.623272 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.623249    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"]
Jul 09 02:40:07.626525 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:07.626502    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-7124ed-openshift-default-b99c9bd75-2gsmg"]
Jul 09 02:40:09.274657 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:09.274627    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="382dd524-20c3-41b6-a14b-97eb52e8a889" path="/var/lib/kubelet/pods/382dd524-20c3-41b6-a14b-97eb52e8a889/volumes"
Jul 09 02:40:14.931819 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:14.931791    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8687897cbb-5lzn4_d3a14dcc-179f-438e-9d48-f49e959d7277/copy-manifests/0.log"
Jul 09 02:40:14.943202 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:14.943179    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8687897cbb-5lzn4_d3a14dcc-179f-438e-9d48-f49e959d7277/manager/0.log"
Jul 09 02:40:15.538171 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:15.538141    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7f86449945-8jpts_b237646f-3c91-43b9-b76d-3f4fd0fd11e7/maas-api/0.log"
Jul 09 02:40:18.057344 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:18.057310    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678bssp5_50ad9c72-0351-43cf-b577-e9a3549dc67b/istio-proxy/0.log"
Jul 09 02:40:18.172604 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:18.172568    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-thpdr_d59ae476-dd75-42a5-a785-c0bee6d44c6f/discovery/0.log"
Jul 09 02:40:18.506828 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:18.506796    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-55h66_58e0bd42-2798-4fe1-a334-482e039808cc/istio-proxy/1.log"
Jul 09 02:40:18.621013 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:18.620981    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-lkk9d_9a592784-f207-437c-84b1-be5cc052fd75/payload-pre-processing/0.log"
Jul 09 02:40:19.288050 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:19.288025    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-tnbf8_69c7d19b-8902-4133-a6cf-2d59a620e6b1/main/0.log"
Jul 09 02:40:19.619515 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:19.619489    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-l74nf_37b859a9-1f3b-4093-89d3-ece3be682d6a/main/0.log"
Jul 09 02:40:26.553008 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:26.552979    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kx7tj_3049ceb1-0ae0-4e5f-8d1d-45ac6f563386/global-pull-secret-syncer/0.log"
Jul 09 02:40:26.707853 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:26.707818    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xfjj5_60d831a1-0634-4162-b4b6-1d46fcfda618/konnectivity-agent/0.log"
Jul 09 02:40:26.768204 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:26.768175    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-63.ec2.internal_44a0ff02708f1add4213dce3a52f0ee3/haproxy/0.log"
Jul 09 02:40:33.517141 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:33.517107    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c58805f6-bebf-4bcf-a49e-3998415d5330/alertmanager/0.log"
Jul 09 02:40:33.541886 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:33.541856    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c58805f6-bebf-4bcf-a49e-3998415d5330/config-reloader/0.log"
Jul 09 02:40:33.560911 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:33.560888    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c58805f6-bebf-4bcf-a49e-3998415d5330/kube-rbac-proxy-web/0.log"
Jul 09 02:40:33.579849 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:33.579832    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c58805f6-bebf-4bcf-a49e-3998415d5330/kube-rbac-proxy/0.log"
Jul 09 02:40:33.599599 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:33.599582    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c58805f6-bebf-4bcf-a49e-3998415d5330/kube-rbac-proxy-metric/0.log"
Jul 09 02:40:33.618053 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:33.618036    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c58805f6-bebf-4bcf-a49e-3998415d5330/prom-label-proxy/0.log"
Jul 09 02:40:33.636592 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:33.636575    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c58805f6-bebf-4bcf-a49e-3998415d5330/init-config-reloader/0.log"
Jul 09 02:40:33.718345 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:33.718319    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-7dxm8_11575dbe-9ff5-4271-bd76-561d2db6f387/kube-state-metrics/0.log"
Jul 09 02:40:33.742593 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:33.742551    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-7dxm8_11575dbe-9ff5-4271-bd76-561d2db6f387/kube-rbac-proxy-main/0.log"
Jul 09 02:40:33.761508 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:33.761489    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-7dxm8_11575dbe-9ff5-4271-bd76-561d2db6f387/kube-rbac-proxy-self/0.log"
Jul 09 02:40:33.825434 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:33.825366    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-7m8rg_444cf910-f6a2-498e-9f57-b787add9e855/monitoring-plugin/0.log"
Jul 09 02:40:33.965113 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:33.965080    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jrllw_f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d/node-exporter/0.log"
Jul 09 02:40:33.986642 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:33.986605    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jrllw_f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d/kube-rbac-proxy/0.log"
Jul 09 02:40:34.005128 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.005106    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jrllw_f0c52d6d-d4b9-412c-8dfd-8e98bc62c57d/init-textfile/0.log"
Jul 09 02:40:34.113305 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.113282    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4nrn9_32112530-ebb1-435c-924e-e865950db0b3/kube-rbac-proxy-main/0.log"
Jul 09 02:40:34.134463 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.134440    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4nrn9_32112530-ebb1-435c-924e-e865950db0b3/kube-rbac-proxy-self/0.log"
Jul 09 02:40:34.167429 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.167394    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4nrn9_32112530-ebb1-435c-924e-e865950db0b3/openshift-state-metrics/0.log"
Jul 09 02:40:34.368456 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.368382    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-x6p6j_61248a7f-8cb6-45ab-b423-4e09afcc0243/prometheus-operator/0.log"
Jul 09 02:40:34.385370 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.385338    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-x6p6j_61248a7f-8cb6-45ab-b423-4e09afcc0243/kube-rbac-proxy/0.log"
Jul 09 02:40:34.496468 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.496435    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84b7586788-c9bqt_e0269e02-ad16-4ce0-9d6f-d50ca3d0b188/telemeter-client/0.log"
Jul 09 02:40:34.543751 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.543724    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84b7586788-c9bqt_e0269e02-ad16-4ce0-9d6f-d50ca3d0b188/reload/0.log"
Jul 09 02:40:34.569705 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.569682    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84b7586788-c9bqt_e0269e02-ad16-4ce0-9d6f-d50ca3d0b188/kube-rbac-proxy/0.log"
Jul 09 02:40:34.607509 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.607481    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54b8b56c8c-dfswm_78ae7b93-903d-4eaa-89e6-42fce22ff8cb/thanos-query/0.log"
Jul 09 02:40:34.626445 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.626379    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54b8b56c8c-dfswm_78ae7b93-903d-4eaa-89e6-42fce22ff8cb/kube-rbac-proxy-web/0.log"
Jul 09 02:40:34.646667 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.646645    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54b8b56c8c-dfswm_78ae7b93-903d-4eaa-89e6-42fce22ff8cb/kube-rbac-proxy/0.log"
Jul 09 02:40:34.664941 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.664915    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54b8b56c8c-dfswm_78ae7b93-903d-4eaa-89e6-42fce22ff8cb/prom-label-proxy/0.log"
Jul 09 02:40:34.683400 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.683377    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54b8b56c8c-dfswm_78ae7b93-903d-4eaa-89e6-42fce22ff8cb/kube-rbac-proxy-rules/0.log"
Jul 09 02:40:34.701438 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:34.701417    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54b8b56c8c-dfswm_78ae7b93-903d-4eaa-89e6-42fce22ff8cb/kube-rbac-proxy-metrics/0.log"
Jul 09 02:40:36.801431 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.801399    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"]
Jul 09 02:40:36.801833 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.801820    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c05f8c0-8be5-4a73-b9c4-4fad1a890978" containerName="maas-api"
Jul 09 02:40:36.801885 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.801835    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c05f8c0-8be5-4a73-b9c4-4fad1a890978" containerName="maas-api"
Jul 09 02:40:36.801885 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.801852    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00c76524-f051-4301-87a4-ef2d2acce9a8" containerName="maas-api"
Jul 09 02:40:36.801885 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.801857    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="00c76524-f051-4301-87a4-ef2d2acce9a8" containerName="maas-api"
Jul 09 02:40:36.801885 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.801876    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="382dd524-20c3-41b6-a14b-97eb52e8a889" containerName="istio-proxy"
Jul 09 02:40:36.801885 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.801881    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="382dd524-20c3-41b6-a14b-97eb52e8a889" containerName="istio-proxy"
Jul 09 02:40:36.802046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.801891    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="382dd524-20c3-41b6-a14b-97eb52e8a889" containerName="istio-proxy"
Jul 09 02:40:36.802046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.801897    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="382dd524-20c3-41b6-a14b-97eb52e8a889" containerName="istio-proxy"
Jul 09 02:40:36.802046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.801955    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="382dd524-20c3-41b6-a14b-97eb52e8a889" containerName="istio-proxy"
Jul 09 02:40:36.802046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.801965    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c05f8c0-8be5-4a73-b9c4-4fad1a890978" containerName="maas-api"
Jul 09 02:40:36.802046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.801971    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="00c76524-f051-4301-87a4-ef2d2acce9a8" containerName="maas-api"
Jul 09 02:40:36.804755 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.804739    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:36.807023 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.806999    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lshzb\"/\"openshift-service-ca.crt\""
Jul 09 02:40:36.807156 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.807074    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lshzb\"/\"default-dockercfg-mbz6n\""
Jul 09 02:40:36.808200 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.808179    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lshzb\"/\"kube-root-ca.crt\""
Jul 09 02:40:36.813728 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.813707    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"]
Jul 09 02:40:36.926096 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.926063    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-lib-modules\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:36.926096 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.926103    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-proc\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:36.926357 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.926210    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhpfn\" (UniqueName: \"kubernetes.io/projected/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-kube-api-access-rhpfn\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:36.926357 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.926254    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-podres\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:36.926357 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:36.926333    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-sys\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:37.027035 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.027000    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhpfn\" (UniqueName: \"kubernetes.io/projected/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-kube-api-access-rhpfn\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:37.027183 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.027058    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-podres\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:37.027183 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.027086    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-sys\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:37.027183 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.027106    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-lib-modules\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:37.027183 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.027139    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-proc\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:37.027389 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.027212    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-sys\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:37.027389 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.027234    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-proc\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:37.027389 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.027259    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-lib-modules\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:37.027389 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.027263    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-podres\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:37.034546 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.034518    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhpfn\" (UniqueName: \"kubernetes.io/projected/8748b9e2-fe7c-4923-9ae2-50051d4a06f5-kube-api-access-rhpfn\") pod \"perf-node-gather-daemonset-9k7d5\" (UID: \"8748b9e2-fe7c-4923-9ae2-50051d4a06f5\") " pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:37.117780 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.117751    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:37.249440 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.249417    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"]
Jul 09 02:40:37.251743 ip-10-0-137-63 kubenswrapper[2556]: W0709 02:40:37.251704    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8748b9e2_fe7c_4923_9ae2_50051d4a06f5.slice/crio-4e2c91149ec2e89b6a4e51317deade1433a24811c71d0ba2c9f3610622cbdcee WatchSource:0}: Error finding container 4e2c91149ec2e89b6a4e51317deade1433a24811c71d0ba2c9f3610622cbdcee: Status 404 returned error can't find the container with id 4e2c91149ec2e89b6a4e51317deade1433a24811c71d0ba2c9f3610622cbdcee
Jul 09 02:40:37.750101 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.750064    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5" event={"ID":"8748b9e2-fe7c-4923-9ae2-50051d4a06f5","Type":"ContainerStarted","Data":"aa64b9cdcbd8effdf1737c2555d16e27e13dd6d5747f888bd6c62c27695e9a8c"}
Jul 09 02:40:37.750329 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.750120    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5" event={"ID":"8748b9e2-fe7c-4923-9ae2-50051d4a06f5","Type":"ContainerStarted","Data":"4e2c91149ec2e89b6a4e51317deade1433a24811c71d0ba2c9f3610622cbdcee"}
Jul 09 02:40:37.750329 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.750141    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:37.767504 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:37.767400    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5" podStartSLOduration=1.767382885 podStartE2EDuration="1.767382885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 02:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 02:40:37.765225734 +0000 UTC m=+2463.047149871" watchObservedRunningTime="2026-07-09 02:40:37.767382885 +0000 UTC m=+2463.049307021"
Jul 09 02:40:38.612226 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:38.612199    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-78qpz_ae01695f-2f46-422a-b1e4-f37db3b443a4/dns/0.log"
Jul 09 02:40:38.629890 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:38.629862    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-78qpz_ae01695f-2f46-422a-b1e4-f37db3b443a4/kube-rbac-proxy/0.log"
Jul 09 02:40:38.689430 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:38.689395    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n74tj_40d9177f-2d6a-4990-b8ac-417ee517ff36/dns-node-resolver/0.log"
Jul 09 02:40:39.226249 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:39.226221    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cdpsd_64da29d7-e098-4a7e-ac29-f6e3ce5351ef/node-ca/0.log"
Jul 09 02:40:40.147616 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:40.147585    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678bssp5_50ad9c72-0351-43cf-b577-e9a3549dc67b/istio-proxy/0.log"
Jul 09 02:40:40.252254 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:40.252217    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-thpdr_d59ae476-dd75-42a5-a785-c0bee6d44c6f/discovery/0.log"
Jul 09 02:40:40.323041 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:40.323000    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-55h66_58e0bd42-2798-4fe1-a334-482e039808cc/istio-proxy/0.log"
Jul 09 02:40:40.351091 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:40.351065    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-55h66_58e0bd42-2798-4fe1-a334-482e039808cc/istio-proxy/1.log"
Jul 09 02:40:40.388461 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:40.388421    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-lkk9d_9a592784-f207-437c-84b1-be5cc052fd75/payload-pre-processing/0.log"
Jul 09 02:40:41.108046 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:41.108017    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c2zmt_4e9eb0f3-26c6-4d68-83ab-7995d58ca644/serve-healthcheck-canary/0.log"
Jul 09 02:40:41.588230 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:41.588140    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gkckl_317fcb0a-ceea-4776-946e-e49985272b65/kube-rbac-proxy/0.log"
Jul 09 02:40:41.605813 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:41.605788    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gkckl_317fcb0a-ceea-4776-946e-e49985272b65/exporter/0.log"
Jul 09 02:40:41.624320 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:41.624293    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gkckl_317fcb0a-ceea-4776-946e-e49985272b65/extractor/0.log"
Jul 09 02:40:43.765138 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:43.765109    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lshzb/perf-node-gather-daemonset-9k7d5"
Jul 09 02:40:44.369678 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:44.369646    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8687897cbb-5lzn4_d3a14dcc-179f-438e-9d48-f49e959d7277/manager/0.log"
Jul 09 02:40:44.389962 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:44.389936    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8687897cbb-5lzn4_d3a14dcc-179f-438e-9d48-f49e959d7277/copy-manifests/0.log"
Jul 09 02:40:45.658746 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:45.658700    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-596d76b798-ds7gd_cbf796ca-d972-4c9c-b1cd-b1860842db9a/manager/0.log"
Jul 09 02:40:46.815532 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:46.815509    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678bssp5_50ad9c72-0351-43cf-b577-e9a3549dc67b/istio-proxy/0.log"
Jul 09 02:40:46.930342 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:46.930297    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-thpdr_d59ae476-dd75-42a5-a785-c0bee6d44c6f/discovery/0.log"
Jul 09 02:40:46.978995 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:46.978965    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-55h66_58e0bd42-2798-4fe1-a334-482e039808cc/istio-proxy/0.log"
Jul 09 02:40:47.005012 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:47.004983    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-55h66_58e0bd42-2798-4fe1-a334-482e039808cc/istio-proxy/1.log"
Jul 09 02:40:47.032901 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:47.032862    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-lkk9d_9a592784-f207-437c-84b1-be5cc052fd75/payload-pre-processing/0.log"
Jul 09 02:40:48.423712 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:48.423683    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678bssp5_50ad9c72-0351-43cf-b577-e9a3549dc67b/istio-proxy/0.log"
Jul 09 02:40:48.523133 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:48.523098    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-thpdr_d59ae476-dd75-42a5-a785-c0bee6d44c6f/discovery/0.log"
Jul 09 02:40:48.568233 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:48.568206    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-55h66_58e0bd42-2798-4fe1-a334-482e039808cc/istio-proxy/0.log"
Jul 09 02:40:48.593128 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:48.593100    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-55h66_58e0bd42-2798-4fe1-a334-482e039808cc/istio-proxy/1.log"
Jul 09 02:40:48.620313 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:48.620286    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-lkk9d_9a592784-f207-437c-84b1-be5cc052fd75/payload-pre-processing/0.log"
Jul 09 02:40:52.463924 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:52.463896    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg24z_98774b45-19d2-428d-b024-489e2d14e26e/kube-multus-additional-cni-plugins/0.log"
Jul 09 02:40:52.483661 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:52.483634    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg24z_98774b45-19d2-428d-b024-489e2d14e26e/egress-router-binary-copy/0.log"
Jul 09 02:40:52.501124 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:52.501098    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg24z_98774b45-19d2-428d-b024-489e2d14e26e/cni-plugins/0.log"
Jul 09 02:40:52.517914 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:52.517895    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg24z_98774b45-19d2-428d-b024-489e2d14e26e/bond-cni-plugin/0.log"
Jul 09 02:40:52.536780 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:52.536755    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg24z_98774b45-19d2-428d-b024-489e2d14e26e/routeoverride-cni/0.log"
Jul 09 02:40:52.553770 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:52.553747    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg24z_98774b45-19d2-428d-b024-489e2d14e26e/whereabouts-cni-bincopy/0.log"
Jul 09 02:40:52.570352 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:52.570324    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg24z_98774b45-19d2-428d-b024-489e2d14e26e/whereabouts-cni/0.log"
Jul 09 02:40:52.626289 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:52.626241    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g9n5d_1a83d32a-3904-42c2-80da-1d858105cf17/kube-multus/0.log"
Jul 09 02:40:52.771891 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:52.771817    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wlfbh_104dfc74-924d-4b73-8bd5-8e0302fd9650/network-metrics-daemon/0.log"
Jul 09 02:40:52.786741 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:52.786716    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wlfbh_104dfc74-924d-4b73-8bd5-8e0302fd9650/kube-rbac-proxy/0.log"
Jul 09 02:40:53.906174 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:53.906143    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfstd_9de1d9a9-cefc-43b2-b797-5346946e4de9/ovn-controller/0.log"
Jul 09 02:40:53.919837 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:53.919817    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfstd_9de1d9a9-cefc-43b2-b797-5346946e4de9/ovn-acl-logging/0.log"
Jul 09 02:40:53.938511 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:53.938490    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfstd_9de1d9a9-cefc-43b2-b797-5346946e4de9/kube-rbac-proxy-node/0.log"
Jul 09 02:40:53.955108 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:53.955088    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfstd_9de1d9a9-cefc-43b2-b797-5346946e4de9/kube-rbac-proxy-ovn-metrics/0.log"
Jul 09 02:40:53.971880 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:53.971858    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfstd_9de1d9a9-cefc-43b2-b797-5346946e4de9/northd/0.log"
Jul 09 02:40:53.989471 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:53.989449    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfstd_9de1d9a9-cefc-43b2-b797-5346946e4de9/nbdb/0.log"
Jul 09 02:40:54.007096 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:54.007079    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfstd_9de1d9a9-cefc-43b2-b797-5346946e4de9/sbdb/0.log"
Jul 09 02:40:54.063414 ip-10-0-137-63 kubenswrapper[2556]: I0709 02:40:54.063391    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfstd_9de1d9a9-cefc-43b2-b797-5346946e4de9/ovnkube-controller/0.log"