Jul 14 21:37:41.415440 ip-10-0-128-31 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 21:37:41.742420 ip-10-0-128-31 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 21:37:41.742420 ip-10-0-128-31 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 21:37:41.742420 ip-10-0-128-31 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 21:37:41.742420 ip-10-0-128-31 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 21:37:41.742420 ip-10-0-128-31 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 21:37:41.744459 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.744366    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 21:37:41.748653 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748630    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 21:37:41.748653 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748651    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 21:37:41.748653 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748655    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748658    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748663    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748666    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748668    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748671    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748674    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748676    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748679    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748682    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748684    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748687    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748689    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748692    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748694    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748697    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748700    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748703    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748711    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748713    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 21:37:41.748752 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748716    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748718    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748721    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748723    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748726    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748729    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748731    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748733    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748736    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748739    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748742    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748744    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748747    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748749    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748753    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748757    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748760    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748764    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748769    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 21:37:41.749233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748772    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748774    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748777    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748780    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748782    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748785    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748788    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748790    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748793    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748795    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748798    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748801    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748804    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748806    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748809    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748811    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748814    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748817    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748819    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748821    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 21:37:41.749698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748826    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748829    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748832    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748835    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748838    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748842    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748845    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748849    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748851    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748854    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748856    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748859    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748861    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748864    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748866    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748869    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748871    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748874    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748876    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748879    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 21:37:41.750178 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748881    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748884    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748886    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748889    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748891    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748894    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748898    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748901    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748904    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748907    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748910    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748913    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748915    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748918    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748920    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748923    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748925    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.748928    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749674    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 21:37:41.750659 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749683    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749687    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749691    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749694    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749697    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749700    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749702    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749705    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749708    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749711    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749714    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749716    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749719    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749721    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749724    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749726    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749729    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749732    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749734    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749737    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 21:37:41.751119 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749740    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749742    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749746    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749749    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749752    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749755    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749757    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749760    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749762    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749765    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749768    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749770    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749774    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749777    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749779    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749782    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749784    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749787    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749789    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749792    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 21:37:41.751617 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749795    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749797    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749800    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749802    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749804    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749807    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749809    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749812    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749814    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749818    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749822    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749825    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749829    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749831    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749834    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749838    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749840    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749844    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749847    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 21:37:41.752111 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749850    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749853    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749856    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749858    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749861    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749863    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749866    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749869    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749872    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749874    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749877    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749879    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749882    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749885    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749887    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749890    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749892    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749894    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749897    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 21:37:41.752579 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749900    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749904    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749907    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749910    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749913    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749916    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749919    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749922    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749924    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749927    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749929    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749932    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749934    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749937    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749940    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749942    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749945    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749947    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749950    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 21:37:41.753039 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.749952    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750374    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750380    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750383    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750386    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750389    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750392    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750394    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750397    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750400    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750402    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750405    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750408    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750411    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750414    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750416    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750419    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750422    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750424    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 21:37:41.753512 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750428    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750432    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750436    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750439    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750442    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750445    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750448    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750451    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750455    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750458    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750461    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750463    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750466    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750469    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750471    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750474    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750477    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750479    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750482    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750485    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 21:37:41.753979 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750488    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750490    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750493    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750495    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750498    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750500    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750506    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750508    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750511    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750513    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750516    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750518    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750521    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750523    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750527    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750529    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750532    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750535    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750538    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750541    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 21:37:41.754495 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750544    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750547    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750549    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750552    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750555    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750557    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750560    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750563    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750565    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750568    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750570    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750573    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750575    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750578    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750580    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750583    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750585    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750588    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750592    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750594    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 21:37:41.754983 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750597    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750603    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750606    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750609    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750612    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750615    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750617    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750621    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750623    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750627    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750629    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750632    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750636    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750638    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750641    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750643    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750646    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750648    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750651    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 21:37:41.755517 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750653    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.750656    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750736    2572 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750744    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750749    2572 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750753    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750758    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750761    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750766    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750771    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750774    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750777    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750781    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750784    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750789    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750792    2572 flags.go:64] FLAG: --cgroup-root=""
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750795    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750798    2572 flags.go:64] FLAG: --client-ca-file=""
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750801    2572 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750804    2572 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750808    2572 flags.go:64] FLAG: --cluster-domain=""
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750811    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750815    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750818    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 21:37:41.755975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750821    2572 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750825    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750829    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750832    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750835    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750838    2572 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750841    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750845    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750848    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750851    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750855    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750858    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750861    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750864    2572 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750867    2572 flags.go:64] FLAG: --enable-server="true"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750870    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750873    2572 flags.go:64] FLAG: --event-burst="100"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750877    2572 flags.go:64] FLAG: --event-qps="50"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750879    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750883    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750886    2572 flags.go:64] FLAG: --eviction-hard=""
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750890    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750893    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750896    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750899    2572 flags.go:64] FLAG: --eviction-soft=""
Jul 14 21:37:41.756644 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750902    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750906    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750909    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750912    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750915    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750919    2572 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750922    2572 flags.go:64] FLAG: --feature-gates=""
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750926    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750929    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750932    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750935    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750938    2572 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750941    2572 flags.go:64] FLAG: --help="false"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750944    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-128-31.ec2.internal"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750947    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750950    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750953    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750956    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750960    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750963    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750965    2572 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750968    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750971    2572 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 21:37:41.757302 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750974    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750979    2572 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750982    2572 flags.go:64] FLAG: --kube-reserved=""
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750985    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750988    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750991    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750994    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.750997    2572 flags.go:64] FLAG: --lock-file=""
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751000    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751002    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751005    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751011    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751014    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751017    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751019    2572 flags.go:64] FLAG: --logging-format="text"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751023    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751026    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751029    2572 flags.go:64] FLAG: --manifest-url=""
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751032    2572 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751036    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751039    2572 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751043    2572 flags.go:64] FLAG: --max-pods="110"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751046    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751049    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751052    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 21:37:41.758006 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751055    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751058    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751061    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751064    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751071    2572 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751074    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751077    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751095    2572 flags.go:64] FLAG: --pod-cidr=""
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751115    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751122    2572 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751126    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751130    2572 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751133    2572 flags.go:64] FLAG: --port="10250"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751137    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751140    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-059c31cb2ca5fae4e"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751143    2572 flags.go:64] FLAG: --qos-reserved=""
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751146    2572 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751149    2572 flags.go:64] FLAG: --register-node="true"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751152    2572 flags.go:64] FLAG: --register-with-taints=""
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751160    2572 flags.go:64] FLAG: --registry-burst="10"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751163    2572 flags.go:64] FLAG: --registry-qps="5"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751166    2572 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751169    2572 flags.go:64] FLAG: --reserved-memory=""
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751173    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751177    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 21:37:41.758947 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751180    2572 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751183    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751185    2572 flags.go:64] FLAG: --runonce="false"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751188    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751191    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751194    2572 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751197    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751200    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751204    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751207    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751210    2572 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751213    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751216    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751219    2572 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751221    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751224    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751229    2572 flags.go:64] FLAG: --system-cgroups=""
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751233    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751239    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751242    2572 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751244    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751248    2572 flags.go:64] FLAG: --tls-min-version=""
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751251    2572 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751254    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751257    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 21:37:41.759638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751259    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751262    2572 flags.go:64] FLAG: --v="2"
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751266    2572 flags.go:64] FLAG: --version="false"
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751271    2572 flags.go:64] FLAG: --vmodule=""
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751275    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.751278    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751424    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751430    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751433    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751436    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751439    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751443    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751446    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751448    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751451    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751454    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751457    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751460    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751463    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751466    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751468    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 21:37:41.760262 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751471    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751473    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751478    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751481    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751484    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751487    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751490    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751492    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751495    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751497    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751500    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751503    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751505    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751508    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751510    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751513    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751516    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751518    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751526    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 21:37:41.760778 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751529    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751533    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751537    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751539    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751542    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751544    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751547    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751549    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751552    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751554    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751557    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751559    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751562    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751565    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751567    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751572    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751576    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751578    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751581    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 21:37:41.761301 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751583    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751586    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751589    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751591    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751594    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751596    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751599    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751601    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751603    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751606    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751609    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751611    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751614    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751622    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751625    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751628    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751631    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751633    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751636    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751640    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 21:37:41.761787 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751643    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751646    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751649    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751651    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751654    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751656    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751659    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751661    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751666    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751675    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751678    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751681    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751684    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751687    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751689    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751692    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751694    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751697    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751700    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 21:37:41.762289 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751702    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751705    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751707    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751710    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751712    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751715    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.751717    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.752223    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.761218    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.761238    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.761259    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.761265    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761334    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761341    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761345    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 21:37:41.762765 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761348    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761351    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761353    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761356    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761359    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761361    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761364    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761366    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761369    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761372    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761376    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761378    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761383    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761387    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761391    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761393    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761396    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761399    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761402    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 21:37:41.763163 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761405    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761408    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761411    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761414    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761416    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761419    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761421    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761425    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761428    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761430    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761433    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761436    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761439    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761442    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761445    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761447    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761450    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761453    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761455    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761458    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 21:37:41.763628 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761460    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761463    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761466    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761468    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761471    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761474    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761477    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761480    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761483    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761485    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761488    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761491    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761493    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761496    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761498    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761501    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761504    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761507    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761509    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761512    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 21:37:41.764136 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761515    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761517    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761521    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761523    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761527    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761531    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761534    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761537    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761539    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761542    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761544    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761547    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761557    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761561    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761564    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761567    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761570    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761579    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761582    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 21:37:41.764678 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761584    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761587    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761589    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761592    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761594    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761597    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761600    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761602    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761605    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761608    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761611    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761613    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761616    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761619    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761622    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761626    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761629    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 21:37:41.765209 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761632    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.761638    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761765    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761771    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761773    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761777    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761780    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761783    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761787    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761790    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761793    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761796    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761799    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761802    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761813    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 21:37:41.765698 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761816    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761818    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761821    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761824    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761826    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761829    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761832    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761834    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761837    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761840    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761842    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761845    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761847    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761850    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761853    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761855    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761858    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761861    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761863    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761866    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 21:37:41.766201 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761868    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761871    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761873    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761876    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761878    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761880    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761883    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761885    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761888    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761890    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761893    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761896    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761911    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761913    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761917    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761921    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761924    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761926    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761929    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761932    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 21:37:41.766906 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761935    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761939    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761942    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761944    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761947    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761951    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761954    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761957    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761960    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761963    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761965    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761968    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761970    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761973    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761975    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761978    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761980    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761983    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761985    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 21:37:41.767705 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761988    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761990    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761993    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761995    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.761998    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762001    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762007    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762010    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762012    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762014    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762017    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762019    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762022    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762024    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762027    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762030    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762033    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762035    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762038    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762041    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 21:37:41.768197 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762043    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 21:37:41.768965 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762046    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 21:37:41.768965 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762049    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 21:37:41.768965 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762051    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 21:37:41.768965 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762054    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 21:37:41.768965 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762056    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 21:37:41.768965 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:41.762059    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 21:37:41.768965 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.762064    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 21:37:41.768965 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.762216    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 21:37:41.768965 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.764328    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 21:37:41.768965 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.765521    2572 server.go:1019] "Starting client certificate rotation"
Jul 14 21:37:41.768965 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.765637    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 21:37:41.768965 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.765685    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 21:37:41.768965 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.767759    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 21:37:41.769678 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.769662    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 21:37:41.779331 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.779311    2572 log.go:25] "Validated CRI v1 runtime API"
Jul 14 21:37:41.781935 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.781915    2572 log.go:25] "Validated CRI v1 image API"
Jul 14 21:37:41.783626 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.783605    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 21:37:41.785729 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.785700    2572 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b3966f22-55e0-4998-87af-0bce0e7f414e:/dev/nvme0n1p4 e834a4ab-5422-4759-8491-13dc5f6819fb:/dev/nvme0n1p3]
Jul 14 21:37:41.785814 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.785725    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 21:37:41.792773 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.792635    2572 manager.go:216] Machine: {Timestamp:2026-07-14 21:37:41.791493927 +0000 UTC m=+0.276586570 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099987 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec243aa9fcc915424eb6560629a5d29c SystemUUID:ec243aa9-fcc9-1542-4eb6-560629a5d29c BootID:387c0356-344e-445a-9406-57b39d6bc468 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:61:04:12:16:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:61:04:12:16:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:23:bf:15:bf:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 21:37:41.792773 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.792753    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 21:37:41.792933 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.792853    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 21:37:41.794025 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.794006    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 21:37:41.795588 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.795556    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 21:37:41.795735 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.795592    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-31.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 21:37:41.796935 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.796922    2572 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 21:37:41.796980 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.796938    2572 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 21:37:41.796980 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.796946    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 21:37:41.797524 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.797510    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 21:37:41.798802 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.798789    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 21:37:41.801607 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.801592    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 21:37:41.801741 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.801732    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 21:37:41.801781 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.801765    2572 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 21:37:41.801781 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.801778    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 21:37:41.801832 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.801793    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 21:37:41.801832 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.801806    2572 kubelet.go:398] "Adding apiserver pod source"
Jul 14 21:37:41.801832 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.801816    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 21:37:41.802262 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.802247    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 21:37:41.802262 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.802266    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 21:37:41.804265 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.804247    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 21:37:41.806213 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.806199    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 21:37:41.806263 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.806230    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 21:37:41.806418 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.806409    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 21:37:41.806450 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.806423    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 21:37:41.806450 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.806430    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 21:37:41.806450 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.806436    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 21:37:41.806450 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.806444    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 21:37:41.806450 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.806450    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 21:37:41.806907 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.806896    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 21:37:41.806907 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.806905    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 21:37:41.807012 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.806912    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 21:37:41.807012 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.806918    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 21:37:41.807012 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.806927    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 21:37:41.807012 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.806935    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 21:37:41.807569 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.807560    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 21:37:41.807569 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.807568    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 21:37:41.811004 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.810990    2572 server.go:1268] "Started kubelet"
Jul 14 21:37:41.811137 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.811086    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 21:37:41.811225 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.811148    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 21:37:41.811280 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.811254    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 21:37:41.811557 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.811539    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-31.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 21:37:41.811653 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:41.811612    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 21:37:41.811715 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:41.811690    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 21:37:41.812553 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.812536    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 21:37:41.813365 ip-10-0-128-31 systemd[1]: Started Kubernetes Kubelet.
Jul 14 21:37:41.814527 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.814515    2572 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 21:37:41.816559 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:41.816539    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 21:37:41.818243 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.818224    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 21:37:41.818243 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.818237    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 21:37:41.818387 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:41.818297    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found"
Jul 14 21:37:41.818799 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.818782    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 21:37:41.818882 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.818783    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 21:37:41.818882 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.818824    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 21:37:41.819270 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.819251    2572 factory.go:55] Registering systemd factory
Jul 14 21:37:41.819270 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.819273    2572 factory.go:223] Registration of the systemd container factory successfully
Jul 14 21:37:41.819480 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.819462    2572 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 21:37:41.819480 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.819478    2572 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 21:37:41.819858 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.819842    2572 factory.go:153] Registering CRI-O factory
Jul 14 21:37:41.819914 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.819864    2572 factory.go:223] Registration of the crio container factory successfully
Jul 14 21:37:41.819961 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.819921    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 21:37:41.819961 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.819941    2572 factory.go:103] Registering Raw factory
Jul 14 21:37:41.819961 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.819953    2572 manager.go:1196] Started watching for new ooms in manager
Jul 14 21:37:41.820446 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.820434    2572 manager.go:349] Starting recovery of all containers
Jul 14 21:37:41.820515 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:41.820493    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 14 21:37:41.820636 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:41.820616    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 14 21:37:41.821127 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:41.820222    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-31.ec2.internal.18c245b8a96d7a2b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-31.ec2.internal,UID:ip-10-0-128-31.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-31.ec2.internal,},FirstTimestamp:2026-07-14 21:37:41.810960939 +0000 UTC m=+0.296053582,LastTimestamp:2026-07-14 21:37:41.810960939 +0000 UTC m=+0.296053582,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-31.ec2.internal,}"
Jul 14 21:37:41.831730 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.831549    2572 manager.go:354] Recovery completed
Jul 14 21:37:41.832373 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.832346    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m9wnw"
Jul 14 21:37:41.837894 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.837879    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 21:37:41.838698 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.838679    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m9wnw"
Jul 14 21:37:41.841099 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.841077    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 21:37:41.841188 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.841133    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 21:37:41.841188 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.841146    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientPID"
Jul 14 21:37:41.841751 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.841733    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 21:37:41.841751 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.841747    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 21:37:41.841873 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.841761    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 21:37:41.841873 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.841780    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 21:37:41.842670 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.842653    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 21:37:41.842755 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.842687    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 21:37:41.842755 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.842702    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientPID"
Jul 14 21:37:41.842844 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.842756    2572 policy_none.go:49] "None policy: Start"
Jul 14 21:37:41.842844 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.842773    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 21:37:41.842844 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.842784    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 21:37:41.843297 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:41.843228    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-31.ec2.internal.18c245b8ab399085  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-31.ec2.internal,UID:ip-10-0-128-31.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-31.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-31.ec2.internal,},FirstTimestamp:2026-07-14 21:37:41.841113221 +0000 UTC m=+0.326205867,LastTimestamp:2026-07-14 21:37:41.841113221 +0000 UTC m=+0.326205867,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-31.ec2.internal,}"
Jul 14 21:37:41.843846 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.843834    2572 policy_none.go:47] "Start"
Jul 14 21:37:41.867880 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.867859    2572 manager.go:337] "Starting Device Plugin manager"
Jul 14 21:37:41.868014 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:41.867896    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 21:37:41.868014 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.867908    2572 server.go:87] "Starting device plugin registration server"
Jul 14 21:37:41.868262 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.868250    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 21:37:41.868309 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.868264    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 21:37:41.868359 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.868351    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 21:37:41.868455 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.868432    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 21:37:41.868455 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.868447    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 21:37:41.869058 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:41.869031    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 21:37:41.869141 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:41.869096    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-31.ec2.internal\" not found"
Jul 14 21:37:41.968646 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.968597    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 21:37:41.969852 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.969696    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 21:37:41.969852 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.969744    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 21:37:41.969852 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.969756    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientPID"
Jul 14 21:37:41.969852 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.969806    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-31.ec2.internal"
Jul 14 21:37:41.971192 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.971160    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 21:37:41.972419 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.972403    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 21:37:41.972516 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.972444    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 21:37:41.972516 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.972471    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 21:37:41.972516 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:41.972511    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 21:37:41.975308 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.975289    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 21:37:41.976394 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:41.976376    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-31.ec2.internal"
Jul 14 21:37:41.976482 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:41.976400    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-31.ec2.internal\": node \"ip-10-0-128-31.ec2.internal\" not found"
Jul 14 21:37:42.022589 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:42.022506    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found"
Jul 14 21:37:42.072677 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.072629    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal"]
Jul 14 21:37:42.072875 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.072741    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 21:37:42.074412 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.074394    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 21:37:42.074530 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.074441    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 21:37:42.074530 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.074455    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientPID"
Jul 14 21:37:42.076009 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.075991    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 21:37:42.076143 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.076128    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.076196 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.076163    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 21:37:42.076782 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.076761    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 21:37:42.076884 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.076794    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 21:37:42.076884 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.076808    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientPID"
Jul 14 21:37:42.076884 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.076831    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 21:37:42.076884 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.076848    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 21:37:42.076884 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.076860    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientPID"
Jul 14 21:37:42.078063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.078047    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.078144 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.078073    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 21:37:42.078750 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.078734    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 21:37:42.078822 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.078762    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 21:37:42.078822 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.078773    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeHasSufficientPID"
Jul 14 21:37:42.103007 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:42.102977    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-31.ec2.internal\" not found" node="ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.107673 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:42.107656    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-31.ec2.internal\" not found" node="ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.120931 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.120903    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e3715788632b0289973cb9034308be71-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal\" (UID: \"e3715788632b0289973cb9034308be71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.121030 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.120934    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3715788632b0289973cb9034308be71-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal\" (UID: \"e3715788632b0289973cb9034308be71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.121030 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.120960    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f71cbe28c74af33d6d21b6fef376a32-config\") pod \"kube-apiserver-proxy-ip-10-0-128-31.ec2.internal\" (UID: \"3f71cbe28c74af33d6d21b6fef376a32\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.122999 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:42.122983    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found"
Jul 14 21:37:42.221676 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.221635    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e3715788632b0289973cb9034308be71-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal\" (UID: \"e3715788632b0289973cb9034308be71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.221676 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.221678    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3715788632b0289973cb9034308be71-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal\" (UID: \"e3715788632b0289973cb9034308be71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.221924 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.221699    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f71cbe28c74af33d6d21b6fef376a32-config\") pod \"kube-apiserver-proxy-ip-10-0-128-31.ec2.internal\" (UID: \"3f71cbe28c74af33d6d21b6fef376a32\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.221924 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.221746    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e3715788632b0289973cb9034308be71-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal\" (UID: \"e3715788632b0289973cb9034308be71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.221924 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.221785    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3715788632b0289973cb9034308be71-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal\" (UID: \"e3715788632b0289973cb9034308be71\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.221924 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.221855    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3f71cbe28c74af33d6d21b6fef376a32-config\") pod \"kube-apiserver-proxy-ip-10-0-128-31.ec2.internal\" (UID: \"3f71cbe28c74af33d6d21b6fef376a32\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.223749 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:42.223727    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found"
Jul 14 21:37:42.324362 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:42.324276    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found"
Jul 14 21:37:42.405523 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.405485    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.410492 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.410474    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:42.424541 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:42.424503    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found"
Jul 14 21:37:42.525179 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:42.525125    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found"
Jul 14 21:37:42.625697 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:42.625618    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found"
Jul 14 21:37:42.726193 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:42.726136    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found"
Jul 14 21:37:42.765311 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.765283    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 21:37:42.765833 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.765459    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 21:37:42.826447 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:42.826418    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found"
Jul 14 21:37:42.841774 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.841732    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 21:32:41 +0000 UTC" deadline="2028-03-03 03:23:43.106108235 +0000 UTC"
Jul 14 21:37:42.841774 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.841766    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14333h46m0.264345862s"
Jul 14 21:37:42.866166 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:42.866096    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f71cbe28c74af33d6d21b6fef376a32.slice/crio-e214f8f0db18ca9708448148ddf04ab245ab6a1c537984a17a7f121764e67da5 WatchSource:0}: Error finding container e214f8f0db18ca9708448148ddf04ab245ab6a1c537984a17a7f121764e67da5: Status 404 returned error can't find the container with id e214f8f0db18ca9708448148ddf04ab245ab6a1c537984a17a7f121764e67da5
Jul 14 21:37:42.875792 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.875739    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 21:37:42.882321 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:42.882294    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3715788632b0289973cb9034308be71.slice/crio-0662ee9227a688a6a951d40a80c9485470517403899f86ec42273ff88d0ea820 WatchSource:0}: Error finding container 0662ee9227a688a6a951d40a80c9485470517403899f86ec42273ff88d0ea820: Status 404 returned error can't find the container with id 0662ee9227a688a6a951d40a80c9485470517403899f86ec42273ff88d0ea820
Jul 14 21:37:42.927158 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:42.927085    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found"
Jul 14 21:37:42.936381 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.936356    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 21:37:42.957539 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.957510    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 21:37:42.975953 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.975895    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" event={"ID":"e3715788632b0289973cb9034308be71","Type":"ContainerStarted","Data":"0662ee9227a688a6a951d40a80c9485470517403899f86ec42273ff88d0ea820"}
Jul 14 21:37:42.976945 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:42.976920    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal" event={"ID":"3f71cbe28c74af33d6d21b6fef376a32","Type":"ContainerStarted","Data":"e214f8f0db18ca9708448148ddf04ab245ab6a1c537984a17a7f121764e67da5"}
Jul 14 21:37:43.027419 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:43.027385    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-31.ec2.internal\" not found"
Jul 14 21:37:43.085529 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.085504    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 21:37:43.118934 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.118899    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:43.133174 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.133092    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 21:37:43.134079 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.134064    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal"
Jul 14 21:37:43.144868 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.144846    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 21:37:43.802835 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.802804    2572 apiserver.go:52] "Watching apiserver"
Jul 14 21:37:43.811411 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.811359    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 21:37:43.811869 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.811846    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal","openshift-multus/multus-additional-cni-plugins-hmqzr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l","openshift-multus/multus-hht8r","openshift-multus/network-metrics-daemon-f5vcq","openshift-network-diagnostics/network-check-target-26bng","openshift-network-operator/iptables-alerter-vwjqf","openshift-ovn-kubernetes/ovnkube-node-wfbd8","kube-system/global-pull-secret-syncer-tmv56","kube-system/konnectivity-agent-hxqwh","kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2z64w","openshift-dns/node-resolver-4l5xq","openshift-image-registry/node-ca-7zd76"]
Jul 14 21:37:43.813542 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.813504    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vwjqf"
Jul 14 21:37:43.814804 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.814765    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4l5xq"
Jul 14 21:37:43.816213 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.816189    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.817278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.817249    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 21:37:43.817441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.817415    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 21:37:43.817584 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.817565    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m8blk\""
Jul 14 21:37:43.817791 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.817769    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.818370 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.817908    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 21:37:43.819055 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.818659    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 21:37:43.819463 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.819405    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:43.819564 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:43.819481    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:37:43.820518 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.820498    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:43.820619 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:43.820571    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:37:43.821322 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.821274    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 21:37:43.821441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.821417    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 21:37:43.822410 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.822389    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:43.822507 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:43.822458    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:37:43.823229 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.823196    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 21:37:43.823485 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.823462    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wvptx\""
Jul 14 21:37:43.823485 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.823470    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 21:37:43.823653 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.823637    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 21:37:43.823723 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.823709    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 21:37:43.823864 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.823849    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 21:37:43.823979 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.823965    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m9g66\""
Jul 14 21:37:43.824187 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.824163    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7zd76"
Jul 14 21:37:43.825688 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.824898    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 21:37:43.825688 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.825186    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b9nqd\""
Jul 14 21:37:43.827010 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.826128    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:43.827521 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.827463    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hxqwh"
Jul 14 21:37:43.828533 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.828511    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 21:37:43.830277 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.829215    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 21:37:43.830734 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.829313    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 21:37:43.830906 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.830885    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 21:37:43.831341 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.829382    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 21:37:43.831341 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.829391    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 21:37:43.831341 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.829327    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 21:37:43.831341 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.829490    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fxc85\""
Jul 14 21:37:43.831341 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.829474    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rg4fm\""
Jul 14 21:37:43.831341 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.830711    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.832237 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.832217    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 21:37:43.833353 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.833331    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z2lk\" (UniqueName: \"kubernetes.io/projected/150dc8f0-1e0c-4604-b243-64ccf379c315-kube-api-access-4z2lk\") pod \"iptables-alerter-vwjqf\" (UID: \"150dc8f0-1e0c-4604-b243-64ccf379c315\") " pod="openshift-network-operator/iptables-alerter-vwjqf"
Jul 14 21:37:43.834059 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834035    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-hostroot\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.834238 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834074    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xnjm\" (UniqueName: \"kubernetes.io/projected/9b299cfd-4132-4261-a395-5426f00c0416-kube-api-access-7xnjm\") pod \"node-resolver-4l5xq\" (UID: \"9b299cfd-4132-4261-a395-5426f00c0416\") " pod="openshift-dns/node-resolver-4l5xq"
Jul 14 21:37:43.834238 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834103    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-registration-dir\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.834238 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834146    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-etc-selinux\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.834238 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834175    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mbs2\" (UniqueName: \"kubernetes.io/projected/83b6973e-7235-4802-9583-12796420ee80-kube-api-access-7mbs2\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.834238 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834199    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-cnibin\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.834238 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834224    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-os-release\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.834552 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834249    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-run-k8s-cni-cncf-io\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.834552 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834291    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b299cfd-4132-4261-a395-5426f00c0416-hosts-file\") pod \"node-resolver-4l5xq\" (UID: \"9b299cfd-4132-4261-a395-5426f00c0416\") " pod="openshift-dns/node-resolver-4l5xq"
Jul 14 21:37:43.834552 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.833497    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-57frc\""
Jul 14 21:37:43.834552 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834321    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b299cfd-4132-4261-a395-5426f00c0416-tmp-dir\") pod \"node-resolver-4l5xq\" (UID: \"9b299cfd-4132-4261-a395-5426f00c0416\") " pod="openshift-dns/node-resolver-4l5xq"
Jul 14 21:37:43.834552 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834358    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.834552 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834384    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-multus-socket-dir-parent\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.834552 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834408    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-var-lib-cni-multus\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.834552 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834442    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-etc-kubernetes\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.834552 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834467    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljq7p\" (UniqueName: \"kubernetes.io/projected/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-kube-api-access-ljq7p\") pod \"network-metrics-daemon-f5vcq\" (UID: \"ad4922e5-5a9e-45d9-93db-5fd8d2534abd\") " pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:43.834552 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834492    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-var-lib-kubelet\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.834552 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834537    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-multus-conf-dir\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.835132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834562    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-multus-daemon-config\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.835132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834586    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-multus-cni-dir\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.835132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834610    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-cni-binary-copy\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.835132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834640    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-socket-dir\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.835132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834674    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-sys-fs\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.835132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834701    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-system-cni-dir\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.835132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834767    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-var-lib-cni-bin\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.835132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834793    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs\") pod \"network-metrics-daemon-f5vcq\" (UID: \"ad4922e5-5a9e-45d9-93db-5fd8d2534abd\") " pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:43.835132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834818    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-device-dir\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.835132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834844    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-run-netns\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.835132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834869    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dbs4\" (UniqueName: \"kubernetes.io/projected/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-kube-api-access-7dbs4\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.835132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834893    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/150dc8f0-1e0c-4604-b243-64ccf379c315-iptables-alerter-script\") pod \"iptables-alerter-vwjqf\" (UID: \"150dc8f0-1e0c-4604-b243-64ccf379c315\") " pod="openshift-network-operator/iptables-alerter-vwjqf"
Jul 14 21:37:43.835132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834917    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/150dc8f0-1e0c-4604-b243-64ccf379c315-host-slash\") pod \"iptables-alerter-vwjqf\" (UID: \"150dc8f0-1e0c-4604-b243-64ccf379c315\") " pod="openshift-network-operator/iptables-alerter-vwjqf"
Jul 14 21:37:43.835132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.834949    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-run-multus-certs\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.835851 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.835200    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.836831 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.836678    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qjj8n\""
Jul 14 21:37:43.836831 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.836736    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 21:37:43.837034 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.836859    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 21:37:43.837034 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.836906    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 21:37:43.837034 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.837004    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 21:37:43.837221 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.837115    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 21:37:43.837221 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.837162    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 21:37:43.838748 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.838727    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 21:37:43.841183 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.841163    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9djtc\""
Jul 14 21:37:43.841948 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.841849    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 21:37:43.848337 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.848083    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 21:37:43.875540 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.875514    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ck68k"
Jul 14 21:37:43.887190 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.887159    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ck68k"
Jul 14 21:37:43.894992 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.894965    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 21:37:43.920369 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.920337    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 21:37:43.935598 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.935505    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-modprobe-d\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.935598 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.935545    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-var-lib-kubelet\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.935598 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.935573    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a732f775-e8f5-449a-bbc9-3444417b18a3-ovn-node-metrics-cert\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.935882 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.935607    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-cni-binary-copy\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.935882 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.935634    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18a6bb3a-2e83-4b23-9129-6612da3726f5-konnectivity-ca\") pod \"konnectivity-agent-hxqwh\" (UID: \"18a6bb3a-2e83-4b23-9129-6612da3726f5\") " pod="kube-system/konnectivity-agent-hxqwh"
Jul 14 21:37:43.935882 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.935687    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-sys\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.935882 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.935766    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-socket-dir\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.936083 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.935942    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdjd2\" (UniqueName: \"kubernetes.io/projected/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-kube-api-access-gdjd2\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.936083 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.935977    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-etc-openvswitch\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.936083 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936006    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-run-openvswitch\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.936083 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936032    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.936083 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.935946    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-socket-dir\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.936083 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936074    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a732f775-e8f5-449a-bbc9-3444417b18a3-ovnkube-config\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.936423 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936129    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:43.936423 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936167    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-device-dir\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.936423 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936194    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-run-netns\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.936423 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936220    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dbs4\" (UniqueName: \"kubernetes.io/projected/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-kube-api-access-7dbs4\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.936423 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936244    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-sysconfig\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.936423 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936270    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-tmp\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.936423 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936286    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-run-netns\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.936423 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936293    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-device-dir\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.936423 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936295    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77-serviceca\") pod \"node-ca-7zd76\" (UID: \"c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77\") " pod="openshift-image-registry/node-ca-7zd76"
Jul 14 21:37:43.936423 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936353    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-run-multus-certs\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.936423 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936384    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7dddc3f3-4833-4d05-8db0-86e663dde23c-kubelet-config\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:43.936423 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936414    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6k4d\" (UniqueName: \"kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d\") pod \"network-check-target-26bng\" (UID: \"60090e8b-aefa-43fa-9bb0-ff481a0fc9f3\") " pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:43.936423 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936425    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-cni-binary-copy\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936438    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936439    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-run-multus-certs\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936462    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18a6bb3a-2e83-4b23-9129-6612da3726f5-agent-certs\") pod \"konnectivity-agent-hxqwh\" (UID: \"18a6bb3a-2e83-4b23-9129-6612da3726f5\") " pod="kube-system/konnectivity-agent-hxqwh"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936499    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-systemd-units\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936531    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-slash\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936561    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936595    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-registration-dir\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936635    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-etc-selinux\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936651    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-registration-dir\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-kubernetes\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936696    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-lib-modules\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936734    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-etc-selinux\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936743    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-run-netns\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936780    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936808    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-multus-socket-dir-parent\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.937063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936837    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-etc-kubernetes\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936873    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-cni-bin\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936920    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-var-lib-kubelet\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936940    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-multus-socket-dir-parent\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936949    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936946    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-multus-conf-dir\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936974    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-etc-kubernetes\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.936996    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-multus-conf-dir\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937042    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-multus-daemon-config\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937092    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-node-log\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937156    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-log-socket\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937186    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a732f775-e8f5-449a-bbc9-3444417b18a3-env-overrides\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937240    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w8nj\" (UniqueName: \"kubernetes.io/projected/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-kube-api-access-9w8nj\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937259    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-var-lib-kubelet\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937276    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-multus-cni-dir\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937303    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77-host\") pod \"node-ca-7zd76\" (UID: \"c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77\") " pod="openshift-image-registry/node-ca-7zd76"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937371    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-multus-cni-dir\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.937862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937377    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg8g9\" (UniqueName: \"kubernetes.io/projected/a732f775-e8f5-449a-bbc9-3444417b18a3-kube-api-access-sg8g9\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937414    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-sys-fs\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937464    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-system-cni-dir\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937500    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-var-lib-cni-bin\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937527    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs\") pod \"network-metrics-daemon-f5vcq\" (UID: \"ad4922e5-5a9e-45d9-93db-5fd8d2534abd\") " pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937545    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-system-cni-dir\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937550    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-multus-daemon-config\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937557    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937480    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/83b6973e-7235-4802-9583-12796420ee80-sys-fs\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937572    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-var-lib-cni-bin\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937597    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-var-lib-openvswitch\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937631    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-run-ovn\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937655    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-cnibin\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:43.937659    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937683    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-host\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:43.937757    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs podName:ad4922e5-5a9e-45d9-93db-5fd8d2534abd nodeName:}" failed. No retries permitted until 2026-07-14 21:37:44.437721331 +0000 UTC m=+2.922813985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs") pod "network-metrics-daemon-f5vcq" (UID: "ad4922e5-5a9e-45d9-93db-5fd8d2534abd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937784    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtfkg\" (UniqueName: \"kubernetes.io/projected/c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77-kube-api-access-gtfkg\") pod \"node-ca-7zd76\" (UID: \"c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77\") " pod="openshift-image-registry/node-ca-7zd76"
Jul 14 21:37:43.938637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937812    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-kubelet\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937837    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937863    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-system-cni-dir\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937888    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-os-release\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937915    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937945    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/150dc8f0-1e0c-4604-b243-64ccf379c315-iptables-alerter-script\") pod \"iptables-alerter-vwjqf\" (UID: \"150dc8f0-1e0c-4604-b243-64ccf379c315\") " pod="openshift-network-operator/iptables-alerter-vwjqf"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937971    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/150dc8f0-1e0c-4604-b243-64ccf379c315-host-slash\") pod \"iptables-alerter-vwjqf\" (UID: \"150dc8f0-1e0c-4604-b243-64ccf379c315\") " pod="openshift-network-operator/iptables-alerter-vwjqf"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.937996    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7dddc3f3-4833-4d05-8db0-86e663dde23c-dbus\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938021    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-run-systemd\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938049    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z2lk\" (UniqueName: \"kubernetes.io/projected/150dc8f0-1e0c-4604-b243-64ccf379c315-kube-api-access-4z2lk\") pod \"iptables-alerter-vwjqf\" (UID: \"150dc8f0-1e0c-4604-b243-64ccf379c315\") " pod="openshift-network-operator/iptables-alerter-vwjqf"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938075    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-hostroot\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938081    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/150dc8f0-1e0c-4604-b243-64ccf379c315-host-slash\") pod \"iptables-alerter-vwjqf\" (UID: \"150dc8f0-1e0c-4604-b243-64ccf379c315\") " pod="openshift-network-operator/iptables-alerter-vwjqf"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938102    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-tuned\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938127    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-cni-netd\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938170    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a732f775-e8f5-449a-bbc9-3444417b18a3-ovnkube-script-lib\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938198    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xnjm\" (UniqueName: \"kubernetes.io/projected/9b299cfd-4132-4261-a395-5426f00c0416-kube-api-access-7xnjm\") pod \"node-resolver-4l5xq\" (UID: \"9b299cfd-4132-4261-a395-5426f00c0416\") " pod="openshift-dns/node-resolver-4l5xq"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938224    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mbs2\" (UniqueName: \"kubernetes.io/projected/83b6973e-7235-4802-9583-12796420ee80-kube-api-access-7mbs2\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:43.939441 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938247    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-cnibin\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938265    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-os-release\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938280    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-run-k8s-cni-cncf-io\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938298    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-systemd\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938317    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-run\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938358    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b299cfd-4132-4261-a395-5426f00c0416-hosts-file\") pod \"node-resolver-4l5xq\" (UID: \"9b299cfd-4132-4261-a395-5426f00c0416\") " pod="openshift-dns/node-resolver-4l5xq"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938383    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b299cfd-4132-4261-a395-5426f00c0416-tmp-dir\") pod \"node-resolver-4l5xq\" (UID: \"9b299cfd-4132-4261-a395-5426f00c0416\") " pod="openshift-dns/node-resolver-4l5xq"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938403    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-var-lib-cni-multus\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938431    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljq7p\" (UniqueName: \"kubernetes.io/projected/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-kube-api-access-ljq7p\") pod \"network-metrics-daemon-f5vcq\" (UID: \"ad4922e5-5a9e-45d9-93db-5fd8d2534abd\") " pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938472    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-sysctl-d\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938496    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-sysctl-conf\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938626    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-hostroot\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938821    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-cnibin\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938843    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b299cfd-4132-4261-a395-5426f00c0416-hosts-file\") pod \"node-resolver-4l5xq\" (UID: \"9b299cfd-4132-4261-a395-5426f00c0416\") " pod="openshift-dns/node-resolver-4l5xq"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938914    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-os-release\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.938964    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-run-k8s-cni-cncf-io\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.939026    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-host-var-lib-cni-multus\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.939222    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b299cfd-4132-4261-a395-5426f00c0416-tmp-dir\") pod \"node-resolver-4l5xq\" (UID: \"9b299cfd-4132-4261-a395-5426f00c0416\") " pod="openshift-dns/node-resolver-4l5xq"
Jul 14 21:37:43.940202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.939235    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/150dc8f0-1e0c-4604-b243-64ccf379c315-iptables-alerter-script\") pod \"iptables-alerter-vwjqf\" (UID: \"150dc8f0-1e0c-4604-b243-64ccf379c315\") " pod="openshift-network-operator/iptables-alerter-vwjqf"
Jul 14 21:37:43.961381 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.961341    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 21:37:43.964993 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.964965    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xnjm\" (UniqueName: \"kubernetes.io/projected/9b299cfd-4132-4261-a395-5426f00c0416-kube-api-access-7xnjm\") pod \"node-resolver-4l5xq\" (UID: \"9b299cfd-4132-4261-a395-5426f00c0416\") " pod="openshift-dns/node-resolver-4l5xq"
Jul 14 21:37:43.964993 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.964982    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z2lk\" (UniqueName: \"kubernetes.io/projected/150dc8f0-1e0c-4604-b243-64ccf379c315-kube-api-access-4z2lk\") pod \"iptables-alerter-vwjqf\" (UID: \"150dc8f0-1e0c-4604-b243-64ccf379c315\") " pod="openshift-network-operator/iptables-alerter-vwjqf"
Jul 14 21:37:43.965205 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.965013    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dbs4\" (UniqueName: \"kubernetes.io/projected/0f5c8ed9-53a1-4533-926a-d65ea2a8d69b-kube-api-access-7dbs4\") pod \"multus-hht8r\" (UID: \"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b\") " pod="openshift-multus/multus-hht8r"
Jul 14 21:37:43.969066 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.969037    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljq7p\" (UniqueName: \"kubernetes.io/projected/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-kube-api-access-ljq7p\") pod \"network-metrics-daemon-f5vcq\" (UID: \"ad4922e5-5a9e-45d9-93db-5fd8d2534abd\") " pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:43.969730 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:43.969703    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mbs2\" (UniqueName: \"kubernetes.io/projected/83b6973e-7235-4802-9583-12796420ee80-kube-api-access-7mbs2\") pod \"aws-ebs-csi-driver-node-xpz6l\" (UID: \"83b6973e-7235-4802-9583-12796420ee80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:44.039614 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039571    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7dddc3f3-4833-4d05-8db0-86e663dde23c-dbus\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:44.039614 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039618    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-run-systemd\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.039881 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039647    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-tuned\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.039881 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039667    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-cni-netd\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.039881 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039684    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a732f775-e8f5-449a-bbc9-3444417b18a3-ovnkube-script-lib\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.039881 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039706    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-systemd\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.039881 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039731    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-run\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.039881 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039758    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-sysctl-d\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.039881 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039772    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7dddc3f3-4833-4d05-8db0-86e663dde23c-dbus\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:44.039881 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039773    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-run-systemd\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.039881 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039782    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-sysctl-conf\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.039881 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039776    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-cni-netd\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.039881 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039838    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-systemd\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.039881 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039860    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-modprobe-d\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039906    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-var-lib-kubelet\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039924    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-sysctl-d\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039940    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a732f775-e8f5-449a-bbc9-3444417b18a3-ovn-node-metrics-cert\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039968    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-sysctl-conf\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039944    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-modprobe-d\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039971    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18a6bb3a-2e83-4b23-9129-6612da3726f5-konnectivity-ca\") pod \"konnectivity-agent-hxqwh\" (UID: \"18a6bb3a-2e83-4b23-9129-6612da3726f5\") " pod="kube-system/konnectivity-agent-hxqwh"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039977    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-run\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-sys\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.039983    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-var-lib-kubelet\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040058    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjd2\" (UniqueName: \"kubernetes.io/projected/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-kube-api-access-gdjd2\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040124    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-etc-openvswitch\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040164    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-run-openvswitch\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040195    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040224    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a732f775-e8f5-449a-bbc9-3444417b18a3-ovnkube-config\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040238    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-etc-openvswitch\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040251    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.040526 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040306    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-sysconfig\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040326    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-run-openvswitch\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040337    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-tmp\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040364    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77-serviceca\") pod \"node-ca-7zd76\" (UID: \"c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77\") " pod="openshift-image-registry/node-ca-7zd76"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040378    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040393    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7dddc3f3-4833-4d05-8db0-86e663dde23c-kubelet-config\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040424    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6k4d\" (UniqueName: \"kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d\") pod \"network-check-target-26bng\" (UID: \"60090e8b-aefa-43fa-9bb0-ff481a0fc9f3\") " pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040454    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040459    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-sys\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18a6bb3a-2e83-4b23-9129-6612da3726f5-agent-certs\") pod \"konnectivity-agent-hxqwh\" (UID: \"18a6bb3a-2e83-4b23-9129-6612da3726f5\") " pod="kube-system/konnectivity-agent-hxqwh"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040507    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-systemd-units\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040531    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-slash\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040557    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040572    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18a6bb3a-2e83-4b23-9129-6612da3726f5-konnectivity-ca\") pod \"konnectivity-agent-hxqwh\" (UID: \"18a6bb3a-2e83-4b23-9129-6612da3726f5\") " pod="kube-system/konnectivity-agent-hxqwh"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040587    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-kubernetes\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040613    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-lib-modules\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040637    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-run-netns\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.041384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040637    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-sysconfig\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040667    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-cni-bin\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040753    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-node-log\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.040943    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77-serviceca\") pod \"node-ca-7zd76\" (UID: \"c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77\") " pod="openshift-image-registry/node-ca-7zd76"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041001    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a732f775-e8f5-449a-bbc9-3444417b18a3-ovnkube-config\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041271    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a732f775-e8f5-449a-bbc9-3444417b18a3-ovnkube-script-lib\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041293    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041362    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7dddc3f3-4833-4d05-8db0-86e663dde23c-kubelet-config\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041376    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-systemd-units\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041421    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-slash\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041453    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041473    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-run-netns\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041506    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-kubernetes\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041555    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-cni-bin\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041609    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-lib-modules\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041613    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-node-log\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041749    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-log-socket\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041760    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-log-socket\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.042282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041788    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a732f775-e8f5-449a-bbc9-3444417b18a3-env-overrides\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041817    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w8nj\" (UniqueName: \"kubernetes.io/projected/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-kube-api-access-9w8nj\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041844    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77-host\") pod \"node-ca-7zd76\" (UID: \"c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77\") " pod="openshift-image-registry/node-ca-7zd76"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041864    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041871    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg8g9\" (UniqueName: \"kubernetes.io/projected/a732f775-e8f5-449a-bbc9-3444417b18a3-kube-api-access-sg8g9\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041941    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041971    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-var-lib-openvswitch\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.041996    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-run-ovn\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042021    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-cnibin\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042047    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-host\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042074    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtfkg\" (UniqueName: \"kubernetes.io/projected/c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77-kube-api-access-gtfkg\") pod \"node-ca-7zd76\" (UID: \"c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77\") " pod="openshift-image-registry/node-ca-7zd76"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042102    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-kubelet\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042168    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-system-cni-dir\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042218    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-os-release\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042247    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042389    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77-host\") pod \"node-ca-7zd76\" (UID: \"c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77\") " pod="openshift-image-registry/node-ca-7zd76"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042465    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-host\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.043278 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.042545    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 21:37:44.044104 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.042608    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret podName:7dddc3f3-4833-4d05-8db0-86e663dde23c nodeName:}" failed. No retries permitted until 2026-07-14 21:37:44.542588279 +0000 UTC m=+3.027680910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret") pod "global-pull-secret-syncer-tmv56" (UID: "7dddc3f3-4833-4d05-8db0-86e663dde23c") : object "kube-system"/"original-pull-secret" not registered
Jul 14 21:37:44.044104 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042671    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-etc-tuned\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.044104 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042745    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.044104 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042768    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.044104 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042822    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-var-lib-openvswitch\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.044104 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042847    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-system-cni-dir\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.044104 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042869    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-run-ovn\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.044104 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042916    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-cnibin\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.044104 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042918    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a732f775-e8f5-449a-bbc9-3444417b18a3-host-kubelet\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.044104 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.042991    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-os-release\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.044104 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.043271    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a732f775-e8f5-449a-bbc9-3444417b18a3-ovn-node-metrics-cert\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.044104 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.043279    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a732f775-e8f5-449a-bbc9-3444417b18a3-env-overrides\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.044104 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.043446    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18a6bb3a-2e83-4b23-9129-6612da3726f5-agent-certs\") pod \"konnectivity-agent-hxqwh\" (UID: \"18a6bb3a-2e83-4b23-9129-6612da3726f5\") " pod="kube-system/konnectivity-agent-hxqwh"
Jul 14 21:37:44.044104 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.043451    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-tmp\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.059371 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.059344    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdjd2\" (UniqueName: \"kubernetes.io/projected/e0db4b2f-76e8-4240-bb70-3f2bd9f07460-kube-api-access-gdjd2\") pod \"tuned-2z64w\" (UID: \"e0db4b2f-76e8-4240-bb70-3f2bd9f07460\") " pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.065751 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.065717    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg8g9\" (UniqueName: \"kubernetes.io/projected/a732f775-e8f5-449a-bbc9-3444417b18a3-kube-api-access-sg8g9\") pod \"ovnkube-node-wfbd8\" (UID: \"a732f775-e8f5-449a-bbc9-3444417b18a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.067608 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.067577    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtfkg\" (UniqueName: \"kubernetes.io/projected/c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77-kube-api-access-gtfkg\") pod \"node-ca-7zd76\" (UID: \"c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77\") " pod="openshift-image-registry/node-ca-7zd76"
Jul 14 21:37:44.070590 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.070565    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 21:37:44.070590 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.070594    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 21:37:44.070766 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.070605    2572 projected.go:196] Error preparing data for projected volume kube-api-access-v6k4d for pod openshift-network-diagnostics/network-check-target-26bng: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:37:44.070766 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.070674    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d podName:60090e8b-aefa-43fa-9bb0-ff481a0fc9f3 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:44.570653431 +0000 UTC m=+3.055746067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v6k4d" (UniqueName: "kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d") pod "network-check-target-26bng" (UID: "60090e8b-aefa-43fa-9bb0-ff481a0fc9f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:37:44.074464 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.074434    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w8nj\" (UniqueName: \"kubernetes.io/projected/e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9-kube-api-access-9w8nj\") pod \"multus-additional-cni-plugins-hmqzr\" (UID: \"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9\") " pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.135328 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.135287    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vwjqf"
Jul 14 21:37:44.142746 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.142711    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4l5xq"
Jul 14 21:37:44.151746 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.151717    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l"
Jul 14 21:37:44.159555 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.159530    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hht8r"
Jul 14 21:37:44.167292 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.167267    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7zd76"
Jul 14 21:37:44.175141 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.175118    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hmqzr"
Jul 14 21:37:44.183788 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.183759    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hxqwh"
Jul 14 21:37:44.193975 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.193944    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:37:44.198883 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.198861    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2z64w"
Jul 14 21:37:44.445952 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.445848    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs\") pod \"network-metrics-daemon-f5vcq\" (UID: \"ad4922e5-5a9e-45d9-93db-5fd8d2534abd\") " pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:44.446155 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.446018    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:37:44.446155 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.446101    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs podName:ad4922e5-5a9e-45d9-93db-5fd8d2534abd nodeName:}" failed. No retries permitted until 2026-07-14 21:37:45.446080971 +0000 UTC m=+3.931173635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs") pod "network-metrics-daemon-f5vcq" (UID: "ad4922e5-5a9e-45d9-93db-5fd8d2534abd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:37:44.547010 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.546968    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:44.547215 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.547143    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 21:37:44.547269 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.547232    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret podName:7dddc3f3-4833-4d05-8db0-86e663dde23c nodeName:}" failed. No retries permitted until 2026-07-14 21:37:45.547215843 +0000 UTC m=+4.032308478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret") pod "global-pull-secret-syncer-tmv56" (UID: "7dddc3f3-4833-4d05-8db0-86e663dde23c") : object "kube-system"/"original-pull-secret" not registered
Jul 14 21:37:44.647624 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.647577    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6k4d\" (UniqueName: \"kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d\") pod \"network-check-target-26bng\" (UID: \"60090e8b-aefa-43fa-9bb0-ff481a0fc9f3\") " pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:44.647830 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.647756    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 21:37:44.647830 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.647778    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 21:37:44.647830 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.647789    2572 projected.go:196] Error preparing data for projected volume kube-api-access-v6k4d for pod openshift-network-diagnostics/network-check-target-26bng: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:37:44.647979 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.647850    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d podName:60090e8b-aefa-43fa-9bb0-ff481a0fc9f3 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:45.647831782 +0000 UTC m=+4.132924429 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6k4d" (UniqueName: "kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d") pod "network-check-target-26bng" (UID: "60090e8b-aefa-43fa-9bb0-ff481a0fc9f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:37:44.872944 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:44.872908    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5c8ed9_53a1_4533_926a_d65ea2a8d69b.slice/crio-2534c39247bc718e89bfa6ecb7c13648a4e5822f278a589e093a2f9b02fb0148 WatchSource:0}: Error finding container 2534c39247bc718e89bfa6ecb7c13648a4e5822f278a589e093a2f9b02fb0148: Status 404 returned error can't find the container with id 2534c39247bc718e89bfa6ecb7c13648a4e5822f278a589e093a2f9b02fb0148
Jul 14 21:37:44.877605 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:44.877444    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e8a59e_f4ba_4762_b1c6_0a436c3bf6f9.slice/crio-caf60d71b2ab44be883f4e53425dc9e8c6959130bfa34dc1252bfb6bd82a28f2 WatchSource:0}: Error finding container caf60d71b2ab44be883f4e53425dc9e8c6959130bfa34dc1252bfb6bd82a28f2: Status 404 returned error can't find the container with id caf60d71b2ab44be883f4e53425dc9e8c6959130bfa34dc1252bfb6bd82a28f2
Jul 14 21:37:44.880421 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:44.880392    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b91eda_ff5f_4e5d_bdb8_a4ac41c3dd77.slice/crio-d9a47f73b470cd06b0cffeda7064b3abd81faefac6a507770dcf6410cb2c958e WatchSource:0}: Error finding container d9a47f73b470cd06b0cffeda7064b3abd81faefac6a507770dcf6410cb2c958e: Status 404 returned error can't find the container with id d9a47f73b470cd06b0cffeda7064b3abd81faefac6a507770dcf6410cb2c958e
Jul 14 21:37:44.881208 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:44.881178    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod150dc8f0_1e0c_4604_b243_64ccf379c315.slice/crio-062f9eb1aeb38d426d3c702e7a68cd8e702da4712187e373254455dc2b65d3d9 WatchSource:0}: Error finding container 062f9eb1aeb38d426d3c702e7a68cd8e702da4712187e373254455dc2b65d3d9: Status 404 returned error can't find the container with id 062f9eb1aeb38d426d3c702e7a68cd8e702da4712187e373254455dc2b65d3d9
Jul 14 21:37:44.883342 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:44.883318    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a6bb3a_2e83_4b23_9129_6612da3726f5.slice/crio-036d33a62e5eff7ad94782ca8e045ca46d6bbdb3e0806635354bab47b9ee4f1c WatchSource:0}: Error finding container 036d33a62e5eff7ad94782ca8e045ca46d6bbdb3e0806635354bab47b9ee4f1c: Status 404 returned error can't find the container with id 036d33a62e5eff7ad94782ca8e045ca46d6bbdb3e0806635354bab47b9ee4f1c
Jul 14 21:37:44.883849 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:44.883824    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda732f775_e8f5_449a_bbc9_3444417b18a3.slice/crio-e60e9d626df33fcf024b316bc1b26741b9525586edb939f126ad7b09c31a121b WatchSource:0}: Error finding container e60e9d626df33fcf024b316bc1b26741b9525586edb939f126ad7b09c31a121b: Status 404 returned error can't find the container with id e60e9d626df33fcf024b316bc1b26741b9525586edb939f126ad7b09c31a121b
Jul 14 21:37:44.885381 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:37:44.885344    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b299cfd_4132_4261_a395_5426f00c0416.slice/crio-a7d010179d0336ef38a503b76fe6d1fa6a34394bfcfc7fd9ebc5989e2d305ae8 WatchSource:0}: Error finding container a7d010179d0336ef38a503b76fe6d1fa6a34394bfcfc7fd9ebc5989e2d305ae8: Status 404 returned error can't find the container with id a7d010179d0336ef38a503b76fe6d1fa6a34394bfcfc7fd9ebc5989e2d305ae8
Jul 14 21:37:44.890706 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.889638    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 21:32:43 +0000 UTC" deadline="2027-12-30 01:37:30.947414998 +0000 UTC"
Jul 14 21:37:44.890706 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.889685    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12795h59m46.057733907s"
Jul 14 21:37:44.973089 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.972889    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:44.973299 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:44.973224    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:37:44.984822 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.984783    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2z64w" event={"ID":"e0db4b2f-76e8-4240-bb70-3f2bd9f07460","Type":"ContainerStarted","Data":"9ad2564ab75c8c298600ed97c7218ad7c9400ae6f62a16fa18fc6e166436387a"}
Jul 14 21:37:44.986995 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.986967    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4l5xq" event={"ID":"9b299cfd-4132-4261-a395-5426f00c0416","Type":"ContainerStarted","Data":"a7d010179d0336ef38a503b76fe6d1fa6a34394bfcfc7fd9ebc5989e2d305ae8"}
Jul 14 21:37:44.989179 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.989152    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vwjqf" event={"ID":"150dc8f0-1e0c-4604-b243-64ccf379c315","Type":"ContainerStarted","Data":"062f9eb1aeb38d426d3c702e7a68cd8e702da4712187e373254455dc2b65d3d9"}
Jul 14 21:37:44.991989 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.991957    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7zd76" event={"ID":"c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77","Type":"ContainerStarted","Data":"d9a47f73b470cd06b0cffeda7064b3abd81faefac6a507770dcf6410cb2c958e"}
Jul 14 21:37:44.993776 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.993748    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmqzr" event={"ID":"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9","Type":"ContainerStarted","Data":"caf60d71b2ab44be883f4e53425dc9e8c6959130bfa34dc1252bfb6bd82a28f2"}
Jul 14 21:37:44.996414 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.996390    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8" event={"ID":"a732f775-e8f5-449a-bbc9-3444417b18a3","Type":"ContainerStarted","Data":"e60e9d626df33fcf024b316bc1b26741b9525586edb939f126ad7b09c31a121b"}
Jul 14 21:37:44.997318 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.997296    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hxqwh" event={"ID":"18a6bb3a-2e83-4b23-9129-6612da3726f5","Type":"ContainerStarted","Data":"036d33a62e5eff7ad94782ca8e045ca46d6bbdb3e0806635354bab47b9ee4f1c"}
Jul 14 21:37:44.999907 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:44.999882    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hht8r" event={"ID":"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b","Type":"ContainerStarted","Data":"2534c39247bc718e89bfa6ecb7c13648a4e5822f278a589e093a2f9b02fb0148"}
Jul 14 21:37:45.002247 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:45.002221    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal" event={"ID":"3f71cbe28c74af33d6d21b6fef376a32","Type":"ContainerStarted","Data":"3e6efd1e9100457d1e2bd90d864a12ef6fb0e8748f27bed2f1f6cdf18463278f"}
Jul 14 21:37:45.003661 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:45.003631    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l" event={"ID":"83b6973e-7235-4802-9583-12796420ee80","Type":"ContainerStarted","Data":"1f5bb0453e66bc8fcb9f23a01603c4562a4cdcaebbebf1c85e196b2d88c4887f"}
Jul 14 21:37:45.022374 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:45.022311    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-31.ec2.internal" podStartSLOduration=2.022296031 podStartE2EDuration="2.022296031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:37:45.022010619 +0000 UTC m=+3.507103271" watchObservedRunningTime="2026-07-14 21:37:45.022296031 +0000 UTC m=+3.507388683"
Jul 14 21:37:45.454291 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:45.453462    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs\") pod \"network-metrics-daemon-f5vcq\" (UID: \"ad4922e5-5a9e-45d9-93db-5fd8d2534abd\") " pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:45.454291 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:45.453751    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:37:45.454291 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:45.453821    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs podName:ad4922e5-5a9e-45d9-93db-5fd8d2534abd nodeName:}" failed. No retries permitted until 2026-07-14 21:37:47.453800501 +0000 UTC m=+5.938893131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs") pod "network-metrics-daemon-f5vcq" (UID: "ad4922e5-5a9e-45d9-93db-5fd8d2534abd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:37:45.554826 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:45.554782    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:45.555023 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:45.554951    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 21:37:45.555023 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:45.555020    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret podName:7dddc3f3-4833-4d05-8db0-86e663dde23c nodeName:}" failed. No retries permitted until 2026-07-14 21:37:47.555000023 +0000 UTC m=+6.040092660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret") pod "global-pull-secret-syncer-tmv56" (UID: "7dddc3f3-4833-4d05-8db0-86e663dde23c") : object "kube-system"/"original-pull-secret" not registered
Jul 14 21:37:45.655734 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:45.655693    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6k4d\" (UniqueName: \"kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d\") pod \"network-check-target-26bng\" (UID: \"60090e8b-aefa-43fa-9bb0-ff481a0fc9f3\") " pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:45.655917 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:45.655877    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 21:37:45.655917 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:45.655896    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 21:37:45.655917 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:45.655910    2572 projected.go:196] Error preparing data for projected volume kube-api-access-v6k4d for pod openshift-network-diagnostics/network-check-target-26bng: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:37:45.656097 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:45.655970    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d podName:60090e8b-aefa-43fa-9bb0-ff481a0fc9f3 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:47.655950722 +0000 UTC m=+6.141043367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6k4d" (UniqueName: "kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d") pod "network-check-target-26bng" (UID: "60090e8b-aefa-43fa-9bb0-ff481a0fc9f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:37:45.890452 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:45.890352    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 21:32:43 +0000 UTC" deadline="2027-12-29 22:18:21.163565054 +0000 UTC"
Jul 14 21:37:45.890452 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:45.890395    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12792h40m35.273174039s"
Jul 14 21:37:45.975305 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:45.975269    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:45.975501 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:45.975454    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:37:45.975823 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:45.975803    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:45.975932 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:45.975912    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:37:46.016600 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:46.016564    2572 generic.go:356] "Generic (PLEG): container finished" podID="e3715788632b0289973cb9034308be71" containerID="4715ff460a47e11307d2f7871467c26dc3516eac2ae1b8f52e0c1264d754d7fd" exitCode=0
Jul 14 21:37:46.017764 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:46.017533    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" event={"ID":"e3715788632b0289973cb9034308be71","Type":"ContainerDied","Data":"4715ff460a47e11307d2f7871467c26dc3516eac2ae1b8f52e0c1264d754d7fd"}
Jul 14 21:37:46.973408 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:46.973376    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:46.973915 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:46.973521    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:37:47.043301 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:47.043245    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" event={"ID":"e3715788632b0289973cb9034308be71","Type":"ContainerStarted","Data":"072bfed2de1d0df315f49006ab22177dc37bbd70e4b73982bd6c4f976455d0a4"}
Jul 14 21:37:47.472119 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:47.472013    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs\") pod \"network-metrics-daemon-f5vcq\" (UID: \"ad4922e5-5a9e-45d9-93db-5fd8d2534abd\") " pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:47.472644 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:47.472621    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:37:47.472736 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:47.472716    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs podName:ad4922e5-5a9e-45d9-93db-5fd8d2534abd nodeName:}" failed. No retries permitted until 2026-07-14 21:37:51.472691493 +0000 UTC m=+9.957784179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs") pod "network-metrics-daemon-f5vcq" (UID: "ad4922e5-5a9e-45d9-93db-5fd8d2534abd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:37:47.572680 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:47.572628    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:47.572879 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:47.572804    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 21:37:47.572879 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:47.572871    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret podName:7dddc3f3-4833-4d05-8db0-86e663dde23c nodeName:}" failed. No retries permitted until 2026-07-14 21:37:51.572851443 +0000 UTC m=+10.057944079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret") pod "global-pull-secret-syncer-tmv56" (UID: "7dddc3f3-4833-4d05-8db0-86e663dde23c") : object "kube-system"/"original-pull-secret" not registered
Jul 14 21:37:47.673385 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:47.673254    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6k4d\" (UniqueName: \"kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d\") pod \"network-check-target-26bng\" (UID: \"60090e8b-aefa-43fa-9bb0-ff481a0fc9f3\") " pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:47.673569 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:47.673462    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 21:37:47.673569 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:47.673489    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 21:37:47.673569 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:47.673505    2572 projected.go:196] Error preparing data for projected volume kube-api-access-v6k4d for pod openshift-network-diagnostics/network-check-target-26bng: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:37:47.673569 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:47.673569    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d podName:60090e8b-aefa-43fa-9bb0-ff481a0fc9f3 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:51.673549343 +0000 UTC m=+10.158641987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6k4d" (UniqueName: "kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d") pod "network-check-target-26bng" (UID: "60090e8b-aefa-43fa-9bb0-ff481a0fc9f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:37:47.973850 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:47.973602    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:47.973850 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:47.973639    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:47.973850 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:47.973756    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:37:47.975192 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:47.973989    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:37:48.973280 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:48.973239    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:48.973460 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:48.973394    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:37:49.973040 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:49.973010    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:49.973538 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:49.973020    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:49.973538 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:49.973156    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:37:49.973538 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:49.973227    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:37:50.973187 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:50.973152    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:50.973663 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:50.973296    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:37:51.508247 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:51.508096    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs\") pod \"network-metrics-daemon-f5vcq\" (UID: \"ad4922e5-5a9e-45d9-93db-5fd8d2534abd\") " pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:51.508247 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:51.508237    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:37:51.508512 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:51.508325    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs podName:ad4922e5-5a9e-45d9-93db-5fd8d2534abd nodeName:}" failed. No retries permitted until 2026-07-14 21:37:59.508301487 +0000 UTC m=+17.993394119 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs") pod "network-metrics-daemon-f5vcq" (UID: "ad4922e5-5a9e-45d9-93db-5fd8d2534abd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:37:51.609334 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:51.609216    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:51.609501 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:51.609364    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 21:37:51.609501 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:51.609427    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret podName:7dddc3f3-4833-4d05-8db0-86e663dde23c nodeName:}" failed. No retries permitted until 2026-07-14 21:37:59.609409469 +0000 UTC m=+18.094502106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret") pod "global-pull-secret-syncer-tmv56" (UID: "7dddc3f3-4833-4d05-8db0-86e663dde23c") : object "kube-system"/"original-pull-secret" not registered
Jul 14 21:37:51.710559 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:51.710510    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6k4d\" (UniqueName: \"kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d\") pod \"network-check-target-26bng\" (UID: \"60090e8b-aefa-43fa-9bb0-ff481a0fc9f3\") " pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:51.710743 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:51.710656    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 21:37:51.710743 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:51.710687    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 21:37:51.710743 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:51.710700    2572 projected.go:196] Error preparing data for projected volume kube-api-access-v6k4d for pod openshift-network-diagnostics/network-check-target-26bng: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:37:51.710899 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:51.710757    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d podName:60090e8b-aefa-43fa-9bb0-ff481a0fc9f3 nodeName:}" failed. No retries permitted until 2026-07-14 21:37:59.710736113 +0000 UTC m=+18.195828747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6k4d" (UniqueName: "kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d") pod "network-check-target-26bng" (UID: "60090e8b-aefa-43fa-9bb0-ff481a0fc9f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:37:51.974682 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:51.974555    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:51.974682 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:51.974671    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:37:51.975209 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:51.975128    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:51.975262 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:51.975233    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:37:52.973737 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:52.973691    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:52.973917 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:52.973831    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:37:53.973379 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:53.973312    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:53.973872 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:53.973517    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:37:53.973872 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:53.973581    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:53.973872 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:53.973695    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:37:54.972853 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:54.972815    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:54.973059 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:54.972963    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:37:55.972796 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:55.972718    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:55.972796 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:55.972743    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:55.973351 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:55.972842    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:37:55.973351 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:55.972995    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:37:56.973250 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:56.973208    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:56.973745 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:56.973359    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:37:57.973222 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:57.973174    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:57.973422 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:57.973319    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:37:57.973422 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:57.973384    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:57.973831 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:57.973497    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:37:58.973580 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:58.973532    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:58.974177 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:58.973693    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:37:59.573501 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:59.573460    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs\") pod \"network-metrics-daemon-f5vcq\" (UID: \"ad4922e5-5a9e-45d9-93db-5fd8d2534abd\") " pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:37:59.573705 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:59.573635    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:37:59.573772 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:59.573717    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs podName:ad4922e5-5a9e-45d9-93db-5fd8d2534abd nodeName:}" failed. No retries permitted until 2026-07-14 21:38:15.573697034 +0000 UTC m=+34.058789668 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs") pod "network-metrics-daemon-f5vcq" (UID: "ad4922e5-5a9e-45d9-93db-5fd8d2534abd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:37:59.674250 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:59.674212    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:59.674431 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:59.674343    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 21:37:59.674431 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:59.674406    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret podName:7dddc3f3-4833-4d05-8db0-86e663dde23c nodeName:}" failed. No retries permitted until 2026-07-14 21:38:15.67439186 +0000 UTC m=+34.159484490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret") pod "global-pull-secret-syncer-tmv56" (UID: "7dddc3f3-4833-4d05-8db0-86e663dde23c") : object "kube-system"/"original-pull-secret" not registered
Jul 14 21:37:59.775529 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:59.775485    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6k4d\" (UniqueName: \"kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d\") pod \"network-check-target-26bng\" (UID: \"60090e8b-aefa-43fa-9bb0-ff481a0fc9f3\") " pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:59.775690 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:59.775657    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 21:37:59.775690 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:59.775679    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 21:37:59.775690 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:59.775689    2572 projected.go:196] Error preparing data for projected volume kube-api-access-v6k4d for pod openshift-network-diagnostics/network-check-target-26bng: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:37:59.775819 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:59.775753    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d podName:60090e8b-aefa-43fa-9bb0-ff481a0fc9f3 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:15.77573298 +0000 UTC m=+34.260825609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6k4d" (UniqueName: "kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d") pod "network-check-target-26bng" (UID: "60090e8b-aefa-43fa-9bb0-ff481a0fc9f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:37:59.976173 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:59.976087    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:37:59.976609 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:37:59.976087    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:37:59.976609 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:59.976216    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:37:59.976609 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:37:59.976309    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:00.973723 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:00.973685    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:00.973919 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:00.973823    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:01.973567 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:01.973536    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:01.974018 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:01.973648    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:01.974018 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:01.973714    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:01.974018 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:01.973836    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:02.973415 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:02.973378    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:02.973607 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:02.973524    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:03.973538 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:03.973156    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:03.973627 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:03.973182    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:03.974166 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:03.973652    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:03.974166 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:03.973712    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:04.081169 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.081142    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l" event={"ID":"83b6973e-7235-4802-9583-12796420ee80","Type":"ContainerStarted","Data":"cf4455b792acd91efd4a4e64a585adfa16f6741c1b9c5e9929c0bd44a53318cf"}
Jul 14 21:38:04.082469 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.082444    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2z64w" event={"ID":"e0db4b2f-76e8-4240-bb70-3f2bd9f07460","Type":"ContainerStarted","Data":"32869e034e673f5a42778f7377d92245695ed2f9d81f9eea34be308f65d9ccec"}
Jul 14 21:38:04.083690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.083669    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4l5xq" event={"ID":"9b299cfd-4132-4261-a395-5426f00c0416","Type":"ContainerStarted","Data":"ccb3b5bbfa31b8244787a63d5b4e8793abf2621f603bbc30d1c385a83d90b865"}
Jul 14 21:38:04.084970 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.084949    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7zd76" event={"ID":"c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77","Type":"ContainerStarted","Data":"03bafdb2f1f8f9984ccdee1f0edc58bbf0a728211d487710d3fab98e8c7c070b"}
Jul 14 21:38:04.086279 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.086258    2572 generic.go:356] "Generic (PLEG): container finished" podID="e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9" containerID="2361a9e0ed05fe88feea2c16e98024aa424eb2207aad568679acb8e4e4c8d1cd" exitCode=0
Jul 14 21:38:04.086367 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.086297    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmqzr" event={"ID":"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9","Type":"ContainerDied","Data":"2361a9e0ed05fe88feea2c16e98024aa424eb2207aad568679acb8e4e4c8d1cd"}
Jul 14 21:38:04.088723 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.088704    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 21:38:04.089046 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.089029    2572 generic.go:356] "Generic (PLEG): container finished" podID="a732f775-e8f5-449a-bbc9-3444417b18a3" containerID="a07c0b7764b0489cad6f1ed41880370c7ae27344f9c8d76e7087d56c8b8b0518" exitCode=1
Jul 14 21:38:04.089127 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.089090    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8" event={"ID":"a732f775-e8f5-449a-bbc9-3444417b18a3","Type":"ContainerStarted","Data":"2f22e8abfae1163df2b10f3ba392dd23fe315d3fe4865b692e4e16e21fb32f02"}
Jul 14 21:38:04.089186 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.089168    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8" event={"ID":"a732f775-e8f5-449a-bbc9-3444417b18a3","Type":"ContainerStarted","Data":"0bb93c891e615b9601982abc629911e56bce0d7fac959759df215f39e5d5b5a3"}
Jul 14 21:38:04.089233 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.089211    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8" event={"ID":"a732f775-e8f5-449a-bbc9-3444417b18a3","Type":"ContainerStarted","Data":"bc056d11cfd2fc1515275aa15bd9534bd9393119e4a4c4580b305073d98d12ee"}
Jul 14 21:38:04.089268 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.089245    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8" event={"ID":"a732f775-e8f5-449a-bbc9-3444417b18a3","Type":"ContainerDied","Data":"a07c0b7764b0489cad6f1ed41880370c7ae27344f9c8d76e7087d56c8b8b0518"}
Jul 14 21:38:04.089309 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.089275    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8" event={"ID":"a732f775-e8f5-449a-bbc9-3444417b18a3","Type":"ContainerStarted","Data":"dd4af674c53e41d6d3bef5b3973efee4825b898182bb07badb3004aff4321b7b"}
Jul 14 21:38:04.090416 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.090400    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hxqwh" event={"ID":"18a6bb3a-2e83-4b23-9129-6612da3726f5","Type":"ContainerStarted","Data":"ffc174164b8ac446ce9f402fb0ff71264073d7475098b6c4c7f6804e67bf4974"}
Jul 14 21:38:04.091631 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.091608    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hht8r" event={"ID":"0f5c8ed9-53a1-4533-926a-d65ea2a8d69b","Type":"ContainerStarted","Data":"3d0f920562fff05fc8a68cd7c5412025a89afda67d933e7daf11fcda462c2da0"}
Jul 14 21:38:04.114552 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.114517    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2z64w" podStartSLOduration=3.522726729 podStartE2EDuration="22.114504665s" totalImagesPullingTime="18.591777936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:04.114405912 +0000 UTC m=+22.599498564" watchObservedRunningTime="2026-07-14 21:38:04.114504665 +0000 UTC m=+22.599597317"
Jul 14 21:38:04.114672 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.114656    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-31.ec2.internal" podStartSLOduration=21.114652249 podStartE2EDuration="21.114652249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:37:47.071229818 +0000 UTC m=+5.556322470" watchObservedRunningTime="2026-07-14 21:38:04.114652249 +0000 UTC m=+22.599744899"
Jul 14 21:38:04.150911 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.150867    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hxqwh" podStartSLOduration=11.62324613 podStartE2EDuration="22.1508524s" totalImagesPullingTime="10.52760627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:04.149762276 +0000 UTC m=+22.634854938" watchObservedRunningTime="2026-07-14 21:38:04.1508524 +0000 UTC m=+22.635945051"
Jul 14 21:38:04.178332 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.177536    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4l5xq" podStartSLOduration=3.588022439 podStartE2EDuration="22.177515234s" totalImagesPullingTime="18.589492795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:04.17643235 +0000 UTC m=+22.661525023" watchObservedRunningTime="2026-07-14 21:38:04.177515234 +0000 UTC m=+22.662607893"
Jul 14 21:38:04.211516 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.211443    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7zd76" podStartSLOduration=3.616422181 podStartE2EDuration="22.211422087s" totalImagesPullingTime="18.594999906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:04.21100481 +0000 UTC m=+22.696097463" watchObservedRunningTime="2026-07-14 21:38:04.211422087 +0000 UTC m=+22.696514745"
Jul 14 21:38:04.350502 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.350404    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hht8r" podStartSLOduration=3.689631013 podStartE2EDuration="22.350386008s" totalImagesPullingTime="18.660754995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:04.280923373 +0000 UTC m=+22.766016025" watchObservedRunningTime="2026-07-14 21:38:04.350386008 +0000 UTC m=+22.835478668"
Jul 14 21:38:04.972732 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:04.972673    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:04.972878 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:04.972791    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:05.025093 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:05.025064    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 21:38:05.096700 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:05.096658    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l" event={"ID":"83b6973e-7235-4802-9583-12796420ee80","Type":"ContainerStarted","Data":"761886555d5c0545e5674b332021bf86697217279a1a78a292172ad57627960a"}
Jul 14 21:38:05.098132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:05.098087    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vwjqf" event={"ID":"150dc8f0-1e0c-4604-b243-64ccf379c315","Type":"ContainerStarted","Data":"a3811b0c8dce6266be6155deb9c2be7bf359d939495b7e01616fdd499407910f"}
Jul 14 21:38:05.101118 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:05.101085    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 21:38:05.101502 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:05.101477    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8" event={"ID":"a732f775-e8f5-449a-bbc9-3444417b18a3","Type":"ContainerStarted","Data":"8b63acb77f9af87eeeb060f424928a95579511437451789b0fb05d45fa7f3d4f"}
Jul 14 21:38:05.115999 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:05.115942    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vwjqf" podStartSLOduration=4.519760421 podStartE2EDuration="23.115920618s" totalImagesPullingTime="18.596160197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:05.115742998 +0000 UTC m=+23.600835650" watchObservedRunningTime="2026-07-14 21:38:05.115920618 +0000 UTC m=+23.601013271"
Jul 14 21:38:05.881826 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:05.881709    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T21:38:05.025084812Z","UUID":"402008ea-74dc-42d4-abc3-1ef3ff5fda43","Handler":null,"Name":"","Endpoint":""}
Jul 14 21:38:05.884048 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:05.884026    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 21:38:05.884195 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:05.884071    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 21:38:05.972983 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:05.972951    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:05.973181 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:05.972952    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:05.973181 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:05.973074    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:05.973181 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:05.973170    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:06.973586 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:06.973370    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:06.974068 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:06.973704    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:07.109203 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:07.109170    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 21:38:07.109673 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:07.109635    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8" event={"ID":"a732f775-e8f5-449a-bbc9-3444417b18a3","Type":"ContainerStarted","Data":"e888515cf3c8ec31cbe23d9a5554545161b14bf815f2f10faa85843ba807d6cf"}
Jul 14 21:38:07.112066 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:07.112034    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l" event={"ID":"83b6973e-7235-4802-9583-12796420ee80","Type":"ContainerStarted","Data":"da44a0bcb5edeabed1ee88bc42819fcba2b4eec9553cc99102e7ecd7656d5667"}
Jul 14 21:38:07.140297 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:07.140235    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpz6l" podStartSLOduration=4.132832014 podStartE2EDuration="25.140213875s" totalImagesPullingTime="21.007381861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:07.140063396 +0000 UTC m=+25.625156079" watchObservedRunningTime="2026-07-14 21:38:07.140213875 +0000 UTC m=+25.625306531"
Jul 14 21:38:07.972712 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:07.972682    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:07.973098 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:07.972680    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:07.973098 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:07.972818    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:07.973098 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:07.972897    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:08.155197 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:08.155172    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4l5xq_9b299cfd-4132-4261-a395-5426f00c0416/dns-node-resolver/0.log"
Jul 14 21:38:08.973390 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:08.973125    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:08.973552 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:08.973442    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:09.063386 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:09.063340    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hxqwh"
Jul 14 21:38:09.063957 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:09.063942    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hxqwh"
Jul 14 21:38:09.119041 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:09.119008    2572 generic.go:356] "Generic (PLEG): container finished" podID="e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9" containerID="ad762a1b245acf82f78e7ac33f1326e396ba62afdc14e49d93cb93da23e08529" exitCode=0
Jul 14 21:38:09.119250 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:09.119095    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmqzr" event={"ID":"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9","Type":"ContainerDied","Data":"ad762a1b245acf82f78e7ac33f1326e396ba62afdc14e49d93cb93da23e08529"}
Jul 14 21:38:09.122807 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:09.122784    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 21:38:09.123197 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:09.123170    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8" event={"ID":"a732f775-e8f5-449a-bbc9-3444417b18a3","Type":"ContainerStarted","Data":"f1b896f7599ba3cab40b5bc820508791225ee7a4f52e0b4ff7799998aa72f1ee"}
Jul 14 21:38:09.123442 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:09.123421    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hxqwh"
Jul 14 21:38:09.123679 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:09.123662    2572 scope.go:117] "RemoveContainer" containerID="a07c0b7764b0489cad6f1ed41880370c7ae27344f9c8d76e7087d56c8b8b0518"
Jul 14 21:38:09.123859 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:09.123846    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hxqwh"
Jul 14 21:38:09.323228 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:09.323157    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7zd76_c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77/node-ca/0.log"
Jul 14 21:38:09.973568 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:09.973248    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:09.973568 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:09.973300    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:09.973568 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:09.973392    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:09.973568 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:09.973535    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:10.129373 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:10.129346    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 21:38:10.129799 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:10.129767    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8" event={"ID":"a732f775-e8f5-449a-bbc9-3444417b18a3","Type":"ContainerStarted","Data":"65761e649f82164c54270c29552223c284304525440c486aac1587809873614e"}
Jul 14 21:38:10.130192 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:10.130002    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:38:10.130192 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:10.130080    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:38:10.130192 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:10.130144    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:38:10.145626 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:10.145600    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:38:10.145767 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:10.145702    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:38:10.178494 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:10.178382    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8" podStartSLOduration=9.510935133 podStartE2EDuration="28.178360449s" totalImagesPullingTime="18.667425316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:10.174946783 +0000 UTC m=+28.660039436" watchObservedRunningTime="2026-07-14 21:38:10.178360449 +0000 UTC m=+28.663453098"
Jul 14 21:38:10.973041 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:10.973005    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:10.973515 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:10.973142    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:11.134583 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:11.134548    2572 generic.go:356] "Generic (PLEG): container finished" podID="e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9" containerID="777b1365da682106ccc5d93f248b7f0e7826629c3fafa2e5596205d896f3b92c" exitCode=0
Jul 14 21:38:11.134765 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:11.134628    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmqzr" event={"ID":"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9","Type":"ContainerDied","Data":"777b1365da682106ccc5d93f248b7f0e7826629c3fafa2e5596205d896f3b92c"}
Jul 14 21:38:11.974672 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:11.974622    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:11.975177 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:11.974695    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:11.975177 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:11.974817    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:11.977377 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:11.975435    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:12.973422 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:12.973383    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:12.973596 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:12.973501    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:13.140893 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:13.140857    2572 generic.go:356] "Generic (PLEG): container finished" podID="e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9" containerID="be08d6ac0b6e4411c05ce85dc6da579cb476ea14317b73926924b82fd63f9ad0" exitCode=0
Jul 14 21:38:13.141303 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:13.140922    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmqzr" event={"ID":"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9","Type":"ContainerDied","Data":"be08d6ac0b6e4411c05ce85dc6da579cb476ea14317b73926924b82fd63f9ad0"}
Jul 14 21:38:13.973350 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:13.973316    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:13.973534 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:13.973327    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:13.973534 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:13.973460    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:13.973534 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:13.973501    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:14.973374 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:14.973339    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:14.973830 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:14.973476    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:15.590316 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:15.590277    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs\") pod \"network-metrics-daemon-f5vcq\" (UID: \"ad4922e5-5a9e-45d9-93db-5fd8d2534abd\") " pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:15.590527 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:15.590454    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:38:15.590595 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:15.590544    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs podName:ad4922e5-5a9e-45d9-93db-5fd8d2534abd nodeName:}" failed. No retries permitted until 2026-07-14 21:38:47.590521095 +0000 UTC m=+66.075613742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs") pod "network-metrics-daemon-f5vcq" (UID: "ad4922e5-5a9e-45d9-93db-5fd8d2534abd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:38:15.690812 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:15.690779    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:15.690968 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:15.690906    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 21:38:15.690968 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:15.690955    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret podName:7dddc3f3-4833-4d05-8db0-86e663dde23c nodeName:}" failed. No retries permitted until 2026-07-14 21:38:47.69094114 +0000 UTC m=+66.176033770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret") pod "global-pull-secret-syncer-tmv56" (UID: "7dddc3f3-4833-4d05-8db0-86e663dde23c") : object "kube-system"/"original-pull-secret" not registered
Jul 14 21:38:15.791069 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:15.791040    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6k4d\" (UniqueName: \"kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d\") pod \"network-check-target-26bng\" (UID: \"60090e8b-aefa-43fa-9bb0-ff481a0fc9f3\") " pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:15.791253 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:15.791218    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 21:38:15.791253 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:15.791240    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 21:38:15.791253 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:15.791250    2572 projected.go:196] Error preparing data for projected volume kube-api-access-v6k4d for pod openshift-network-diagnostics/network-check-target-26bng: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:38:15.791373 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:15.791302    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d podName:60090e8b-aefa-43fa-9bb0-ff481a0fc9f3 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:47.79128867 +0000 UTC m=+66.276381300 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6k4d" (UniqueName: "kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d") pod "network-check-target-26bng" (UID: "60090e8b-aefa-43fa-9bb0-ff481a0fc9f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:38:15.972978 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:15.972717    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:15.973170 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:15.972739    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:15.973170 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:15.973031    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:15.973170 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:15.973120    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:16.973343 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:16.973309    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:16.973765 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:16.973464    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:17.972897 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:17.972809    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:17.973045 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:17.972941    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:17.973045 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:17.972973    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:17.973045 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:17.973036    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:18.157456 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:18.157421    2572 generic.go:356] "Generic (PLEG): container finished" podID="e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9" containerID="e1b29751aa95d48037672c43f7a97210ba315892fe9c61a3082fe7695fa89490" exitCode=0
Jul 14 21:38:18.157914 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:18.157478    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmqzr" event={"ID":"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9","Type":"ContainerDied","Data":"e1b29751aa95d48037672c43f7a97210ba315892fe9c61a3082fe7695fa89490"}
Jul 14 21:38:18.973350 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:18.973322    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:18.973494 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:18.973420    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:19.162228 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:19.162198    2572 generic.go:356] "Generic (PLEG): container finished" podID="e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9" containerID="00b58daa07059d5c7ad0c6e264d26c9baf06aec1dbf29fa2f6c0c119271e78c2" exitCode=0
Jul 14 21:38:19.162542 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:19.162277    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmqzr" event={"ID":"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9","Type":"ContainerDied","Data":"00b58daa07059d5c7ad0c6e264d26c9baf06aec1dbf29fa2f6c0c119271e78c2"}
Jul 14 21:38:19.972724 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:19.972694    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:19.972895 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:19.972791    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:19.972895 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:19.972848    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:19.972975 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:19.972928    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:20.167391 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:20.167362    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hmqzr" event={"ID":"e5e8a59e-f4ba-4762-b1c6-0a436c3bf6f9","Type":"ContainerStarted","Data":"f2c5a7fb9c776f970af7c0c863c57a38e81a44c3607f0ecbcda7d53bea1d033f"}
Jul 14 21:38:20.196619 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:20.196577    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hmqzr" podStartSLOduration=8.144629197 podStartE2EDuration="38.196560622s" totalImagesPullingTime="30.051931425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:20.196145563 +0000 UTC m=+38.681238215" watchObservedRunningTime="2026-07-14 21:38:20.196560622 +0000 UTC m=+38.681653271"
Jul 14 21:38:20.972726 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:20.972692    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:20.972929 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:20.972822    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:21.973780 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:21.973735    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:21.974340 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:21.973842    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:21.974340 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:21.973920    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:21.974340 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:21.974007    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:22.973653 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:22.973617    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:22.973852 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:22.973732    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:23.973185 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:23.973147    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:23.973185 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:23.973184    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:23.973415 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:23.973282    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:23.973473 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:23.973422    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:24.973513 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:24.973470    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:24.973911 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:24.973582    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:25.973430 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:25.973387    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:25.973430 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:25.973430    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:25.973861 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:25.973520    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:25.973861 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:25.973636    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:26.973623 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:26.973592    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:26.974087 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:26.973704    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:27.972960 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:27.972920    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:27.973190 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:27.972921    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:27.973190 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:27.973034    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:27.973190 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:27.973153    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:28.972960 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:28.972926    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:28.973342 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:28.973057    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:29.546132 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:29.546012    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-26bng"]
Jul 14 21:38:29.546296 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:29.546183    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:29.546374 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:29.546295    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:29.546954 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:29.546906    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tmv56"]
Jul 14 21:38:29.547085 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:29.546986    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:29.547085 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:29.547063    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:29.547736 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:29.547710    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f5vcq"]
Jul 14 21:38:29.547816 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:29.547804    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:29.547923 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:29.547902    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:30.973534 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:30.973237    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:30.973534 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:30.973269    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:30.974207 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:30.973529    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:30.974207 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:30.973300    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:30.974207 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:30.973603    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:30.974207 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:30.973675    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:32.973579 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:32.973545    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:32.974035 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:32.973545    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:32.974035 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:32.973645    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5vcq" podUID="ad4922e5-5a9e-45d9-93db-5fd8d2534abd"
Jul 14 21:38:32.974035 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:32.973653    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:32.974035 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:32.973715    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26bng" podUID="60090e8b-aefa-43fa-9bb0-ff481a0fc9f3"
Jul 14 21:38:32.974035 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:32.973788    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmv56" podUID="7dddc3f3-4833-4d05-8db0-86e663dde23c"
Jul 14 21:38:34.376268 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.376240    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-31.ec2.internal" event="NodeReady"
Jul 14 21:38:34.376664 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.376379    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 21:38:34.432241 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.432207    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gsvz7"]
Jul 14 21:38:34.455609 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.455575    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2pw2n"]
Jul 14 21:38:34.455762 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.455663    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:34.458661 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.458635    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zdsh8\""
Jul 14 21:38:34.458800 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.458635    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 21:38:34.458800 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.458635    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 21:38:34.471723 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.471700    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2pw2n"]
Jul 14 21:38:34.471837 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.471741    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gsvz7"]
Jul 14 21:38:34.471837 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.471788    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.474595 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.474572    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 21:38:34.474727 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.474597    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-62q7v\""
Jul 14 21:38:34.474727 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.474571    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 21:38:34.474849 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.474739    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 21:38:34.474849 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.474751    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 21:38:34.527300 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.527268    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vht6t"]
Jul 14 21:38:34.541972 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.541946    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vht6t"]
Jul 14 21:38:34.542161 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.542044    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vht6t"
Jul 14 21:38:34.544772 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.544751    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 21:38:34.544926 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.544879    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cq9kr\""
Jul 14 21:38:34.544926 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.544917    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 21:38:34.545044 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.544930    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 21:38:34.625190 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.625148    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-data-volume\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.625190 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.625192    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b4819a-7965-45b2-9a63-855c9e7f009d-tmp-dir\") pod \"dns-default-gsvz7\" (UID: \"33b4819a-7965-45b2-9a63-855c9e7f009d\") " pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:34.625412 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.625212    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b4819a-7965-45b2-9a63-855c9e7f009d-metrics-tls\") pod \"dns-default-gsvz7\" (UID: \"33b4819a-7965-45b2-9a63-855c9e7f009d\") " pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:34.625412 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.625309    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.625412 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.625354    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.625412 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.625389    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-crio-socket\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.625550 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.625432    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33b4819a-7965-45b2-9a63-855c9e7f009d-config-volume\") pod \"dns-default-gsvz7\" (UID: \"33b4819a-7965-45b2-9a63-855c9e7f009d\") " pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:34.625550 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.625469    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htblc\" (UniqueName: \"kubernetes.io/projected/33b4819a-7965-45b2-9a63-855c9e7f009d-kube-api-access-htblc\") pod \"dns-default-gsvz7\" (UID: \"33b4819a-7965-45b2-9a63-855c9e7f009d\") " pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:34.625550 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.625515    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfq7c\" (UniqueName: \"kubernetes.io/projected/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-kube-api-access-jfq7c\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.726660 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.726563    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.726660 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.726607    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-crio-socket\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.726660 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.726634    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33b4819a-7965-45b2-9a63-855c9e7f009d-config-volume\") pod \"dns-default-gsvz7\" (UID: \"33b4819a-7965-45b2-9a63-855c9e7f009d\") " pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:34.726660 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.726660    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twt8b\" (UniqueName: \"kubernetes.io/projected/8fe050af-65e6-45ce-8fa0-0e925501070e-kube-api-access-twt8b\") pod \"ingress-canary-vht6t\" (UID: \"8fe050af-65e6-45ce-8fa0-0e925501070e\") " pod="openshift-ingress-canary/ingress-canary-vht6t"
Jul 14 21:38:34.726935 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.726684    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htblc\" (UniqueName: \"kubernetes.io/projected/33b4819a-7965-45b2-9a63-855c9e7f009d-kube-api-access-htblc\") pod \"dns-default-gsvz7\" (UID: \"33b4819a-7965-45b2-9a63-855c9e7f009d\") " pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:34.726935 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.726730    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfq7c\" (UniqueName: \"kubernetes.io/projected/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-kube-api-access-jfq7c\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.726935 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.726770    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-crio-socket\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.726935 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.726808    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fe050af-65e6-45ce-8fa0-0e925501070e-cert\") pod \"ingress-canary-vht6t\" (UID: \"8fe050af-65e6-45ce-8fa0-0e925501070e\") " pod="openshift-ingress-canary/ingress-canary-vht6t"
Jul 14 21:38:34.726935 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.726868    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-data-volume\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.726935 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.726915    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b4819a-7965-45b2-9a63-855c9e7f009d-tmp-dir\") pod \"dns-default-gsvz7\" (UID: \"33b4819a-7965-45b2-9a63-855c9e7f009d\") " pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:34.727224 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.726943    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b4819a-7965-45b2-9a63-855c9e7f009d-metrics-tls\") pod \"dns-default-gsvz7\" (UID: \"33b4819a-7965-45b2-9a63-855c9e7f009d\") " pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:34.727224 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.726997    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.727224 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.727212    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-data-volume\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.727338 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.727317    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b4819a-7965-45b2-9a63-855c9e7f009d-tmp-dir\") pod \"dns-default-gsvz7\" (UID: \"33b4819a-7965-45b2-9a63-855c9e7f009d\") " pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:34.727380 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.727323    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33b4819a-7965-45b2-9a63-855c9e7f009d-config-volume\") pod \"dns-default-gsvz7\" (UID: \"33b4819a-7965-45b2-9a63-855c9e7f009d\") " pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:34.727535 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.727519    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.730942 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.730923    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.731070 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.730922    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b4819a-7965-45b2-9a63-855c9e7f009d-metrics-tls\") pod \"dns-default-gsvz7\" (UID: \"33b4819a-7965-45b2-9a63-855c9e7f009d\") " pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:34.736752 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.736721    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfq7c\" (UniqueName: \"kubernetes.io/projected/ff78d138-ff4f-47bd-9e8c-29b4cc13390b-kube-api-access-jfq7c\") pod \"insights-runtime-extractor-2pw2n\" (UID: \"ff78d138-ff4f-47bd-9e8c-29b4cc13390b\") " pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.737021 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.737004    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htblc\" (UniqueName: \"kubernetes.io/projected/33b4819a-7965-45b2-9a63-855c9e7f009d-kube-api-access-htblc\") pod \"dns-default-gsvz7\" (UID: \"33b4819a-7965-45b2-9a63-855c9e7f009d\") " pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:34.780186 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.780147    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2pw2n"
Jul 14 21:38:34.780186 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.780187    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:34.828121 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.828084    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twt8b\" (UniqueName: \"kubernetes.io/projected/8fe050af-65e6-45ce-8fa0-0e925501070e-kube-api-access-twt8b\") pod \"ingress-canary-vht6t\" (UID: \"8fe050af-65e6-45ce-8fa0-0e925501070e\") " pod="openshift-ingress-canary/ingress-canary-vht6t"
Jul 14 21:38:34.828233 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.828168    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fe050af-65e6-45ce-8fa0-0e925501070e-cert\") pod \"ingress-canary-vht6t\" (UID: \"8fe050af-65e6-45ce-8fa0-0e925501070e\") " pod="openshift-ingress-canary/ingress-canary-vht6t"
Jul 14 21:38:34.830748 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.830726    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8fe050af-65e6-45ce-8fa0-0e925501070e-cert\") pod \"ingress-canary-vht6t\" (UID: \"8fe050af-65e6-45ce-8fa0-0e925501070e\") " pod="openshift-ingress-canary/ingress-canary-vht6t"
Jul 14 21:38:34.837605 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.837560    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twt8b\" (UniqueName: \"kubernetes.io/projected/8fe050af-65e6-45ce-8fa0-0e925501070e-kube-api-access-twt8b\") pod \"ingress-canary-vht6t\" (UID: \"8fe050af-65e6-45ce-8fa0-0e925501070e\") " pod="openshift-ingress-canary/ingress-canary-vht6t"
Jul 14 21:38:34.852221 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.852195    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vht6t"
Jul 14 21:38:34.974386 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.974310    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:34.974386 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.974350    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:34.974621 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.974424    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:34.977922 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.977556    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 21:38:34.977922 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.977607    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 21:38:34.977922 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.977556    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bkps7\""
Jul 14 21:38:34.977922 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.977820    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 21:38:34.977922 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.977892    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2rjnp\""
Jul 14 21:38:34.978287 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.977989    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 21:38:34.992720 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:34.992693    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gsvz7"]
Jul 14 21:38:34.997539 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:34.997517    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b4819a_7965_45b2_9a63_855c9e7f009d.slice/crio-909c80378ae591bcb383a4c5f0dec4455b22f679d0dbe4ec9a06181fd96943bb WatchSource:0}: Error finding container 909c80378ae591bcb383a4c5f0dec4455b22f679d0dbe4ec9a06181fd96943bb: Status 404 returned error can't find the container with id 909c80378ae591bcb383a4c5f0dec4455b22f679d0dbe4ec9a06181fd96943bb
Jul 14 21:38:35.009042 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:35.008863    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2pw2n"]
Jul 14 21:38:35.011976 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:35.011950    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff78d138_ff4f_47bd_9e8c_29b4cc13390b.slice/crio-d14766c88b1809cb542fb261b41832014461977e6ada9df6c206b7feef360809 WatchSource:0}: Error finding container d14766c88b1809cb542fb261b41832014461977e6ada9df6c206b7feef360809: Status 404 returned error can't find the container with id d14766c88b1809cb542fb261b41832014461977e6ada9df6c206b7feef360809
Jul 14 21:38:35.027899 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:35.027874    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vht6t"]
Jul 14 21:38:35.030668 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:35.030646    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe050af_65e6_45ce_8fa0_0e925501070e.slice/crio-08505c7ffed5138ec1f30332a0250dfc548b9cf7ef898b43c76f7e93663a6ddd WatchSource:0}: Error finding container 08505c7ffed5138ec1f30332a0250dfc548b9cf7ef898b43c76f7e93663a6ddd: Status 404 returned error can't find the container with id 08505c7ffed5138ec1f30332a0250dfc548b9cf7ef898b43c76f7e93663a6ddd
Jul 14 21:38:35.198662 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:35.198627    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vht6t" event={"ID":"8fe050af-65e6-45ce-8fa0-0e925501070e","Type":"ContainerStarted","Data":"08505c7ffed5138ec1f30332a0250dfc548b9cf7ef898b43c76f7e93663a6ddd"}
Jul 14 21:38:35.199796 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:35.199772    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gsvz7" event={"ID":"33b4819a-7965-45b2-9a63-855c9e7f009d","Type":"ContainerStarted","Data":"909c80378ae591bcb383a4c5f0dec4455b22f679d0dbe4ec9a06181fd96943bb"}
Jul 14 21:38:35.200818 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:35.200793    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2pw2n" event={"ID":"ff78d138-ff4f-47bd-9e8c-29b4cc13390b","Type":"ContainerStarted","Data":"d14766c88b1809cb542fb261b41832014461977e6ada9df6c206b7feef360809"}
Jul 14 21:38:37.094668 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:37.094634    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nks8c"]
Jul 14 21:38:37.105363 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:37.105334    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nks8c"
Jul 14 21:38:37.108063 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:37.108034    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 14 21:38:37.108427 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:37.108404    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lmmg8\""
Jul 14 21:38:37.111745 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:37.111718    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nks8c"]
Jul 14 21:38:37.250008 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:37.249965    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f8462872-6171-43c1-8f49-78e4d4b14fe3-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-nks8c\" (UID: \"f8462872-6171-43c1-8f49-78e4d4b14fe3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nks8c"
Jul 14 21:38:37.350823 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:37.350738    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f8462872-6171-43c1-8f49-78e4d4b14fe3-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-nks8c\" (UID: \"f8462872-6171-43c1-8f49-78e4d4b14fe3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nks8c"
Jul 14 21:38:37.355343 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:37.355313    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f8462872-6171-43c1-8f49-78e4d4b14fe3-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-nks8c\" (UID: \"f8462872-6171-43c1-8f49-78e4d4b14fe3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nks8c"
Jul 14 21:38:37.418665 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:37.418631    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nks8c"
Jul 14 21:38:40.711693 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:40.711366    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nks8c"]
Jul 14 21:38:40.714798 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:40.714768    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8462872_6171_43c1_8f49_78e4d4b14fe3.slice/crio-d2368b9a10809e2d5f28f2badd370f18135f31f315e9b51dac892b9c523f7edc WatchSource:0}: Error finding container d2368b9a10809e2d5f28f2badd370f18135f31f315e9b51dac892b9c523f7edc: Status 404 returned error can't find the container with id d2368b9a10809e2d5f28f2badd370f18135f31f315e9b51dac892b9c523f7edc
Jul 14 21:38:41.219126 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.219038    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vht6t" event={"ID":"8fe050af-65e6-45ce-8fa0-0e925501070e","Type":"ContainerStarted","Data":"08af4f4e17e574b1ea467cb3802a29dcc68b6e972b01ae57ff2ef881179f3ab7"}
Jul 14 21:38:41.221521 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.221448    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2pw2n" event={"ID":"ff78d138-ff4f-47bd-9e8c-29b4cc13390b","Type":"ContainerStarted","Data":"ca44cce065f25046404c49b033f2c3e41f59bd78117a88b86218745afb8c0990"}
Jul 14 21:38:41.224590 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.224539    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gsvz7" event={"ID":"33b4819a-7965-45b2-9a63-855c9e7f009d","Type":"ContainerStarted","Data":"2bca1077c253701d4bad75c4ce341d7ac659abc61bf214057d40c1b88081e957"}
Jul 14 21:38:41.224722 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.224596    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gsvz7" event={"ID":"33b4819a-7965-45b2-9a63-855c9e7f009d","Type":"ContainerStarted","Data":"890c8342f859e467f2ab137a1485dd5ef65a8369396ebf8584bcbfeff4c0ceb9"}
Jul 14 21:38:41.224722 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.224627    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:41.227389 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.227339    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nks8c" event={"ID":"f8462872-6171-43c1-8f49-78e4d4b14fe3","Type":"ContainerStarted","Data":"d2368b9a10809e2d5f28f2badd370f18135f31f315e9b51dac892b9c523f7edc"}
Jul 14 21:38:41.259377 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.259314    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vht6t" podStartSLOduration=1.731378141 podStartE2EDuration="7.259291946s" totalImagesPullingTime="5.527913805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:41.238702001 +0000 UTC m=+59.723794654" watchObservedRunningTime="2026-07-14 21:38:41.259291946 +0000 UTC m=+59.744384597"
Jul 14 21:38:41.259755 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.259645    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gsvz7" podStartSLOduration=1.7246705150000001 podStartE2EDuration="7.259635052s" totalImagesPullingTime="5.534964537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:41.258390378 +0000 UTC m=+59.743483031" watchObservedRunningTime="2026-07-14 21:38:41.259635052 +0000 UTC m=+59.744727705"
Jul 14 21:38:41.590482 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.590441    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-848c8c8b7d-fs96b"]
Jul 14 21:38:41.592755 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.592728    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.596515 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.596479    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 21:38:41.596659 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.596528    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6thlj\""
Jul 14 21:38:41.596659 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.596588    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 14 21:38:41.597032 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.597012    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 21:38:41.597161 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.597096    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 21:38:41.597235 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.597166    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 14 21:38:41.597293 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.597242    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 21:38:41.597486 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.597463    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 21:38:41.606748 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.606217    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 14 21:38:41.608788 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.608761    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-848c8c8b7d-fs96b"]
Jul 14 21:38:41.685898 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.685844    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-config\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.685898 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.685893    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r577q\" (UniqueName: \"kubernetes.io/projected/3907167d-62bd-440d-a9d2-9a4b7b054f21-kube-api-access-r577q\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.686153 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.685954    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-serving-cert\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.686153 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.685980    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-service-ca\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.686153 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.686004    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-oauth-serving-cert\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.686153 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.686072    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-trusted-ca-bundle\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.686319 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.686149    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-oauth-config\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.786988 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.786589    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-serving-cert\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.786988 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.786642    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-service-ca\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.786988 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.786666    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-oauth-serving-cert\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.786988 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.786738    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-trusted-ca-bundle\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.786988 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.786766    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-oauth-config\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.786988 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.786817    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-config\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.786988 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.786843    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r577q\" (UniqueName: \"kubernetes.io/projected/3907167d-62bd-440d-a9d2-9a4b7b054f21-kube-api-access-r577q\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.788034 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.787986    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-trusted-ca-bundle\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.788280 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.788254    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-service-ca\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.788465 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.788444    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-config\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.788626 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.788570    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-oauth-serving-cert\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.789886 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.789865    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-oauth-config\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.790649 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.790629    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-serving-cert\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.797569 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.797542    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r577q\" (UniqueName: \"kubernetes.io/projected/3907167d-62bd-440d-a9d2-9a4b7b054f21-kube-api-access-r577q\") pod \"console-848c8c8b7d-fs96b\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") " pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:41.908304 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.908226    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6thlj\""
Jul 14 21:38:41.915039 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:41.915010    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:42.064531 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:42.064499    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-848c8c8b7d-fs96b"]
Jul 14 21:38:42.067712 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:42.067688    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3907167d_62bd_440d_a9d2_9a4b7b054f21.slice/crio-dad756ad5f86774c0531ab82838102942942975358e3fbce72dacc7042c6ab5e WatchSource:0}: Error finding container dad756ad5f86774c0531ab82838102942942975358e3fbce72dacc7042c6ab5e: Status 404 returned error can't find the container with id dad756ad5f86774c0531ab82838102942942975358e3fbce72dacc7042c6ab5e
Jul 14 21:38:42.148683 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:42.148647    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wfbd8"
Jul 14 21:38:42.234456 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:42.234365    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2pw2n" event={"ID":"ff78d138-ff4f-47bd-9e8c-29b4cc13390b","Type":"ContainerStarted","Data":"ea68899baa47cac7b9e5eda5098992228ddffa5a348c1fa6b5873a0bc601d0b1"}
Jul 14 21:38:42.235767 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:42.235718    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848c8c8b7d-fs96b" event={"ID":"3907167d-62bd-440d-a9d2-9a4b7b054f21","Type":"ContainerStarted","Data":"dad756ad5f86774c0531ab82838102942942975358e3fbce72dacc7042c6ab5e"}
Jul 14 21:38:42.237398 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:42.237274    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nks8c" event={"ID":"f8462872-6171-43c1-8f49-78e4d4b14fe3","Type":"ContainerStarted","Data":"cf71c0a850d44ca6c94f22dc8ce7830731ce8bc35604036b25550f5869be7602"}
Jul 14 21:38:42.237718 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:42.237629    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nks8c"
Jul 14 21:38:42.243001 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:42.242975    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nks8c"
Jul 14 21:38:42.256972 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:42.256911    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-nks8c" podStartSLOduration=4.25146578 podStartE2EDuration="5.256891703s" totalImagesPullingTime="1.005425923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:42.256476752 +0000 UTC m=+60.741569406" watchObservedRunningTime="2026-07-14 21:38:42.256891703 +0000 UTC m=+60.741984355"
Jul 14 21:38:43.178385 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.178344    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-8znpd"]
Jul 14 21:38:43.184481 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.184454    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:43.187350 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.187324    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 21:38:43.188385 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.188364    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 21:38:43.188800 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.188633    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 14 21:38:43.188800 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.188662    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 14 21:38:43.188800 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.188680    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 21:38:43.189018 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.188859    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fvhf5\""
Jul 14 21:38:43.193335 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.192162    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-8znpd"]
Jul 14 21:38:43.201154 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.201092    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-8znpd\" (UID: \"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:43.201297 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.201215    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-8znpd\" (UID: \"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:43.201371 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.201295    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn9wg\" (UniqueName: \"kubernetes.io/projected/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-kube-api-access-xn9wg\") pod \"prometheus-operator-64785b6675-8znpd\" (UID: \"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:43.201371 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.201347    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-metrics-client-ca\") pod \"prometheus-operator-64785b6675-8znpd\" (UID: \"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:43.302087 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.302053    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-metrics-client-ca\") pod \"prometheus-operator-64785b6675-8znpd\" (UID: \"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:43.302289 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.302131    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-8znpd\" (UID: \"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:43.302289 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.302196    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-8znpd\" (UID: \"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:43.302289 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.302284    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn9wg\" (UniqueName: \"kubernetes.io/projected/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-kube-api-access-xn9wg\") pod \"prometheus-operator-64785b6675-8znpd\" (UID: \"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:43.302677 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:43.302659    2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 14 21:38:43.302756 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:43.302710    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-prometheus-operator-tls podName:aa0024ef-3ab2-462f-8281-5cc4d1daf7c2 nodeName:}" failed. No retries permitted until 2026-07-14 21:38:43.802697324 +0000 UTC m=+62.287789953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-prometheus-operator-tls") pod "prometheus-operator-64785b6675-8znpd" (UID: "aa0024ef-3ab2-462f-8281-5cc4d1daf7c2") : secret "prometheus-operator-tls" not found
Jul 14 21:38:43.302847 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.302824    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-metrics-client-ca\") pod \"prometheus-operator-64785b6675-8znpd\" (UID: \"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:43.305385 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.305356    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-8znpd\" (UID: \"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:43.313737 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.313709    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn9wg\" (UniqueName: \"kubernetes.io/projected/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-kube-api-access-xn9wg\") pod \"prometheus-operator-64785b6675-8znpd\" (UID: \"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:43.805832 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.805796    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-8znpd\" (UID: \"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:43.808522 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:43.808492    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/aa0024ef-3ab2-462f-8281-5cc4d1daf7c2-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-8znpd\" (UID: \"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2\") " pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:44.098052 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:44.097961    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd"
Jul 14 21:38:45.191300 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:45.191268    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-8znpd"]
Jul 14 21:38:45.194796 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:45.194769    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa0024ef_3ab2_462f_8281_5cc4d1daf7c2.slice/crio-70b5954025b1a4795a5a0fcf1c75d8006bfa3d6fcc377b3e044f72210c191c89 WatchSource:0}: Error finding container 70b5954025b1a4795a5a0fcf1c75d8006bfa3d6fcc377b3e044f72210c191c89: Status 404 returned error can't find the container with id 70b5954025b1a4795a5a0fcf1c75d8006bfa3d6fcc377b3e044f72210c191c89
Jul 14 21:38:45.248525 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:45.248489    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2pw2n" event={"ID":"ff78d138-ff4f-47bd-9e8c-29b4cc13390b","Type":"ContainerStarted","Data":"bf55362ab47fca9505c905d351a9958b01d6c372892f3b79d9d271e5d52652b6"}
Jul 14 21:38:45.250045 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:45.250017    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848c8c8b7d-fs96b" event={"ID":"3907167d-62bd-440d-a9d2-9a4b7b054f21","Type":"ContainerStarted","Data":"aa13d5ca8cf154bdb2cf74502b86e61acdfe90b4b5a3fb68497d7689545cc5a1"}
Jul 14 21:38:45.251100 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:45.251080    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd" event={"ID":"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2","Type":"ContainerStarted","Data":"70b5954025b1a4795a5a0fcf1c75d8006bfa3d6fcc377b3e044f72210c191c89"}
Jul 14 21:38:45.271446 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:45.271397    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2pw2n" podStartSLOduration=1.394717821 podStartE2EDuration="11.271379316s" totalImagesPullingTime="9.876661495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:38:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:45.269710235 +0000 UTC m=+63.754802884" watchObservedRunningTime="2026-07-14 21:38:45.271379316 +0000 UTC m=+63.756471961"
Jul 14 21:38:45.294151 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:45.294077    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-848c8c8b7d-fs96b" podStartSLOduration=1.300122572 podStartE2EDuration="4.294060347s" totalImagesPullingTime="2.993937775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:45.293529197 +0000 UTC m=+63.778621849" watchObservedRunningTime="2026-07-14 21:38:45.294060347 +0000 UTC m=+63.779152999"
Jul 14 21:38:47.259584 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.259545    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd" event={"ID":"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2","Type":"ContainerStarted","Data":"d75b93e18fd7df5a6ac29a4ebcd6a751418247607c0095b8c83fab8dcc3984df"}
Jul 14 21:38:47.259996 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.259597    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd" event={"ID":"aa0024ef-3ab2-462f-8281-5cc4d1daf7c2","Type":"ContainerStarted","Data":"99eb8aab8b887c3ec738b6242ad175e7fa8785228302376743a5b509233f1080"}
Jul 14 21:38:47.280169 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.280121    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-8znpd" podStartSLOduration=3.256055082 podStartE2EDuration="4.280086505s" totalImagesPullingTime="1.024031423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:47.279688134 +0000 UTC m=+65.764780798" watchObservedRunningTime="2026-07-14 21:38:47.280086505 +0000 UTC m=+65.765179158"
Jul 14 21:38:47.637382 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.637298    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs\") pod \"network-metrics-daemon-f5vcq\" (UID: \"ad4922e5-5a9e-45d9-93db-5fd8d2534abd\") " pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:47.640229 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.640210    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 21:38:47.650531 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.650510    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad4922e5-5a9e-45d9-93db-5fd8d2534abd-metrics-certs\") pod \"network-metrics-daemon-f5vcq\" (UID: \"ad4922e5-5a9e-45d9-93db-5fd8d2534abd\") " pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:47.737865 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.737839    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:47.740794 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.740779    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 21:38:47.750203 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.750178    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7dddc3f3-4833-4d05-8db0-86e663dde23c-original-pull-secret\") pod \"global-pull-secret-syncer-tmv56\" (UID: \"7dddc3f3-4833-4d05-8db0-86e663dde23c\") " pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:47.838829 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.838783    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6k4d\" (UniqueName: \"kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d\") pod \"network-check-target-26bng\" (UID: \"60090e8b-aefa-43fa-9bb0-ff481a0fc9f3\") " pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:47.841663 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.841643    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 21:38:47.852424 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.852405    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 21:38:47.862813 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.862788    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6k4d\" (UniqueName: \"kubernetes.io/projected/60090e8b-aefa-43fa-9bb0-ff481a0fc9f3-kube-api-access-v6k4d\") pod \"network-check-target-26bng\" (UID: \"60090e8b-aefa-43fa-9bb0-ff481a0fc9f3\") " pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:47.890266 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.890206    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2rjnp\""
Jul 14 21:38:47.894347 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.894330    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmv56"
Jul 14 21:38:47.898331 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.898317    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:47.901981 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.901966    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bkps7\""
Jul 14 21:38:47.910371 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:47.910350    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5vcq"
Jul 14 21:38:48.037548 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:48.037522    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tmv56"]
Jul 14 21:38:48.040509 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:48.040482    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dddc3f3_4833_4d05_8db0_86e663dde23c.slice/crio-7e8f4d18532ac47635cdafd0fc03ecadcd1866e135505ad150c79881e9d598df WatchSource:0}: Error finding container 7e8f4d18532ac47635cdafd0fc03ecadcd1866e135505ad150c79881e9d598df: Status 404 returned error can't find the container with id 7e8f4d18532ac47635cdafd0fc03ecadcd1866e135505ad150c79881e9d598df
Jul 14 21:38:48.264162 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:48.264134    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-26bng"]
Jul 14 21:38:48.264555 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:48.264349    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tmv56" event={"ID":"7dddc3f3-4833-4d05-8db0-86e663dde23c","Type":"ContainerStarted","Data":"7e8f4d18532ac47635cdafd0fc03ecadcd1866e135505ad150c79881e9d598df"}
Jul 14 21:38:48.266718 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:48.266697    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f5vcq"]
Jul 14 21:38:48.267532 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:48.267506    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60090e8b_aefa_43fa_9bb0_ff481a0fc9f3.slice/crio-bd0ba4e78a3856030a821ea5ad92af9fa58f058015d1621e30c52b5d5ef6ac8e WatchSource:0}: Error finding container bd0ba4e78a3856030a821ea5ad92af9fa58f058015d1621e30c52b5d5ef6ac8e: Status 404 returned error can't find the container with id bd0ba4e78a3856030a821ea5ad92af9fa58f058015d1621e30c52b5d5ef6ac8e
Jul 14 21:38:48.269583 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:48.269561    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4922e5_5a9e_45d9_93db_5fd8d2534abd.slice/crio-2af800e07c84ffff7a6e43991d8c4d1b9cb0cf08bbd90f0a9a9948dd44b7b144 WatchSource:0}: Error finding container 2af800e07c84ffff7a6e43991d8c4d1b9cb0cf08bbd90f0a9a9948dd44b7b144: Status 404 returned error can't find the container with id 2af800e07c84ffff7a6e43991d8c4d1b9cb0cf08bbd90f0a9a9948dd44b7b144
Jul 14 21:38:49.273935 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.273857    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5vcq" event={"ID":"ad4922e5-5a9e-45d9-93db-5fd8d2534abd","Type":"ContainerStarted","Data":"2af800e07c84ffff7a6e43991d8c4d1b9cb0cf08bbd90f0a9a9948dd44b7b144"}
Jul 14 21:38:49.276705 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.276548    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-26bng" event={"ID":"60090e8b-aefa-43fa-9bb0-ff481a0fc9f3","Type":"ContainerStarted","Data":"bd0ba4e78a3856030a821ea5ad92af9fa58f058015d1621e30c52b5d5ef6ac8e"}
Jul 14 21:38:49.654524 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.654489    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"]
Jul 14 21:38:49.660551 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.660521    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"
Jul 14 21:38:49.664141 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.664115    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mw2dl\""
Jul 14 21:38:49.666478 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.666388    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 14 21:38:49.666478 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.666427    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 14 21:38:49.693680 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.693599    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"]
Jul 14 21:38:49.722973 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.722945    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-g684d"]
Jul 14 21:38:49.726393 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.726373    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.733373 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.733328    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 14 21:38:49.733552 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.733530    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g4rl7"]
Jul 14 21:38:49.734157 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.733643    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-q4bwp\""
Jul 14 21:38:49.734157 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.733952    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 14 21:38:49.736119 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.735918    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 14 21:38:49.737037 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.737018    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.739727 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.739691    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b4qtd\""
Jul 14 21:38:49.748276 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.748222    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 21:38:49.750491 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.750468    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 21:38:49.752729 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.752699    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b82833-1e09-4f39-80b7-eaf479c2e7ba-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-skkqq\" (UID: \"33b82833-1e09-4f39-80b7-eaf479c2e7ba\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"
Jul 14 21:38:49.752824 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.752739    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6ec894e0-b385-4e8b-98fc-fdff455b2d71-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.752824 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.752766    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.752934 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.752832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j49n2\" (UniqueName: \"kubernetes.io/projected/6ec894e0-b385-4e8b-98fc-fdff455b2d71-kube-api-access-j49n2\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.752934 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.752875    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ec894e0-b385-4e8b-98fc-fdff455b2d71-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.752934 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.752910    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-textfile\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.753080 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.752969    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2a00549-6a72-4a01-b936-5f1ea204a44b-metrics-client-ca\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.753080 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.753042    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqn7z\" (UniqueName: \"kubernetes.io/projected/33b82833-1e09-4f39-80b7-eaf479c2e7ba-kube-api-access-hqn7z\") pod \"openshift-state-metrics-84bd68b896-skkqq\" (UID: \"33b82833-1e09-4f39-80b7-eaf479c2e7ba\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"
Jul 14 21:38:49.753202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.753127    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33b82833-1e09-4f39-80b7-eaf479c2e7ba-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-skkqq\" (UID: \"33b82833-1e09-4f39-80b7-eaf479c2e7ba\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"
Jul 14 21:38:49.753202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.753166    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6ec894e0-b385-4e8b-98fc-fdff455b2d71-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.753202 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.753192    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2a00549-6a72-4a01-b936-5f1ea204a44b-root\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.753358 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.753218    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-tls\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.753358 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.753245    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.753358 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.753280    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2a00549-6a72-4a01-b936-5f1ea204a44b-sys\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.753358 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.753309    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33b82833-1e09-4f39-80b7-eaf479c2e7ba-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-skkqq\" (UID: \"33b82833-1e09-4f39-80b7-eaf479c2e7ba\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"
Jul 14 21:38:49.753358 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.753337    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec894e0-b385-4e8b-98fc-fdff455b2d71-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.753559 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.753365    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ec894e0-b385-4e8b-98fc-fdff455b2d71-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.753559 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.753391    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs9ct\" (UniqueName: \"kubernetes.io/projected/c2a00549-6a72-4a01-b936-5f1ea204a44b-kube-api-access-rs9ct\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.753559 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.753410    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-wtmp\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.761602 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.761585    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 21:38:49.783537 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.783389    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-g684d"]
Jul 14 21:38:49.854182 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854147    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-textfile\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.854182 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854190    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2a00549-6a72-4a01-b936-5f1ea204a44b-metrics-client-ca\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.854429 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854219    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqn7z\" (UniqueName: \"kubernetes.io/projected/33b82833-1e09-4f39-80b7-eaf479c2e7ba-kube-api-access-hqn7z\") pod \"openshift-state-metrics-84bd68b896-skkqq\" (UID: \"33b82833-1e09-4f39-80b7-eaf479c2e7ba\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"
Jul 14 21:38:49.854429 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854249    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33b82833-1e09-4f39-80b7-eaf479c2e7ba-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-skkqq\" (UID: \"33b82833-1e09-4f39-80b7-eaf479c2e7ba\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"
Jul 14 21:38:49.854429 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854279    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6ec894e0-b385-4e8b-98fc-fdff455b2d71-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.854429 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854303    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2a00549-6a72-4a01-b936-5f1ea204a44b-root\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.854429 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854330    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-tls\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.854429 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854356    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.854429 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854393    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2a00549-6a72-4a01-b936-5f1ea204a44b-sys\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.854429 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854421    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33b82833-1e09-4f39-80b7-eaf479c2e7ba-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-skkqq\" (UID: \"33b82833-1e09-4f39-80b7-eaf479c2e7ba\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"
Jul 14 21:38:49.854814 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854452    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec894e0-b385-4e8b-98fc-fdff455b2d71-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.854814 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ec894e0-b385-4e8b-98fc-fdff455b2d71-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.854814 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854505    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs9ct\" (UniqueName: \"kubernetes.io/projected/c2a00549-6a72-4a01-b936-5f1ea204a44b-kube-api-access-rs9ct\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.854814 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854532    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-wtmp\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.854814 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b82833-1e09-4f39-80b7-eaf479c2e7ba-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-skkqq\" (UID: \"33b82833-1e09-4f39-80b7-eaf479c2e7ba\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"
Jul 14 21:38:49.854814 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854600    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6ec894e0-b385-4e8b-98fc-fdff455b2d71-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.854814 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854627    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.854814 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854649    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j49n2\" (UniqueName: \"kubernetes.io/projected/6ec894e0-b385-4e8b-98fc-fdff455b2d71-kube-api-access-j49n2\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.854814 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.854687    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ec894e0-b385-4e8b-98fc-fdff455b2d71-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.855347 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.855146    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2a00549-6a72-4a01-b936-5f1ea204a44b-sys\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.855347 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.855244    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-wtmp\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.855488 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.855460    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-textfile\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.855997 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.855965    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ec894e0-b385-4e8b-98fc-fdff455b2d71-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.856488 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.856093    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2a00549-6a72-4a01-b936-5f1ea204a44b-metrics-client-ca\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.856488 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.856170    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2a00549-6a72-4a01-b936-5f1ea204a44b-root\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.856488 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:49.856243    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 14 21:38:49.856488 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:49.856295    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-tls podName:c2a00549-6a72-4a01-b936-5f1ea204a44b nodeName:}" failed. No retries permitted until 2026-07-14 21:38:50.356277977 +0000 UTC m=+68.841370615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-tls") pod "node-exporter-g4rl7" (UID: "c2a00549-6a72-4a01-b936-5f1ea204a44b") : secret "node-exporter-tls" not found
Jul 14 21:38:49.856746 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.856502    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6ec894e0-b385-4e8b-98fc-fdff455b2d71-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.856746 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.856527    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6ec894e0-b385-4e8b-98fc-fdff455b2d71-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.856984 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.856866    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.857814 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.857744    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33b82833-1e09-4f39-80b7-eaf479c2e7ba-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-skkqq\" (UID: \"33b82833-1e09-4f39-80b7-eaf479c2e7ba\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"
Jul 14 21:38:49.857910 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.857883    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ec894e0-b385-4e8b-98fc-fdff455b2d71-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.859338 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.859318    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/33b82833-1e09-4f39-80b7-eaf479c2e7ba-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-skkqq\" (UID: \"33b82833-1e09-4f39-80b7-eaf479c2e7ba\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"
Jul 14 21:38:49.859574 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.859531    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.860661 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.860166    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33b82833-1e09-4f39-80b7-eaf479c2e7ba-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-skkqq\" (UID: \"33b82833-1e09-4f39-80b7-eaf479c2e7ba\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"
Jul 14 21:38:49.860661 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.860614    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ec894e0-b385-4e8b-98fc-fdff455b2d71-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.876331 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.876304    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j49n2\" (UniqueName: \"kubernetes.io/projected/6ec894e0-b385-4e8b-98fc-fdff455b2d71-kube-api-access-j49n2\") pod \"kube-state-metrics-785778ff74-g684d\" (UID: \"6ec894e0-b385-4e8b-98fc-fdff455b2d71\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:49.881633 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.881609    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs9ct\" (UniqueName: \"kubernetes.io/projected/c2a00549-6a72-4a01-b936-5f1ea204a44b-kube-api-access-rs9ct\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:49.906718 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.906683    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqn7z\" (UniqueName: \"kubernetes.io/projected/33b82833-1e09-4f39-80b7-eaf479c2e7ba-kube-api-access-hqn7z\") pod \"openshift-state-metrics-84bd68b896-skkqq\" (UID: \"33b82833-1e09-4f39-80b7-eaf479c2e7ba\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"
Jul 14 21:38:49.972406 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:49.972375    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"
Jul 14 21:38:50.038808 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.038778    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d"
Jul 14 21:38:50.148525 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.148434    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq"]
Jul 14 21:38:50.153014 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:50.152968    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b82833_1e09_4f39_80b7_eaf479c2e7ba.slice/crio-b38212904988709f5b9c6d219a134dc1687c198b1a6400f33726200c7d1ce13d WatchSource:0}: Error finding container b38212904988709f5b9c6d219a134dc1687c198b1a6400f33726200c7d1ce13d: Status 404 returned error can't find the container with id b38212904988709f5b9c6d219a134dc1687c198b1a6400f33726200c7d1ce13d
Jul 14 21:38:50.214736 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.214707    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-g684d"]
Jul 14 21:38:50.217717 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:50.217680    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec894e0_b385_4e8b_98fc_fdff455b2d71.slice/crio-4cb19e9df796ac0eb215a6b68e3ccc42341af3e043d77df0f162bf362df5db21 WatchSource:0}: Error finding container 4cb19e9df796ac0eb215a6b68e3ccc42341af3e043d77df0f162bf362df5db21: Status 404 returned error can't find the container with id 4cb19e9df796ac0eb215a6b68e3ccc42341af3e043d77df0f162bf362df5db21
Jul 14 21:38:50.284498 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.284403    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d" event={"ID":"6ec894e0-b385-4e8b-98fc-fdff455b2d71","Type":"ContainerStarted","Data":"4cb19e9df796ac0eb215a6b68e3ccc42341af3e043d77df0f162bf362df5db21"}
Jul 14 21:38:50.286626 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.286570    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq" event={"ID":"33b82833-1e09-4f39-80b7-eaf479c2e7ba","Type":"ContainerStarted","Data":"e772f184bc0d7b827fc2de9d9eb27599b2d45835df19a774c851a08d291c4bff"}
Jul 14 21:38:50.286724 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.286631    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq" event={"ID":"33b82833-1e09-4f39-80b7-eaf479c2e7ba","Type":"ContainerStarted","Data":"b38212904988709f5b9c6d219a134dc1687c198b1a6400f33726200c7d1ce13d"}
Jul 14 21:38:50.288921 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.288837    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5vcq" event={"ID":"ad4922e5-5a9e-45d9-93db-5fd8d2534abd","Type":"ContainerStarted","Data":"2050812dceda578a09e9c1996a010541cda85ca95bb9326128ebb5fab78eb9bc"}
Jul 14 21:38:50.288921 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.288883    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5vcq" event={"ID":"ad4922e5-5a9e-45d9-93db-5fd8d2534abd","Type":"ContainerStarted","Data":"4aec188c1a77ecc395f315686e72dae7069d7a34acf2a585a3548eb1257e02d4"}
Jul 14 21:38:50.321776 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.321720    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f5vcq" podStartSLOduration=67.225036973 podStartE2EDuration="1m8.321704711s" totalImagesPullingTime="1.096667738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:50.320649269 +0000 UTC m=+68.805741919" watchObservedRunningTime="2026-07-14 21:38:50.321704711 +0000 UTC m=+68.806797362"
Jul 14 21:38:50.359548 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.359508    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-tls\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:50.362955 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.362918    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2a00549-6a72-4a01-b936-5f1ea204a44b-node-exporter-tls\") pod \"node-exporter-g4rl7\" (UID: \"c2a00549-6a72-4a01-b936-5f1ea204a44b\") " pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:50.647614 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.647520    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g4rl7"
Jul 14 21:38:50.673553 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.673520    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 21:38:50.680297 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.680269    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.684845 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.684488    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 14 21:38:50.684845 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.684588    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 14 21:38:50.684845 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.684743    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 14 21:38:50.685457 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.685430    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 14 21:38:50.685584 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.685492    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 14 21:38:50.686058 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.685715    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 14 21:38:50.686058 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.685775    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kztbh\""
Jul 14 21:38:50.686058 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.685869    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 14 21:38:50.686058 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.686011    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 14 21:38:50.686058 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.686031    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 14 21:38:50.695578 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.695492    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 21:38:50.762936 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.762847    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.762936 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.762900    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.762936 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.762938    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/65077af2-1e75-4cef-bd80-c52026caa31e-config-out\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.763279 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.763004    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/65077af2-1e75-4cef-bd80-c52026caa31e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.763279 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.763032    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-config-volume\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.763279 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.763057    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.763279 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.763087    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65077af2-1e75-4cef-bd80-c52026caa31e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.763279 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.763132    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65077af2-1e75-4cef-bd80-c52026caa31e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.763279 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.763160    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-web-config\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.763279 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.763190    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.763589 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.763284    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/65077af2-1e75-4cef-bd80-c52026caa31e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.763589 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.763337    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.763589 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.763389    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxwzn\" (UniqueName: \"kubernetes.io/projected/65077af2-1e75-4cef-bd80-c52026caa31e-kube-api-access-mxwzn\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.864886 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.864853    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.864886 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.864901    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.865150 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.864933    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/65077af2-1e75-4cef-bd80-c52026caa31e-config-out\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.865150 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.864963    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/65077af2-1e75-4cef-bd80-c52026caa31e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.865150 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.864989    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-config-volume\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.865150 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.865013    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.865150 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.865034    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65077af2-1e75-4cef-bd80-c52026caa31e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.865150 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.865062    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65077af2-1e75-4cef-bd80-c52026caa31e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.865150 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.865125    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-web-config\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.865461 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.865158    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.865461 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.865188    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/65077af2-1e75-4cef-bd80-c52026caa31e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.865461 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.865226    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.865461 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.865265    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxwzn\" (UniqueName: \"kubernetes.io/projected/65077af2-1e75-4cef-bd80-c52026caa31e-kube-api-access-mxwzn\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.866022 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:50.865996    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65077af2-1e75-4cef-bd80-c52026caa31e-alertmanager-trusted-ca-bundle podName:65077af2-1e75-4cef-bd80-c52026caa31e nodeName:}" failed. No retries permitted until 2026-07-14 21:38:51.365970462 +0000 UTC m=+69.851063115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/65077af2-1e75-4cef-bd80-c52026caa31e-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "65077af2-1e75-4cef-bd80-c52026caa31e") : configmap references non-existent config key: ca-bundle.crt
Jul 14 21:38:50.866462 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.866435    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65077af2-1e75-4cef-bd80-c52026caa31e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.866893 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.866864    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/65077af2-1e75-4cef-bd80-c52026caa31e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.866984 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:50.866974    2572 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 14 21:38:50.867151 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:38:50.867049    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-main-tls podName:65077af2-1e75-4cef-bd80-c52026caa31e nodeName:}" failed. No retries permitted until 2026-07-14 21:38:51.367029729 +0000 UTC m=+69.852122373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "65077af2-1e75-4cef-bd80-c52026caa31e") : secret "alertmanager-main-tls" not found
Jul 14 21:38:50.869251 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.869206    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/65077af2-1e75-4cef-bd80-c52026caa31e-config-out\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.871615 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.871190    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/65077af2-1e75-4cef-bd80-c52026caa31e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.871615 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.871221    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-config-volume\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.871615 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.871360    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.872164 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.871948    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.873496 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.873381    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-web-config\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.873496 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.873453    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.874351 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.873900    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:50.876799 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:50.876702    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxwzn\" (UniqueName: \"kubernetes.io/projected/65077af2-1e75-4cef-bd80-c52026caa31e-kube-api-access-mxwzn\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:51.239991 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.239956    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gsvz7"
Jul 14 21:38:51.296185 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.296144    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq" event={"ID":"33b82833-1e09-4f39-80b7-eaf479c2e7ba","Type":"ContainerStarted","Data":"c59dd512a525bae0f5c674b0f0475915a847ec4b3330f0027b83041fdea13c05"}
Jul 14 21:38:51.370401 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.370344    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65077af2-1e75-4cef-bd80-c52026caa31e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:51.370575 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.370483    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:51.371488 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.371452    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65077af2-1e75-4cef-bd80-c52026caa31e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:51.373523 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.373492    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/65077af2-1e75-4cef-bd80-c52026caa31e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"65077af2-1e75-4cef-bd80-c52026caa31e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:51.592546 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.592505    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 21:38:51.657352 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.657318    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f75556856-v6lgv"]
Jul 14 21:38:51.672269 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.672236    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.673470 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.673446    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f75556856-v6lgv"]
Jul 14 21:38:51.675342 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.675320    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 14 21:38:51.675435 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.675369    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 14 21:38:51.675435 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.675394    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 14 21:38:51.675764 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.675624    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 14 21:38:51.675764 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.675639    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ej8aoobl5te1l\""
Jul 14 21:38:51.675764 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.675692    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vdlnt\""
Jul 14 21:38:51.675764 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.675692    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 14 21:38:51.773809 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.773770    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w42h\" (UniqueName: \"kubernetes.io/projected/265a7a1d-0f5d-499f-ab05-197e0e1b6929-kube-api-access-4w42h\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.773809 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.773815    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-tls\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.774070 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.773837    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-grpc-tls\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.774070 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.773886    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.774070 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.773945    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.774070 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.774042    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/265a7a1d-0f5d-499f-ab05-197e0e1b6929-metrics-client-ca\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.774296 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.774082    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.774296 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.774151    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.875453 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.875344    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-tls\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.875453 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.875398    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-grpc-tls\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.875453 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.875452    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.875749 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.875483    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.875749 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.875560    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/265a7a1d-0f5d-499f-ab05-197e0e1b6929-metrics-client-ca\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.875749 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.875599    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.875749 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.875630    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.875949 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.875831    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w42h\" (UniqueName: \"kubernetes.io/projected/265a7a1d-0f5d-499f-ab05-197e0e1b6929-kube-api-access-4w42h\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.876481 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.876437    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/265a7a1d-0f5d-499f-ab05-197e0e1b6929-metrics-client-ca\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.878637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.878588    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.878637 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.878633    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-tls\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.878795 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.878676    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-grpc-tls\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.878871 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.878837    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.879060 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.879032    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.879188 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.879093    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/265a7a1d-0f5d-499f-ab05-197e0e1b6929-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.886191 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.886146    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w42h\" (UniqueName: \"kubernetes.io/projected/265a7a1d-0f5d-499f-ab05-197e0e1b6929-kube-api-access-4w42h\") pod \"thanos-querier-f75556856-v6lgv\" (UID: \"265a7a1d-0f5d-499f-ab05-197e0e1b6929\") " pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:51.915277 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.915238    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:51.915463 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.915317    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:38:51.916990 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.916954    2572 patch_prober.go:28] interesting pod/console-848c8c8b7d-fs96b container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused" start-of-body=
Jul 14 21:38:51.917130 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.917008    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-848c8c8b7d-fs96b" podUID="3907167d-62bd-440d-a9d2-9a4b7b054f21" containerName="console" probeResult="failure" output="Get \"https://10.134.0.10:8443/health\": dial tcp 10.134.0.10:8443: connect: connection refused"
Jul 14 21:38:51.985276 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:51.985239    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:52.938283 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:52.938176    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a00549_6a72_4a01_b936_5f1ea204a44b.slice/crio-ae090eeb503d953a8184b6a504331f312acc5a00a427f709595e2bbe0eff25bb WatchSource:0}: Error finding container ae090eeb503d953a8184b6a504331f312acc5a00a427f709595e2bbe0eff25bb: Status 404 returned error can't find the container with id ae090eeb503d953a8184b6a504331f312acc5a00a427f709595e2bbe0eff25bb
Jul 14 21:38:53.117620 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:53.117590    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f75556856-v6lgv"]
Jul 14 21:38:53.121007 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:53.120972    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod265a7a1d_0f5d_499f_ab05_197e0e1b6929.slice/crio-aba6043814bb5c83ec30c905364e89b3953bc92b318cefe6d690d9ca83946521 WatchSource:0}: Error finding container aba6043814bb5c83ec30c905364e89b3953bc92b318cefe6d690d9ca83946521: Status 404 returned error can't find the container with id aba6043814bb5c83ec30c905364e89b3953bc92b318cefe6d690d9ca83946521
Jul 14 21:38:53.130539 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:53.130446    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 21:38:53.138182 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:53.138152    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65077af2_1e75_4cef_bd80_c52026caa31e.slice/crio-a2d40ba5ad64e2d9844394823fa98196f8ab7cdda3cf91ff73a0023aff3c15df WatchSource:0}: Error finding container a2d40ba5ad64e2d9844394823fa98196f8ab7cdda3cf91ff73a0023aff3c15df: Status 404 returned error can't find the container with id a2d40ba5ad64e2d9844394823fa98196f8ab7cdda3cf91ff73a0023aff3c15df
Jul 14 21:38:53.310506 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:53.309639    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-26bng" event={"ID":"60090e8b-aefa-43fa-9bb0-ff481a0fc9f3","Type":"ContainerStarted","Data":"b4bf3f30f2d6a4523fae922012fd8f03ae7765c7e03160ea2ec09b0c1c5f1504"}
Jul 14 21:38:53.310506 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:53.310439    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:38:53.312299 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:53.312269    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4rl7" event={"ID":"c2a00549-6a72-4a01-b936-5f1ea204a44b","Type":"ContainerStarted","Data":"ae090eeb503d953a8184b6a504331f312acc5a00a427f709595e2bbe0eff25bb"}
Jul 14 21:38:53.314764 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:53.314262    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tmv56" event={"ID":"7dddc3f3-4833-4d05-8db0-86e663dde23c","Type":"ContainerStarted","Data":"e906a753782393d3996e0e1737a02feaa1a0c5653a25db04e383464c34f1f149"}
Jul 14 21:38:53.316319 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:53.316241    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65077af2-1e75-4cef-bd80-c52026caa31e","Type":"ContainerStarted","Data":"a2d40ba5ad64e2d9844394823fa98196f8ab7cdda3cf91ff73a0023aff3c15df"}
Jul 14 21:38:53.318168 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:53.318143    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f75556856-v6lgv" event={"ID":"265a7a1d-0f5d-499f-ab05-197e0e1b6929","Type":"ContainerStarted","Data":"aba6043814bb5c83ec30c905364e89b3953bc92b318cefe6d690d9ca83946521"}
Jul 14 21:38:53.329411 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:53.329360    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-26bng" podStartSLOduration=66.660007429 podStartE2EDuration="1m11.329341002s" totalImagesPullingTime="4.669333573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:53.328298693 +0000 UTC m=+71.813391360" watchObservedRunningTime="2026-07-14 21:38:53.329341002 +0000 UTC m=+71.814433657"
Jul 14 21:38:53.349140 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:53.349043    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tmv56" podStartSLOduration=66.437011241 podStartE2EDuration="1m11.349021533s" totalImagesPullingTime="4.912010292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:53.347245847 +0000 UTC m=+71.832338515" watchObservedRunningTime="2026-07-14 21:38:53.349021533 +0000 UTC m=+71.834114186"
Jul 14 21:38:54.203139 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.203051    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-75c6f76555-wskwv"]
Jul 14 21:38:54.207544 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.207491    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.210418 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.210186    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-51u8o2eq0qf8u\""
Jul 14 21:38:54.210418 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.210186    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 14 21:38:54.211563 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.211470    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 14 21:38:54.211563 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.211528    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 14 21:38:54.211563 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.211546    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 14 21:38:54.211810 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.211580    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ctxkj\""
Jul 14 21:38:54.217068 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.217003    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75c6f76555-wskwv"]
Jul 14 21:38:54.301067 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.301031    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7h9r\" (UniqueName: \"kubernetes.io/projected/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-kube-api-access-q7h9r\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.301258 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.301072    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-client-ca-bundle\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.301258 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.301126    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-secret-metrics-server-tls\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.301258 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.301162    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.301258 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.301199    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-audit-log\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.301258 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.301230    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-metrics-server-audit-profiles\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.301448 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.301348    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-secret-metrics-server-client-certs\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.365784 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.365751    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh"]
Jul 14 21:38:54.369175 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.369151    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh"
Jul 14 21:38:54.371749 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.371716    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dqfl7\""
Jul 14 21:38:54.371897 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.371760    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 14 21:38:54.379456 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.379429    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh"]
Jul 14 21:38:54.402119 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.402038    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-audit-log\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.402119 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.402090    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07a31d45-196d-4795-a941-4b2529e2981b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6nbnh\" (UID: \"07a31d45-196d-4795-a941-4b2529e2981b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh"
Jul 14 21:38:54.402371 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.402166    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-metrics-server-audit-profiles\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.402371 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.402335    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-secret-metrics-server-client-certs\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.402479 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.402377    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82ljc\" (UniqueName: \"kubernetes.io/projected/07a31d45-196d-4795-a941-4b2529e2981b-kube-api-access-82ljc\") pod \"monitoring-plugin-5f68df7f58-6nbnh\" (UID: \"07a31d45-196d-4795-a941-4b2529e2981b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh"
Jul 14 21:38:54.402479 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.402421    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7h9r\" (UniqueName: \"kubernetes.io/projected/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-kube-api-access-q7h9r\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.402479 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.402457    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-client-ca-bundle\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.402665 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.402497    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-secret-metrics-server-tls\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.402665 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.402525    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.402665 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.402553    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-audit-log\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.403236 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.403213    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-metrics-server-audit-profiles\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.403534 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.403490    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.405916 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.405874    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-secret-metrics-server-client-certs\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.406033 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.405946    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-client-ca-bundle\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.406033 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.406022    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-secret-metrics-server-tls\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.417704 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.417676    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7h9r\" (UniqueName: \"kubernetes.io/projected/eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356-kube-api-access-q7h9r\") pod \"metrics-server-75c6f76555-wskwv\" (UID: \"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356\") " pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.503725 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.503673    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07a31d45-196d-4795-a941-4b2529e2981b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6nbnh\" (UID: \"07a31d45-196d-4795-a941-4b2529e2981b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh"
Jul 14 21:38:54.503923 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.503773    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82ljc\" (UniqueName: \"kubernetes.io/projected/07a31d45-196d-4795-a941-4b2529e2981b-kube-api-access-82ljc\") pod \"monitoring-plugin-5f68df7f58-6nbnh\" (UID: \"07a31d45-196d-4795-a941-4b2529e2981b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh"
Jul 14 21:38:54.506949 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.506892    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/07a31d45-196d-4795-a941-4b2529e2981b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6nbnh\" (UID: \"07a31d45-196d-4795-a941-4b2529e2981b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh"
Jul 14 21:38:54.513667 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.513636    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82ljc\" (UniqueName: \"kubernetes.io/projected/07a31d45-196d-4795-a941-4b2529e2981b-kube-api-access-82ljc\") pod \"monitoring-plugin-5f68df7f58-6nbnh\" (UID: \"07a31d45-196d-4795-a941-4b2529e2981b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh"
Jul 14 21:38:54.523470 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.523438    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:38:54.680248 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:54.680209    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh"
Jul 14 21:38:55.297538 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.296566    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh"]
Jul 14 21:38:55.303529 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:55.303495    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a31d45_196d_4795_a941_4b2529e2981b.slice/crio-d80615135b91a9a2a15c90bedef7049cb7ae6e78ebf391fd092eb755d762493b WatchSource:0}: Error finding container d80615135b91a9a2a15c90bedef7049cb7ae6e78ebf391fd092eb755d762493b: Status 404 returned error can't find the container with id d80615135b91a9a2a15c90bedef7049cb7ae6e78ebf391fd092eb755d762493b
Jul 14 21:38:55.331407 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.331226    2572 generic.go:356] "Generic (PLEG): container finished" podID="65077af2-1e75-4cef-bd80-c52026caa31e" containerID="d5bee5e584abd29fb3bb9cde1d86aba3bf88a15f33eb7af134af77097e2d1e7b" exitCode=0
Jul 14 21:38:55.331594 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.331504    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65077af2-1e75-4cef-bd80-c52026caa31e","Type":"ContainerDied","Data":"d5bee5e584abd29fb3bb9cde1d86aba3bf88a15f33eb7af134af77097e2d1e7b"}
Jul 14 21:38:55.333172 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.333141    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f75556856-v6lgv" event={"ID":"265a7a1d-0f5d-499f-ab05-197e0e1b6929","Type":"ContainerStarted","Data":"afb1805f0293ede0201be2bb88a6aac9f3c4324658fe5e07a5464432240c8228"}
Jul 14 21:38:55.334784 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.334754    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh" event={"ID":"07a31d45-196d-4795-a941-4b2529e2981b","Type":"ContainerStarted","Data":"d80615135b91a9a2a15c90bedef7049cb7ae6e78ebf391fd092eb755d762493b"}
Jul 14 21:38:55.336887 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.336856    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d" event={"ID":"6ec894e0-b385-4e8b-98fc-fdff455b2d71","Type":"ContainerStarted","Data":"fbaaa5572b019a82ba0412b15417780061740582ff3156c570a91512137fa0a3"}
Jul 14 21:38:55.339800 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.339775    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq" event={"ID":"33b82833-1e09-4f39-80b7-eaf479c2e7ba","Type":"ContainerStarted","Data":"89e19f7dca146d5f9e2cdee61c6ecea8129f2450dc96af84e53d387106d0dec6"}
Jul 14 21:38:55.341861 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.341829    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4rl7" event={"ID":"c2a00549-6a72-4a01-b936-5f1ea204a44b","Type":"ContainerStarted","Data":"0f46c4a771737bacafa8ec483c566f9e833d68b90e5a6f096b1e596959e1edaf"}
Jul 14 21:38:55.347572 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.347471    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75c6f76555-wskwv"]
Jul 14 21:38:55.354332 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:55.354295    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9cd0cf_6a37_4dcf_9ea1_7d4c04c59356.slice/crio-8129d338787e1a2e7453ab102122468b695828ee45d654092d451e62ffa7b195 WatchSource:0}: Error finding container 8129d338787e1a2e7453ab102122468b695828ee45d654092d451e62ffa7b195: Status 404 returned error can't find the container with id 8129d338787e1a2e7453ab102122468b695828ee45d654092d451e62ffa7b195
Jul 14 21:38:55.428610 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.427150    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skkqq" podStartSLOduration=1.615602894 podStartE2EDuration="6.427125935s" totalImagesPullingTime="4.811523041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:55.409372538 +0000 UTC m=+73.894465191" watchObservedRunningTime="2026-07-14 21:38:55.427125935 +0000 UTC m=+73.912218582"
Jul 14 21:38:55.428857 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.428824    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-848c8c8b7d-fs96b"]
Jul 14 21:38:55.468332 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.468290    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-648b5fb79b-2s6ft"]
Jul 14 21:38:55.473131 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.473059    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.484033 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.483403    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648b5fb79b-2s6ft"]
Jul 14 21:38:55.514820 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.514784    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-trusted-ca-bundle\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.514820 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.514824    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-config\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.515099 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.514939    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wn7d\" (UniqueName: \"kubernetes.io/projected/d5d9a8da-61dd-4749-937a-faeccf1143dc-kube-api-access-2wn7d\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.515099 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.515030    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-service-ca\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.515099 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.515065    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-oauth-config\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.515313 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.515128    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-oauth-serving-cert\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.515313 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.515182    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-serving-cert\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.616020 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.615921    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-config\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.616020 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.615991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wn7d\" (UniqueName: \"kubernetes.io/projected/d5d9a8da-61dd-4749-937a-faeccf1143dc-kube-api-access-2wn7d\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.616269 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.616066    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-service-ca\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.616269 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.616097    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-oauth-config\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.616269 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.616154    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-oauth-serving-cert\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.616269 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.616189    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-serving-cert\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.616269 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.616218    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-trusted-ca-bundle\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.617380 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.617347    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-trusted-ca-bundle\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.618764 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.618738    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-config\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.618940 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.618764    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-oauth-serving-cert\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.619309 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.619289    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-service-ca\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.620565 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.620542    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-serving-cert\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.620621 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.620542    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-oauth-config\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.634605 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.634577    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wn7d\" (UniqueName: \"kubernetes.io/projected/d5d9a8da-61dd-4749-937a-faeccf1143dc-kube-api-access-2wn7d\") pod \"console-648b5fb79b-2s6ft\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") " pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.785638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.785359    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:38:55.936157 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.934629    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 21:38:55.957894 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.957716    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:55.958375 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.958348    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 21:38:55.967168 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.964723    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 14 21:38:55.967168 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.965053    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 14 21:38:55.970894 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.967900    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 14 21:38:55.970894 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.967986    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 14 21:38:55.970894 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.968189    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 14 21:38:55.970894 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.968331    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 14 21:38:55.970894 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.968386    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 14 21:38:55.970894 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.968622    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 14 21:38:55.970894 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.968786    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3mvjufghm2v0i\""
Jul 14 21:38:55.970894 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.968847    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 14 21:38:55.970894 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.969162    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 14 21:38:55.970894 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.969202    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 14 21:38:55.970894 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.968612    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 14 21:38:55.970894 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.969447    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xlk66\""
Jul 14 21:38:55.981842 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.981788    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 14 21:38:55.982862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:55.982812    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 14 21:38:56.009081 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.006163    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648b5fb79b-2s6ft"]
Jul 14 21:38:56.009346 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:56.009315    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d9a8da_61dd_4749_937a_faeccf1143dc.slice/crio-7290cd0fefa3ba07f7e2750f9144d5d783399dfa615eb6e275f8e598057226c0 WatchSource:0}: Error finding container 7290cd0fefa3ba07f7e2750f9144d5d783399dfa615eb6e275f8e598057226c0: Status 404 returned error can't find the container with id 7290cd0fefa3ba07f7e2750f9144d5d783399dfa615eb6e275f8e598057226c0
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021419    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021463    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a3be219-67cf-4b05-ac82-ad05f9d71b66-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021491    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021515    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021576    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021613    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021637    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021676    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021709    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021742    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021778    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021801    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df85q\" (UniqueName: \"kubernetes.io/projected/6a3be219-67cf-4b05-ac82-ad05f9d71b66-kube-api-access-df85q\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021833    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a3be219-67cf-4b05-ac82-ad05f9d71b66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021861    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.022272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021910    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-config\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.023094 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021943    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.023094 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.021970    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.023094 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.022010    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.023094 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.022032    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123519    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a3be219-67cf-4b05-ac82-ad05f9d71b66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123574    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123624    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-config\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123654    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123681    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123716    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123740    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123778    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123806    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a3be219-67cf-4b05-ac82-ad05f9d71b66-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123831    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123855    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123895    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123919    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123958    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.123984    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.124024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.124690 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.124056    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.125583 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.124091    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.125583 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.124152    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.125583 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.124184    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df85q\" (UniqueName: \"kubernetes.io/projected/6a3be219-67cf-4b05-ac82-ad05f9d71b66-kube-api-access-df85q\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.128133 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.126083    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.128133 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.126587    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.128133 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.127182    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.128133 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.126589    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.128133 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.127795    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.128133 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.127216    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.135807 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.135742    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.141713 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.140054    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.141713 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.140723    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.141713 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.140742    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df85q\" (UniqueName: \"kubernetes.io/projected/6a3be219-67cf-4b05-ac82-ad05f9d71b66-kube-api-access-df85q\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.141713 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.141500    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a3be219-67cf-4b05-ac82-ad05f9d71b66-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.143966 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.143903    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.143966 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.143940    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.145252 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.144677    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.145252 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.144690    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-web-config\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.145252 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.145072    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.145252 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.145218    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6a3be219-67cf-4b05-ac82-ad05f9d71b66-config-out\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.145516 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.145293    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.145516 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.145501    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6a3be219-67cf-4b05-ac82-ad05f9d71b66-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.146082 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.146038    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6a3be219-67cf-4b05-ac82-ad05f9d71b66-config\") pod \"prometheus-k8s-0\" (UID: \"6a3be219-67cf-4b05-ac82-ad05f9d71b66\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.281421 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.281175    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:38:56.361817 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.361616    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f75556856-v6lgv" event={"ID":"265a7a1d-0f5d-499f-ab05-197e0e1b6929","Type":"ContainerStarted","Data":"af74132f1e246bd1a45d0d2ac6c4d3a6721f51d8c5a70e4fe1c6007ccac76ca6"}
Jul 14 21:38:56.361817 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.361719    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f75556856-v6lgv" event={"ID":"265a7a1d-0f5d-499f-ab05-197e0e1b6929","Type":"ContainerStarted","Data":"cdcf033bb1e8d7f2b4f8320fbc1861be54e2022615efea2e03d0ccb57f2d3aef"}
Jul 14 21:38:56.368267 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.367387    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648b5fb79b-2s6ft" event={"ID":"d5d9a8da-61dd-4749-937a-faeccf1143dc","Type":"ContainerStarted","Data":"6e8059131e7d172da8d6dd90821b9b283b40d0cc322537bd223a3da1b6d52fba"}
Jul 14 21:38:56.368267 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.367456    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648b5fb79b-2s6ft" event={"ID":"d5d9a8da-61dd-4749-937a-faeccf1143dc","Type":"ContainerStarted","Data":"7290cd0fefa3ba07f7e2750f9144d5d783399dfa615eb6e275f8e598057226c0"}
Jul 14 21:38:56.370453 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.370359    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75c6f76555-wskwv" event={"ID":"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356","Type":"ContainerStarted","Data":"8129d338787e1a2e7453ab102122468b695828ee45d654092d451e62ffa7b195"}
Jul 14 21:38:56.378671 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.378391    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d" event={"ID":"6ec894e0-b385-4e8b-98fc-fdff455b2d71","Type":"ContainerStarted","Data":"abed5e8bd743acf29a37d5ab36d3dd8c3241cf53fba8418bba44422c1f54908a"}
Jul 14 21:38:56.378671 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.378461    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d" event={"ID":"6ec894e0-b385-4e8b-98fc-fdff455b2d71","Type":"ContainerStarted","Data":"e6339ec7a475593a9ec0bc166dce26ec1596547adacfd80492052bb01894b144"}
Jul 14 21:38:56.383671 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.383635    2572 generic.go:356] "Generic (PLEG): container finished" podID="c2a00549-6a72-4a01-b936-5f1ea204a44b" containerID="0f46c4a771737bacafa8ec483c566f9e833d68b90e5a6f096b1e596959e1edaf" exitCode=0
Jul 14 21:38:56.385140 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.385091    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4rl7" event={"ID":"c2a00549-6a72-4a01-b936-5f1ea204a44b","Type":"ContainerDied","Data":"0f46c4a771737bacafa8ec483c566f9e833d68b90e5a6f096b1e596959e1edaf"}
Jul 14 21:38:56.391163 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.389570    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-648b5fb79b-2s6ft" podStartSLOduration=1.3895504779999999 podStartE2EDuration="1.389550478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:56.388418993 +0000 UTC m=+74.873511649" watchObservedRunningTime="2026-07-14 21:38:56.389550478 +0000 UTC m=+74.874643129"
Jul 14 21:38:56.417725 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.416052    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-g684d" podStartSLOduration=2.530775883 podStartE2EDuration="7.416027806s" totalImagesPullingTime="4.885251923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:56.414146247 +0000 UTC m=+74.899238901" watchObservedRunningTime="2026-07-14 21:38:56.416027806 +0000 UTC m=+74.901120459"
Jul 14 21:38:56.499035 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:56.498920    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 21:38:57.022706 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:38:57.022657    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3be219_67cf_4b05_ac82_ad05f9d71b66.slice/crio-1e4dfc2f830c40e1d966cb1da17fb9528fb06aa2a2b7a6336efe5c088423fdce WatchSource:0}: Error finding container 1e4dfc2f830c40e1d966cb1da17fb9528fb06aa2a2b7a6336efe5c088423fdce: Status 404 returned error can't find the container with id 1e4dfc2f830c40e1d966cb1da17fb9528fb06aa2a2b7a6336efe5c088423fdce
Jul 14 21:38:57.388808 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:57.388768    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a3be219-67cf-4b05-ac82-ad05f9d71b66","Type":"ContainerStarted","Data":"1e4dfc2f830c40e1d966cb1da17fb9528fb06aa2a2b7a6336efe5c088423fdce"}
Jul 14 21:38:58.396392 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.396354    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh" event={"ID":"07a31d45-196d-4795-a941-4b2529e2981b","Type":"ContainerStarted","Data":"3447edf5e76e5d6cc23561564c050074d8a6922022bb2ada1369230a1330cfd9"}
Jul 14 21:38:58.396828 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.396638    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh"
Jul 14 21:38:58.399143 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.399091    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4rl7" event={"ID":"c2a00549-6a72-4a01-b936-5f1ea204a44b","Type":"ContainerStarted","Data":"62d338caf235e5e83bd46e76d9a1e3852de2cffa2c0e0536c02d25d4c21ea0dc"}
Jul 14 21:38:58.399305 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.399167    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4rl7" event={"ID":"c2a00549-6a72-4a01-b936-5f1ea204a44b","Type":"ContainerStarted","Data":"206d78ab17db1894ae7742a9c84d48c606fb89b017b4f6997c07c78ea0fc8b56"}
Jul 14 21:38:58.400959 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.400913    2572 generic.go:356] "Generic (PLEG): container finished" podID="6a3be219-67cf-4b05-ac82-ad05f9d71b66" containerID="2d1118955f973973da107cc2dc10e1b14a1d893b3e783ad62706138db9651dbf" exitCode=0
Jul 14 21:38:58.401071 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.400993    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a3be219-67cf-4b05-ac82-ad05f9d71b66","Type":"ContainerDied","Data":"2d1118955f973973da107cc2dc10e1b14a1d893b3e783ad62706138db9651dbf"}
Jul 14 21:38:58.403511 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.403494    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh"
Jul 14 21:38:58.406084 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.406049    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65077af2-1e75-4cef-bd80-c52026caa31e","Type":"ContainerStarted","Data":"c5dee35e24e37540e93cc59579d748e5a3d9821f7002c72b2d07d4b165bdbef4"}
Jul 14 21:38:58.406206 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.406142    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65077af2-1e75-4cef-bd80-c52026caa31e","Type":"ContainerStarted","Data":"0242ef5fc456cb817b4acf531a57a96f9ef94d9b95ba62ed8ec533fef047ec6e"}
Jul 14 21:38:58.406206 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.406190    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65077af2-1e75-4cef-bd80-c52026caa31e","Type":"ContainerStarted","Data":"102084d0a9e30c1fb83968385e083a0cbac63a548b54658f672f31000d9955f7"}
Jul 14 21:38:58.406324 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.406221    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65077af2-1e75-4cef-bd80-c52026caa31e","Type":"ContainerStarted","Data":"41cd5237a85dabfdc6026ef4de8ccd41e6c76d0e072376f22889102edca74331"}
Jul 14 21:38:58.406324 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.406258    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65077af2-1e75-4cef-bd80-c52026caa31e","Type":"ContainerStarted","Data":"41f2dffd90ac0d1e96e5cdb642fa7ca37c95ec8d379228955f449a0e95d10683"}
Jul 14 21:38:58.406324 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.406297    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65077af2-1e75-4cef-bd80-c52026caa31e","Type":"ContainerStarted","Data":"16aecbccc91772ae0f1298ef21f6b8f6a8f076dd9d70ffda1677308dd597178e"}
Jul 14 21:38:58.409984 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.409963    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f75556856-v6lgv" event={"ID":"265a7a1d-0f5d-499f-ab05-197e0e1b6929","Type":"ContainerStarted","Data":"7917aa8e64b254a0911067d56683beb6ddd7069354525596c8838c6c78949bed"}
Jul 14 21:38:58.410070 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.410024    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f75556856-v6lgv" event={"ID":"265a7a1d-0f5d-499f-ab05-197e0e1b6929","Type":"ContainerStarted","Data":"b3769155876775c2ce78acaebfc0dcf3da0d92bcdef31ad79d170172530db942"}
Jul 14 21:38:58.410070 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.410066    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f75556856-v6lgv" event={"ID":"265a7a1d-0f5d-499f-ab05-197e0e1b6929","Type":"ContainerStarted","Data":"34ee8baddf5e6866fb4e42d494782b9cc2ada87d85b144ffe82f801438de209b"}
Jul 14 21:38:58.410234 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.410126    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:38:58.411878 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.411856    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75c6f76555-wskwv" event={"ID":"eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356","Type":"ContainerStarted","Data":"c2a915ea6ce6a7cffb5b845c0104001b5fc298e156f9e4660396ea532095374b"}
Jul 14 21:38:58.415555 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.415514    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6nbnh" podStartSLOduration=1.9282292559999998 podStartE2EDuration="4.415497093s" totalImagesPullingTime="2.487267837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:58.415019901 +0000 UTC m=+76.900112554" watchObservedRunningTime="2026-07-14 21:38:58.415497093 +0000 UTC m=+76.900589740"
Jul 14 21:38:58.444240 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.444188    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-75c6f76555-wskwv" podStartSLOduration=2.008375054 podStartE2EDuration="4.444172293s" totalImagesPullingTime="2.435797239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:58.442244234 +0000 UTC m=+76.927336912" watchObservedRunningTime="2026-07-14 21:38:58.444172293 +0000 UTC m=+76.929264945"
Jul 14 21:38:58.467930 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.467882    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g4rl7" podStartSLOduration=7.206266873 podStartE2EDuration="9.467867351s" totalImagesPullingTime="2.165008105s" totalInitContainerRuntime="96.592373ms" isStatefulPod=true podCreationTimestamp="2026-07-14 21:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:58.466071184 +0000 UTC m=+76.951163836" watchObservedRunningTime="2026-07-14 21:38:58.467867351 +0000 UTC m=+76.952960002"
Jul 14 21:38:58.492823 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.492766    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f75556856-v6lgv" podStartSLOduration=3.193655571 podStartE2EDuration="7.492748617s" totalImagesPullingTime="4.299093046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:58.491069924 +0000 UTC m=+76.976162576" watchObservedRunningTime="2026-07-14 21:38:58.492748617 +0000 UTC m=+76.977841269"
Jul 14 21:38:58.601294 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:38:58.601186    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.133244419 podStartE2EDuration="8.601161892s" totalImagesPullingTime="4.440854098s" totalInitContainerRuntime="27.063375ms" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:38:58.600574615 +0000 UTC m=+77.085667267" watchObservedRunningTime="2026-07-14 21:38:58.601161892 +0000 UTC m=+77.086254544"
Jul 14 21:39:02.437396 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:02.437357    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a3be219-67cf-4b05-ac82-ad05f9d71b66","Type":"ContainerStarted","Data":"735922d10e6c77156dd632aa53e370d7b3dba828ce25ee56707693b7bba58e8a"}
Jul 14 21:39:02.437793 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:02.437430    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a3be219-67cf-4b05-ac82-ad05f9d71b66","Type":"ContainerStarted","Data":"6c9c52e0a92a300e39dd370e89eb5a14a4d73ecdb7a7e67704537a41bdeb1cbe"}
Jul 14 21:39:02.437793 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:02.437457    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a3be219-67cf-4b05-ac82-ad05f9d71b66","Type":"ContainerStarted","Data":"f478d88b4314d28a6536fcd66c49a38de3b0ac8cfe373a18a4e037ef9159ebc8"}
Jul 14 21:39:02.437793 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:02.437482    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a3be219-67cf-4b05-ac82-ad05f9d71b66","Type":"ContainerStarted","Data":"2f4ff67605bf81b0332c9c9ea231859c07b50135b34be52311f16ee6d167ba28"}
Jul 14 21:39:02.437793 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:02.437505    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a3be219-67cf-4b05-ac82-ad05f9d71b66","Type":"ContainerStarted","Data":"2c50b2be97cc20c85af7872c47f9628ff1f6aa50a2fd8f1e020409200523b2bb"}
Jul 14 21:39:02.437793 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:02.437527    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6a3be219-67cf-4b05-ac82-ad05f9d71b66","Type":"ContainerStarted","Data":"018df30e627d9558cbe300dd74c4bf40c69775db07d72fb3f1e9e697f0befbc7"}
Jul 14 21:39:02.471721 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:02.471629    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.316969733 podStartE2EDuration="7.471609302s" totalImagesPullingTime="3.12172291s" totalInitContainerRuntime="32.916659ms" isStatefulPod=false podCreationTimestamp="2026-07-14 21:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:39:02.468936658 +0000 UTC m=+80.954029325" watchObservedRunningTime="2026-07-14 21:39:02.471609302 +0000 UTC m=+80.956701954"
Jul 14 21:39:04.424404 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:04.424292    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f75556856-v6lgv"
Jul 14 21:39:05.786193 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:05.786156    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:39:05.786664 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:05.786226    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:39:05.791070 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:05.791047    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:39:06.282058 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:06.282019    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:39:06.459245 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:06.459212    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:39:14.523871 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:14.523835    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:39:14.524365 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:14.523901    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:39:20.466122 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:20.466030    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-848c8c8b7d-fs96b" podUID="3907167d-62bd-440d-a9d2-9a4b7b054f21" containerName="console" containerID="cri-o://aa13d5ca8cf154bdb2cf74502b86e61acdfe90b4b5a3fb68497d7689545cc5a1" gracePeriod=15
Jul 14 21:39:21.242589 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.242556    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:39:21.363554 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.363465    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-config\") pod \"3907167d-62bd-440d-a9d2-9a4b7b054f21\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") "
Jul 14 21:39:21.363554 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.363507    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r577q\" (UniqueName: \"kubernetes.io/projected/3907167d-62bd-440d-a9d2-9a4b7b054f21-kube-api-access-r577q\") pod \"3907167d-62bd-440d-a9d2-9a4b7b054f21\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") "
Jul 14 21:39:21.363554 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.363544    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-service-ca\") pod \"3907167d-62bd-440d-a9d2-9a4b7b054f21\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") "
Jul 14 21:39:21.363807 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.363568    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-oauth-config\") pod \"3907167d-62bd-440d-a9d2-9a4b7b054f21\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") "
Jul 14 21:39:21.363807 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.363589    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-serving-cert\") pod \"3907167d-62bd-440d-a9d2-9a4b7b054f21\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") "
Jul 14 21:39:21.363807 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.363672    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-trusted-ca-bundle\") pod \"3907167d-62bd-440d-a9d2-9a4b7b054f21\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") "
Jul 14 21:39:21.363807 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.363700    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-oauth-serving-cert\") pod \"3907167d-62bd-440d-a9d2-9a4b7b054f21\" (UID: \"3907167d-62bd-440d-a9d2-9a4b7b054f21\") "
Jul 14 21:39:21.364037 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.363895    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-config" (OuterVolumeSpecName: "console-config") pod "3907167d-62bd-440d-a9d2-9a4b7b054f21" (UID: "3907167d-62bd-440d-a9d2-9a4b7b054f21"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:39:21.364037 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.363964    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-service-ca" (OuterVolumeSpecName: "service-ca") pod "3907167d-62bd-440d-a9d2-9a4b7b054f21" (UID: "3907167d-62bd-440d-a9d2-9a4b7b054f21"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:39:21.364184 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.364162    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-config\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:39:21.364241 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.364184    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-service-ca\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:39:21.364241 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.364203    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3907167d-62bd-440d-a9d2-9a4b7b054f21" (UID: "3907167d-62bd-440d-a9d2-9a4b7b054f21"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:39:21.364562 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.364532    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3907167d-62bd-440d-a9d2-9a4b7b054f21" (UID: "3907167d-62bd-440d-a9d2-9a4b7b054f21"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:39:21.366060 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.366033    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3907167d-62bd-440d-a9d2-9a4b7b054f21" (UID: "3907167d-62bd-440d-a9d2-9a4b7b054f21"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:39:21.366060 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.366050    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3907167d-62bd-440d-a9d2-9a4b7b054f21-kube-api-access-r577q" (OuterVolumeSpecName: "kube-api-access-r577q") pod "3907167d-62bd-440d-a9d2-9a4b7b054f21" (UID: "3907167d-62bd-440d-a9d2-9a4b7b054f21"). InnerVolumeSpecName "kube-api-access-r577q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 21:39:21.366226 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.366200    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3907167d-62bd-440d-a9d2-9a4b7b054f21" (UID: "3907167d-62bd-440d-a9d2-9a4b7b054f21"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:39:21.465528 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.465489    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-oauth-config\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:39:21.465528 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.465522    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3907167d-62bd-440d-a9d2-9a4b7b054f21-console-serving-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:39:21.465528 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.465532    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-trusted-ca-bundle\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:39:21.465771 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.465541    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3907167d-62bd-440d-a9d2-9a4b7b054f21-oauth-serving-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:39:21.465771 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.465550    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r577q\" (UniqueName: \"kubernetes.io/projected/3907167d-62bd-440d-a9d2-9a4b7b054f21-kube-api-access-r577q\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:39:21.525721 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.525686    2572 generic.go:356] "Generic (PLEG): container finished" podID="3907167d-62bd-440d-a9d2-9a4b7b054f21" containerID="aa13d5ca8cf154bdb2cf74502b86e61acdfe90b4b5a3fb68497d7689545cc5a1" exitCode=0
Jul 14 21:39:21.526176 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.525748    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-848c8c8b7d-fs96b"
Jul 14 21:39:21.526176 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.525772    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848c8c8b7d-fs96b" event={"ID":"3907167d-62bd-440d-a9d2-9a4b7b054f21","Type":"ContainerDied","Data":"aa13d5ca8cf154bdb2cf74502b86e61acdfe90b4b5a3fb68497d7689545cc5a1"}
Jul 14 21:39:21.526176 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.525846    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-848c8c8b7d-fs96b" event={"ID":"3907167d-62bd-440d-a9d2-9a4b7b054f21","Type":"ContainerDied","Data":"dad756ad5f86774c0531ab82838102942942975358e3fbce72dacc7042c6ab5e"}
Jul 14 21:39:21.526176 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.525868    2572 scope.go:117] "RemoveContainer" containerID="aa13d5ca8cf154bdb2cf74502b86e61acdfe90b4b5a3fb68497d7689545cc5a1"
Jul 14 21:39:21.535252 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.535236    2572 scope.go:117] "RemoveContainer" containerID="aa13d5ca8cf154bdb2cf74502b86e61acdfe90b4b5a3fb68497d7689545cc5a1"
Jul 14 21:39:21.535534 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:39:21.535514    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa13d5ca8cf154bdb2cf74502b86e61acdfe90b4b5a3fb68497d7689545cc5a1\": container with ID starting with aa13d5ca8cf154bdb2cf74502b86e61acdfe90b4b5a3fb68497d7689545cc5a1 not found: ID does not exist" containerID="aa13d5ca8cf154bdb2cf74502b86e61acdfe90b4b5a3fb68497d7689545cc5a1"
Jul 14 21:39:21.535598 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.535542    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa13d5ca8cf154bdb2cf74502b86e61acdfe90b4b5a3fb68497d7689545cc5a1"} err="failed to get container status \"aa13d5ca8cf154bdb2cf74502b86e61acdfe90b4b5a3fb68497d7689545cc5a1\": rpc error: code = NotFound desc = could not find container \"aa13d5ca8cf154bdb2cf74502b86e61acdfe90b4b5a3fb68497d7689545cc5a1\": container with ID starting with aa13d5ca8cf154bdb2cf74502b86e61acdfe90b4b5a3fb68497d7689545cc5a1 not found: ID does not exist"
Jul 14 21:39:21.550729 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.550701    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-848c8c8b7d-fs96b"]
Jul 14 21:39:21.555098 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.555075    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-848c8c8b7d-fs96b"]
Jul 14 21:39:21.977794 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:21.977762    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3907167d-62bd-440d-a9d2-9a4b7b054f21" path="/var/lib/kubelet/pods/3907167d-62bd-440d-a9d2-9a4b7b054f21/volumes"
Jul 14 21:39:25.343791 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:25.343762    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-26bng"
Jul 14 21:39:34.530454 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:34.530420    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:39:34.534282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:34.534256    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-75c6f76555-wskwv"
Jul 14 21:39:56.282476 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:56.282415    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:39:56.301850 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:56.301816    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:39:56.689158 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:39:56.689060    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:40:14.049420 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.049379    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-564f89c8b4-pf84v"]
Jul 14 21:40:14.050477 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.050455    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3907167d-62bd-440d-a9d2-9a4b7b054f21" containerName="console"
Jul 14 21:40:14.050624 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.050614    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3907167d-62bd-440d-a9d2-9a4b7b054f21" containerName="console"
Jul 14 21:40:14.050758 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.050749    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3907167d-62bd-440d-a9d2-9a4b7b054f21" containerName="console"
Jul 14 21:40:14.053285 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.053262    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.056807 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.056784    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 14 21:40:14.056933 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.056784    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 14 21:40:14.057282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.057267    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-whgdl\""
Jul 14 21:40:14.057599 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.057574    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 14 21:40:14.057599 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.057580    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 14 21:40:14.057683 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.057598    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 14 21:40:14.063208 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.063189    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 14 21:40:14.072917 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.072896    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-564f89c8b4-pf84v"]
Jul 14 21:40:14.205423 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.205402    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-telemeter-client-tls\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.205533 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.205440    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62g9x\" (UniqueName: \"kubernetes.io/projected/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-kube-api-access-62g9x\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.205533 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.205477    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.205615 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.205556    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-secret-telemeter-client\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.205615 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.205599    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.205678 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.205636    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-serving-certs-ca-bundle\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.205678 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.205655    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-federate-client-tls\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.205678 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.205670    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-metrics-client-ca\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.306291 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.306240    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-serving-certs-ca-bundle\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.306291 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.306267    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-federate-client-tls\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.306291 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.306283    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-metrics-client-ca\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.306418 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.306307    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-telemeter-client-tls\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.306450 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.306429    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62g9x\" (UniqueName: \"kubernetes.io/projected/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-kube-api-access-62g9x\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.306492 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.306479    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.306546 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.306531    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-secret-telemeter-client\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.306591 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.306556    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.307031 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.306990    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-serving-certs-ca-bundle\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.307031 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.306990    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-metrics-client-ca\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.307512 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.307488    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.308816 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.308796    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-federate-client-tls\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.308904 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.308889    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.309090 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.309075    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-telemeter-client-tls\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.309227 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.309207    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-secret-telemeter-client\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.318404 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.318382    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62g9x\" (UniqueName: \"kubernetes.io/projected/92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9-kube-api-access-62g9x\") pod \"telemeter-client-564f89c8b4-pf84v\" (UID: \"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9\") " pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.362225 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.362205    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v"
Jul 14 21:40:14.513157 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.513133    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-564f89c8b4-pf84v"]
Jul 14 21:40:14.515235 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:40:14.515211    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92cb4e6e_5a0a_4c9e_8572_4d7b26083ae9.slice/crio-c910a6ba9b57dce539c4778c20aeb041b0381457259efcb7b286fc8229321cd4 WatchSource:0}: Error finding container c910a6ba9b57dce539c4778c20aeb041b0381457259efcb7b286fc8229321cd4: Status 404 returned error can't find the container with id c910a6ba9b57dce539c4778c20aeb041b0381457259efcb7b286fc8229321cd4
Jul 14 21:40:14.739348 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:14.739290    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v" event={"ID":"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9","Type":"ContainerStarted","Data":"c910a6ba9b57dce539c4778c20aeb041b0381457259efcb7b286fc8229321cd4"}
Jul 14 21:40:16.750599 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:16.750569    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v" event={"ID":"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9","Type":"ContainerStarted","Data":"e2dc08a4a10a3a7f085e81cf3f257b04e26e80d667f77cde45bd55aa59c069ae"}
Jul 14 21:40:16.751001 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:16.750622    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v" event={"ID":"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9","Type":"ContainerStarted","Data":"b1b0d58dbac783693f40365f4a31917d0d6e219993dda937100c0ebc21cd23ab"}
Jul 14 21:40:16.751001 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:16.750640    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v" event={"ID":"92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9","Type":"ContainerStarted","Data":"342a92a1bd6f0eab15c9da358a48fff4a2a4019b41bbf206f0070f1b36aeb208"}
Jul 14 21:40:16.776742 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:16.776671    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-564f89c8b4-pf84v" podStartSLOduration=0.995494964 podStartE2EDuration="2.776652202s" totalImagesPullingTime="1.781157238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:40:16.77479842 +0000 UTC m=+155.259891070" watchObservedRunningTime="2026-07-14 21:40:16.776652202 +0000 UTC m=+155.261744857"
Jul 14 21:40:37.008457 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:40:37.008363    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648b5fb79b-2s6ft"]
Jul 14 21:41:02.034417 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.034358    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-648b5fb79b-2s6ft" podUID="d5d9a8da-61dd-4749-937a-faeccf1143dc" containerName="console" containerID="cri-o://6e8059131e7d172da8d6dd90821b9b283b40d0cc322537bd223a3da1b6d52fba" gracePeriod=15
Jul 14 21:41:02.272179 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.272160    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:41:02.386471 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.386416    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-config\") pod \"d5d9a8da-61dd-4749-937a-faeccf1143dc\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") "
Jul 14 21:41:02.386471 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.386455    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wn7d\" (UniqueName: \"kubernetes.io/projected/d5d9a8da-61dd-4749-937a-faeccf1143dc-kube-api-access-2wn7d\") pod \"d5d9a8da-61dd-4749-937a-faeccf1143dc\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") "
Jul 14 21:41:02.386658 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.386498    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-oauth-config\") pod \"d5d9a8da-61dd-4749-937a-faeccf1143dc\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") "
Jul 14 21:41:02.386658 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.386522    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-serving-cert\") pod \"d5d9a8da-61dd-4749-937a-faeccf1143dc\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") "
Jul 14 21:41:02.386658 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.386558    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-trusted-ca-bundle\") pod \"d5d9a8da-61dd-4749-937a-faeccf1143dc\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") "
Jul 14 21:41:02.386658 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.386594    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-service-ca\") pod \"d5d9a8da-61dd-4749-937a-faeccf1143dc\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") "
Jul 14 21:41:02.386658 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.386628    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-oauth-serving-cert\") pod \"d5d9a8da-61dd-4749-937a-faeccf1143dc\" (UID: \"d5d9a8da-61dd-4749-937a-faeccf1143dc\") "
Jul 14 21:41:02.386900 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.386803    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-config" (OuterVolumeSpecName: "console-config") pod "d5d9a8da-61dd-4749-937a-faeccf1143dc" (UID: "d5d9a8da-61dd-4749-937a-faeccf1143dc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:41:02.387023 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.387002    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-config\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:41:02.387080 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.387043    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-service-ca" (OuterVolumeSpecName: "service-ca") pod "d5d9a8da-61dd-4749-937a-faeccf1143dc" (UID: "d5d9a8da-61dd-4749-937a-faeccf1143dc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:41:02.387080 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.387058    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d5d9a8da-61dd-4749-937a-faeccf1143dc" (UID: "d5d9a8da-61dd-4749-937a-faeccf1143dc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:41:02.387080 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.387077    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d5d9a8da-61dd-4749-937a-faeccf1143dc" (UID: "d5d9a8da-61dd-4749-937a-faeccf1143dc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:41:02.388713 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.388689    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d5d9a8da-61dd-4749-937a-faeccf1143dc" (UID: "d5d9a8da-61dd-4749-937a-faeccf1143dc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:41:02.388804 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.388712    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d5d9a8da-61dd-4749-937a-faeccf1143dc" (UID: "d5d9a8da-61dd-4749-937a-faeccf1143dc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:41:02.388804 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.388752    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5d9a8da-61dd-4749-937a-faeccf1143dc-kube-api-access-2wn7d" (OuterVolumeSpecName: "kube-api-access-2wn7d") pod "d5d9a8da-61dd-4749-937a-faeccf1143dc" (UID: "d5d9a8da-61dd-4749-937a-faeccf1143dc"). InnerVolumeSpecName "kube-api-access-2wn7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 21:41:02.487348 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.487328    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-oauth-serving-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:41:02.487348 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.487345    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wn7d\" (UniqueName: \"kubernetes.io/projected/d5d9a8da-61dd-4749-937a-faeccf1143dc-kube-api-access-2wn7d\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:41:02.487470 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.487355    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-oauth-config\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:41:02.487470 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.487364    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5d9a8da-61dd-4749-937a-faeccf1143dc-console-serving-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:41:02.487470 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.487372    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-trusted-ca-bundle\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:41:02.487470 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.487382    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5d9a8da-61dd-4749-937a-faeccf1143dc-service-ca\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:41:02.934557 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.934527    2572 generic.go:356] "Generic (PLEG): container finished" podID="d5d9a8da-61dd-4749-937a-faeccf1143dc" containerID="6e8059131e7d172da8d6dd90821b9b283b40d0cc322537bd223a3da1b6d52fba" exitCode=0
Jul 14 21:41:02.934714 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.934598    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648b5fb79b-2s6ft"
Jul 14 21:41:02.934714 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.934602    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648b5fb79b-2s6ft" event={"ID":"d5d9a8da-61dd-4749-937a-faeccf1143dc","Type":"ContainerDied","Data":"6e8059131e7d172da8d6dd90821b9b283b40d0cc322537bd223a3da1b6d52fba"}
Jul 14 21:41:02.934834 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.934716    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648b5fb79b-2s6ft" event={"ID":"d5d9a8da-61dd-4749-937a-faeccf1143dc","Type":"ContainerDied","Data":"7290cd0fefa3ba07f7e2750f9144d5d783399dfa615eb6e275f8e598057226c0"}
Jul 14 21:41:02.934834 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.934740    2572 scope.go:117] "RemoveContainer" containerID="6e8059131e7d172da8d6dd90821b9b283b40d0cc322537bd223a3da1b6d52fba"
Jul 14 21:41:02.944364 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.944340    2572 scope.go:117] "RemoveContainer" containerID="6e8059131e7d172da8d6dd90821b9b283b40d0cc322537bd223a3da1b6d52fba"
Jul 14 21:41:02.944644 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:41:02.944625    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e8059131e7d172da8d6dd90821b9b283b40d0cc322537bd223a3da1b6d52fba\": container with ID starting with 6e8059131e7d172da8d6dd90821b9b283b40d0cc322537bd223a3da1b6d52fba not found: ID does not exist" containerID="6e8059131e7d172da8d6dd90821b9b283b40d0cc322537bd223a3da1b6d52fba"
Jul 14 21:41:02.944682 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.944655    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e8059131e7d172da8d6dd90821b9b283b40d0cc322537bd223a3da1b6d52fba"} err="failed to get container status \"6e8059131e7d172da8d6dd90821b9b283b40d0cc322537bd223a3da1b6d52fba\": rpc error: code = NotFound desc = could not find container \"6e8059131e7d172da8d6dd90821b9b283b40d0cc322537bd223a3da1b6d52fba\": container with ID starting with 6e8059131e7d172da8d6dd90821b9b283b40d0cc322537bd223a3da1b6d52fba not found: ID does not exist"
Jul 14 21:41:02.964654 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.964629    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648b5fb79b-2s6ft"]
Jul 14 21:41:02.974321 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:02.974300    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-648b5fb79b-2s6ft"]
Jul 14 21:41:03.977995 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:03.977968    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5d9a8da-61dd-4749-937a-faeccf1143dc" path="/var/lib/kubelet/pods/d5d9a8da-61dd-4749-937a-faeccf1143dc/volumes"
Jul 14 21:41:44.911174 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:44.911133    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p86ln"]
Jul 14 21:41:44.911613 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:44.911481    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5d9a8da-61dd-4749-937a-faeccf1143dc" containerName="console"
Jul 14 21:41:44.911613 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:44.911492    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5d9a8da-61dd-4749-937a-faeccf1143dc" containerName="console"
Jul 14 21:41:44.911613 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:44.911557    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5d9a8da-61dd-4749-937a-faeccf1143dc" containerName="console"
Jul 14 21:41:44.914135 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:44.914099    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p86ln"
Jul 14 21:41:44.917870 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:44.917839    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 14 21:41:44.918230 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:44.918214    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 14 21:41:44.918913 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:44.918897    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9fmn5\""
Jul 14 21:41:44.927856 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:44.927837    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p86ln"]
Jul 14 21:41:45.022121 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:45.022068    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44f97945-e1a5-4fab-aa1c-edabf5855b6a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p86ln\" (UID: \"44f97945-e1a5-4fab-aa1c-edabf5855b6a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p86ln"
Jul 14 21:41:45.022290 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:45.022144    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbcvw\" (UniqueName: \"kubernetes.io/projected/44f97945-e1a5-4fab-aa1c-edabf5855b6a-kube-api-access-sbcvw\") pod \"cert-manager-webhook-6486ffd997-p86ln\" (UID: \"44f97945-e1a5-4fab-aa1c-edabf5855b6a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p86ln"
Jul 14 21:41:45.122921 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:45.122895    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44f97945-e1a5-4fab-aa1c-edabf5855b6a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p86ln\" (UID: \"44f97945-e1a5-4fab-aa1c-edabf5855b6a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p86ln"
Jul 14 21:41:45.123080 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:45.122941    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbcvw\" (UniqueName: \"kubernetes.io/projected/44f97945-e1a5-4fab-aa1c-edabf5855b6a-kube-api-access-sbcvw\") pod \"cert-manager-webhook-6486ffd997-p86ln\" (UID: \"44f97945-e1a5-4fab-aa1c-edabf5855b6a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p86ln"
Jul 14 21:41:45.151421 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:45.151399    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44f97945-e1a5-4fab-aa1c-edabf5855b6a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p86ln\" (UID: \"44f97945-e1a5-4fab-aa1c-edabf5855b6a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p86ln"
Jul 14 21:41:45.152759 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:45.152739    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbcvw\" (UniqueName: \"kubernetes.io/projected/44f97945-e1a5-4fab-aa1c-edabf5855b6a-kube-api-access-sbcvw\") pod \"cert-manager-webhook-6486ffd997-p86ln\" (UID: \"44f97945-e1a5-4fab-aa1c-edabf5855b6a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p86ln"
Jul 14 21:41:45.241591 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:45.241533    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p86ln"
Jul 14 21:41:45.384599 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:45.384568    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p86ln"]
Jul 14 21:41:45.387799 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:41:45.387778    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44f97945_e1a5_4fab_aa1c_edabf5855b6a.slice/crio-6ba66c63314def20dea9b45367a2b878b8f2b42f1c5b08a5d499bb7029c4e5d9 WatchSource:0}: Error finding container 6ba66c63314def20dea9b45367a2b878b8f2b42f1c5b08a5d499bb7029c4e5d9: Status 404 returned error can't find the container with id 6ba66c63314def20dea9b45367a2b878b8f2b42f1c5b08a5d499bb7029c4e5d9
Jul 14 21:41:46.101252 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:46.101210    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p86ln" event={"ID":"44f97945-e1a5-4fab-aa1c-edabf5855b6a","Type":"ContainerStarted","Data":"6ba66c63314def20dea9b45367a2b878b8f2b42f1c5b08a5d499bb7029c4e5d9"}
Jul 14 21:41:46.844245 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:46.844207    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-twl4h"]
Jul 14 21:41:46.850430 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:46.850405    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-twl4h"
Jul 14 21:41:46.853292 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:46.853270    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-q5bdp\""
Jul 14 21:41:46.854598 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:46.854566    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-twl4h"]
Jul 14 21:41:46.939551 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:46.939498    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/013740b1-6465-4c4a-944b-045e87492cff-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-twl4h\" (UID: \"013740b1-6465-4c4a-944b-045e87492cff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-twl4h"
Jul 14 21:41:46.939707 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:46.939563    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8xg5\" (UniqueName: \"kubernetes.io/projected/013740b1-6465-4c4a-944b-045e87492cff-kube-api-access-f8xg5\") pod \"cert-manager-cainjector-559cdd8c87-twl4h\" (UID: \"013740b1-6465-4c4a-944b-045e87492cff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-twl4h"
Jul 14 21:41:47.040045 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:47.040014    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8xg5\" (UniqueName: \"kubernetes.io/projected/013740b1-6465-4c4a-944b-045e87492cff-kube-api-access-f8xg5\") pod \"cert-manager-cainjector-559cdd8c87-twl4h\" (UID: \"013740b1-6465-4c4a-944b-045e87492cff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-twl4h"
Jul 14 21:41:47.040229 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:47.040148    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/013740b1-6465-4c4a-944b-045e87492cff-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-twl4h\" (UID: \"013740b1-6465-4c4a-944b-045e87492cff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-twl4h"
Jul 14 21:41:47.050505 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:47.050475    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8xg5\" (UniqueName: \"kubernetes.io/projected/013740b1-6465-4c4a-944b-045e87492cff-kube-api-access-f8xg5\") pod \"cert-manager-cainjector-559cdd8c87-twl4h\" (UID: \"013740b1-6465-4c4a-944b-045e87492cff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-twl4h"
Jul 14 21:41:47.050643 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:47.050535    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/013740b1-6465-4c4a-944b-045e87492cff-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-twl4h\" (UID: \"013740b1-6465-4c4a-944b-045e87492cff\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-twl4h"
Jul 14 21:41:47.164036 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:47.163968    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-twl4h"
Jul 14 21:41:48.366570 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:48.366540    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-twl4h"]
Jul 14 21:41:48.369759 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:41:48.369731    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod013740b1_6465_4c4a_944b_045e87492cff.slice/crio-788d398da11b4491ff86f53768ee4c1ab4131423bc41813c014b3cc4bf7d1737 WatchSource:0}: Error finding container 788d398da11b4491ff86f53768ee4c1ab4131423bc41813c014b3cc4bf7d1737: Status 404 returned error can't find the container with id 788d398da11b4491ff86f53768ee4c1ab4131423bc41813c014b3cc4bf7d1737
Jul 14 21:41:49.116155 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:49.116092    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p86ln" event={"ID":"44f97945-e1a5-4fab-aa1c-edabf5855b6a","Type":"ContainerStarted","Data":"cb9fdef0793d35c3ca68cfa9d139b798f477db1a3ebac14df9121957c9d09c11"}
Jul 14 21:41:49.116366 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:49.116251    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p86ln"
Jul 14 21:41:49.117527 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:49.117506    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-twl4h" event={"ID":"013740b1-6465-4c4a-944b-045e87492cff","Type":"ContainerStarted","Data":"07cce7f7b470e3ba70d2a0b7764148fd90c798523c51733a33efb150a2ae924f"}
Jul 14 21:41:49.117622 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:49.117535    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-twl4h" event={"ID":"013740b1-6465-4c4a-944b-045e87492cff","Type":"ContainerStarted","Data":"788d398da11b4491ff86f53768ee4c1ab4131423bc41813c014b3cc4bf7d1737"}
Jul 14 21:41:49.136408 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:49.136367    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-p86ln" podStartSLOduration=2.249558329 podStartE2EDuration="5.136350573s" totalImagesPullingTime="2.886792244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:41:49.135354707 +0000 UTC m=+247.620447361" watchObservedRunningTime="2026-07-14 21:41:49.136350573 +0000 UTC m=+247.621443227"
Jul 14 21:41:49.158356 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:49.155322    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-twl4h" podStartSLOduration=3.1553045 podStartE2EDuration="3.1553045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:41:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:41:49.153013048 +0000 UTC m=+247.638105701" watchObservedRunningTime="2026-07-14 21:41:49.1553045 +0000 UTC m=+247.640397155"
Jul 14 21:41:55.124364 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:41:55.124321    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p86ln"
Jul 14 21:42:19.853232 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:19.853200    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"]
Jul 14 21:42:19.858092 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:19.858072    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:19.860939 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:19.860918    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 21:42:19.861093 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:19.860953    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 21:42:19.861093 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:19.861003    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 21:42:19.861310 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:19.861091    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 21:42:19.861310 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:19.861259    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zzk6s\""
Jul 14 21:42:19.871562 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:19.871540    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"]
Jul 14 21:42:19.921364 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:19.921333    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/378365a2-113e-4918-9899-4320e423c6ce-manifests\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:19.921364 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:19.921364    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/378365a2-113e-4918-9899-4320e423c6ce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:19.921561 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:19.921469    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/378365a2-113e-4918-9899-4320e423c6ce-tmp\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:19.921561 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:19.921498    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82dwx\" (UniqueName: \"kubernetes.io/projected/378365a2-113e-4918-9899-4320e423c6ce-kube-api-access-82dwx\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:19.921561 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:19.921527    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/378365a2-113e-4918-9899-4320e423c6ce-webhook-cert\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:20.022455 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:20.022419    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/378365a2-113e-4918-9899-4320e423c6ce-tmp\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:20.022455 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:20.022455    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82dwx\" (UniqueName: \"kubernetes.io/projected/378365a2-113e-4918-9899-4320e423c6ce-kube-api-access-82dwx\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:20.022710 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:20.022480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/378365a2-113e-4918-9899-4320e423c6ce-webhook-cert\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:20.022710 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:20.022602    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/378365a2-113e-4918-9899-4320e423c6ce-manifests\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:20.022710 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:20.022637    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/378365a2-113e-4918-9899-4320e423c6ce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:20.022963 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:20.022938    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/378365a2-113e-4918-9899-4320e423c6ce-manifests\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:20.024583 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:20.024563    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/378365a2-113e-4918-9899-4320e423c6ce-tmp\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:20.024897 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:20.024882    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/378365a2-113e-4918-9899-4320e423c6ce-webhook-cert\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:20.025086 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:20.025066    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/378365a2-113e-4918-9899-4320e423c6ce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:20.031654 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:20.031631    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82dwx\" (UniqueName: \"kubernetes.io/projected/378365a2-113e-4918-9899-4320e423c6ce-kube-api-access-82dwx\") pod \"opendatahub-operator-controller-manager-c55cf7c4c-6hqcf\" (UID: \"378365a2-113e-4918-9899-4320e423c6ce\") " pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:20.169286 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:20.169193    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:20.304879 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:20.304858    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"]
Jul 14 21:42:20.306982 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:42:20.306957    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod378365a2_113e_4918_9899_4320e423c6ce.slice/crio-86b83020e075c9576a50e1f4527e4c8705e9fac6270ab57ad8ca293c812ff34c WatchSource:0}: Error finding container 86b83020e075c9576a50e1f4527e4c8705e9fac6270ab57ad8ca293c812ff34c: Status 404 returned error can't find the container with id 86b83020e075c9576a50e1f4527e4c8705e9fac6270ab57ad8ca293c812ff34c
Jul 14 21:42:21.246907 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:21.246866    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf" event={"ID":"378365a2-113e-4918-9899-4320e423c6ce","Type":"ContainerStarted","Data":"86b83020e075c9576a50e1f4527e4c8705e9fac6270ab57ad8ca293c812ff34c"}
Jul 14 21:42:24.262003 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:24.261963    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf" event={"ID":"378365a2-113e-4918-9899-4320e423c6ce","Type":"ContainerStarted","Data":"d27be881e6ff82ade3fc405c1aa5c92aae90a670cb248f48d3d8e15eae47e6c5"}
Jul 14 21:42:25.268356 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:25.268315    2572 generic.go:356] "Generic (PLEG): container finished" podID="378365a2-113e-4918-9899-4320e423c6ce" containerID="d27be881e6ff82ade3fc405c1aa5c92aae90a670cb248f48d3d8e15eae47e6c5" exitCode=0
Jul 14 21:42:25.268809 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:25.268395    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf" event={"ID":"378365a2-113e-4918-9899-4320e423c6ce","Type":"ContainerDied","Data":"d27be881e6ff82ade3fc405c1aa5c92aae90a670cb248f48d3d8e15eae47e6c5"}
Jul 14 21:42:26.274802 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:26.274771    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf" event={"ID":"378365a2-113e-4918-9899-4320e423c6ce","Type":"ContainerStarted","Data":"423fe55286618ef3b421953558b6ada61f50e9096bfee51d3065a67506309f40"}
Jul 14 21:42:26.275187 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:26.274890    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:26.303767 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:26.303718    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf" podStartSLOduration=2.946033157 podStartE2EDuration="7.303699396s" totalImagesPullingTime="3.302533005s" totalInitContainerRuntime="1.055133234s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:42:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:42:26.300720429 +0000 UTC m=+284.785813082" watchObservedRunningTime="2026-07-14 21:42:26.303699396 +0000 UTC m=+284.788792047"
Jul 14 21:42:37.280996 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:37.280966    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c55cf7c4c-6hqcf"
Jul 14 21:42:41.844447 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:41.844419    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 21:42:41.850728 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:41.850705    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 21:42:41.854387 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:41.854365    2572 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 21:42:47.641736 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.641705    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"]
Jul 14 21:42:47.644946 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.644929    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.648541 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.648517    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 21:42:47.649280 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.649264    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-c542m\""
Jul 14 21:42:47.649371 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.649308    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 21:42:47.649797 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.649783    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 21:42:47.665328 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.665306    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"]
Jul 14 21:42:47.749626 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.749589    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.749626 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.749627    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbc8x\" (UniqueName: \"kubernetes.io/projected/77b8c1e6-0ede-4d79-9039-1b79b92a8719-kube-api-access-pbc8x\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.749818 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.749700    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.749818 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.749750    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.749818 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.749773    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.749930 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.749867    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.749930 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.749911    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.750005 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.749935    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.750005 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.749954    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.851027 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.850998    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.851173 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.851031    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.851173 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.851069    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.851173 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.851098    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.851173 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.851153    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.851348 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.851178    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbc8x\" (UniqueName: \"kubernetes.io/projected/77b8c1e6-0ede-4d79-9039-1b79b92a8719-kube-api-access-pbc8x\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.851348 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.851311    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.851435 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.851381    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.851435 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.851417    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.851567 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.851550    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.851639 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.851595    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.851639 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.851623    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.851752 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.851729    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.852057 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.852041    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.853532 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.853509    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.853726 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.853709    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.859941 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.859921    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbc8x\" (UniqueName: \"kubernetes.io/projected/77b8c1e6-0ede-4d79-9039-1b79b92a8719-kube-api-access-pbc8x\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.860191 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.860171    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77b8c1e6-0ede-4d79-9039-1b79b92a8719-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf478mvb\" (UID: \"77b8c1e6-0ede-4d79-9039-1b79b92a8719\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:47.955919 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:47.955863    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:48.090309 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:48.090286    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"]
Jul 14 21:42:48.091987 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:42:48.091949    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b8c1e6_0ede_4d79_9039_1b79b92a8719.slice/crio-b1db07ab3497792b4f2eb03e5d4c2caf1ee6053f88f7787a2c0f12e00a113884 WatchSource:0}: Error finding container b1db07ab3497792b4f2eb03e5d4c2caf1ee6053f88f7787a2c0f12e00a113884: Status 404 returned error can't find the container with id b1db07ab3497792b4f2eb03e5d4c2caf1ee6053f88f7787a2c0f12e00a113884
Jul 14 21:42:48.093810 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:48.093794    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 21:42:48.376287 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:48.376257    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb" event={"ID":"77b8c1e6-0ede-4d79-9039-1b79b92a8719","Type":"ContainerStarted","Data":"b1db07ab3497792b4f2eb03e5d4c2caf1ee6053f88f7787a2c0f12e00a113884"}
Jul 14 21:42:49.293777 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.293663    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"]
Jul 14 21:42:49.299588 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.299510    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:49.303374 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.303346    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rlqf6\""
Jul 14 21:42:49.303607 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.303581    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 14 21:42:49.303607 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.303598    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 14 21:42:49.303767 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.303631    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 14 21:42:49.303767 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.303641    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 14 21:42:49.303767 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.303697    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 14 21:42:49.308562 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.308541    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"]
Jul 14 21:42:49.364316 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.364287    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/073abdaf-3293-41cc-9b7c-8e10e9ba49e2-manager-config\") pod \"lws-controller-manager-65d6b5d88-zqwms\" (UID: \"073abdaf-3293-41cc-9b7c-8e10e9ba49e2\") " pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:49.364484 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.364346    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/073abdaf-3293-41cc-9b7c-8e10e9ba49e2-metrics-cert\") pod \"lws-controller-manager-65d6b5d88-zqwms\" (UID: \"073abdaf-3293-41cc-9b7c-8e10e9ba49e2\") " pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:49.364484 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.364431    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/073abdaf-3293-41cc-9b7c-8e10e9ba49e2-cert\") pod \"lws-controller-manager-65d6b5d88-zqwms\" (UID: \"073abdaf-3293-41cc-9b7c-8e10e9ba49e2\") " pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:49.364616 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.364504    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2gng\" (UniqueName: \"kubernetes.io/projected/073abdaf-3293-41cc-9b7c-8e10e9ba49e2-kube-api-access-m2gng\") pod \"lws-controller-manager-65d6b5d88-zqwms\" (UID: \"073abdaf-3293-41cc-9b7c-8e10e9ba49e2\") " pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:49.465826 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.465787    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/073abdaf-3293-41cc-9b7c-8e10e9ba49e2-metrics-cert\") pod \"lws-controller-manager-65d6b5d88-zqwms\" (UID: \"073abdaf-3293-41cc-9b7c-8e10e9ba49e2\") " pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:49.466011 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.465848    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/073abdaf-3293-41cc-9b7c-8e10e9ba49e2-cert\") pod \"lws-controller-manager-65d6b5d88-zqwms\" (UID: \"073abdaf-3293-41cc-9b7c-8e10e9ba49e2\") " pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:49.466011 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.465890    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2gng\" (UniqueName: \"kubernetes.io/projected/073abdaf-3293-41cc-9b7c-8e10e9ba49e2-kube-api-access-m2gng\") pod \"lws-controller-manager-65d6b5d88-zqwms\" (UID: \"073abdaf-3293-41cc-9b7c-8e10e9ba49e2\") " pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:49.466011 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.465941    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/073abdaf-3293-41cc-9b7c-8e10e9ba49e2-manager-config\") pod \"lws-controller-manager-65d6b5d88-zqwms\" (UID: \"073abdaf-3293-41cc-9b7c-8e10e9ba49e2\") " pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:49.466670 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.466642    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/073abdaf-3293-41cc-9b7c-8e10e9ba49e2-manager-config\") pod \"lws-controller-manager-65d6b5d88-zqwms\" (UID: \"073abdaf-3293-41cc-9b7c-8e10e9ba49e2\") " pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:49.469337 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.469315    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/073abdaf-3293-41cc-9b7c-8e10e9ba49e2-cert\") pod \"lws-controller-manager-65d6b5d88-zqwms\" (UID: \"073abdaf-3293-41cc-9b7c-8e10e9ba49e2\") " pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:49.469456 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.469354    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/073abdaf-3293-41cc-9b7c-8e10e9ba49e2-metrics-cert\") pod \"lws-controller-manager-65d6b5d88-zqwms\" (UID: \"073abdaf-3293-41cc-9b7c-8e10e9ba49e2\") " pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:49.481807 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.481779    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2gng\" (UniqueName: \"kubernetes.io/projected/073abdaf-3293-41cc-9b7c-8e10e9ba49e2-kube-api-access-m2gng\") pod \"lws-controller-manager-65d6b5d88-zqwms\" (UID: \"073abdaf-3293-41cc-9b7c-8e10e9ba49e2\") " pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:49.613060 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.612979    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:49.766085 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:49.766059    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"]
Jul 14 21:42:49.768438 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:42:49.768403    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073abdaf_3293_41cc_9b7c_8e10e9ba49e2.slice/crio-bd7ea04d21bf47d8b373de35e94be7251593ae5a0f018bf385eb46b11dca762c WatchSource:0}: Error finding container bd7ea04d21bf47d8b373de35e94be7251593ae5a0f018bf385eb46b11dca762c: Status 404 returned error can't find the container with id bd7ea04d21bf47d8b373de35e94be7251593ae5a0f018bf385eb46b11dca762c
Jul 14 21:42:50.390183 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.390145    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms" event={"ID":"073abdaf-3293-41cc-9b7c-8e10e9ba49e2","Type":"ContainerStarted","Data":"bd7ea04d21bf47d8b373de35e94be7251593ae5a0f018bf385eb46b11dca762c"}
Jul 14 21:42:50.682797 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.682729    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"]
Jul 14 21:42:50.690344 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.690318    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"
Jul 14 21:42:50.690798 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.690777    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk"]
Jul 14 21:42:50.693029 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.693011    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mxpmd\""
Jul 14 21:42:50.693289 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.693271    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 14 21:42:50.694160 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.694144    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk"
Jul 14 21:42:50.696859 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.696837    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jdjr5\""
Jul 14 21:42:50.696960 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.696874    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 14 21:42:50.700771 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.700575    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"]
Jul 14 21:42:50.703943 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.703924    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk"]
Jul 14 21:42:50.780739 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.780698    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa86720d-448c-4782-8625-e81428fa69bd-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vzsdk\" (UID: \"aa86720d-448c-4782-8625-e81428fa69bd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk"
Jul 14 21:42:50.780884 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.780792    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mdd6\" (UniqueName: \"kubernetes.io/projected/a4a21f3c-0409-4544-b9a4-2417a5f45581-kube-api-access-2mdd6\") pod \"kserve-controller-manager-d6f4b65b8-tt2wj\" (UID: \"a4a21f3c-0409-4544-b9a4-2417a5f45581\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"
Jul 14 21:42:50.780884 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.780813    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qhb7\" (UniqueName: \"kubernetes.io/projected/aa86720d-448c-4782-8625-e81428fa69bd-kube-api-access-6qhb7\") pod \"llmisvc-controller-manager-777c6bd7d5-vzsdk\" (UID: \"aa86720d-448c-4782-8625-e81428fa69bd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk"
Jul 14 21:42:50.781009 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.780919    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4a21f3c-0409-4544-b9a4-2417a5f45581-cert\") pod \"kserve-controller-manager-d6f4b65b8-tt2wj\" (UID: \"a4a21f3c-0409-4544-b9a4-2417a5f45581\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"
Jul 14 21:42:50.881847 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.881816    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mdd6\" (UniqueName: \"kubernetes.io/projected/a4a21f3c-0409-4544-b9a4-2417a5f45581-kube-api-access-2mdd6\") pod \"kserve-controller-manager-d6f4b65b8-tt2wj\" (UID: \"a4a21f3c-0409-4544-b9a4-2417a5f45581\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"
Jul 14 21:42:50.881983 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.881861    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qhb7\" (UniqueName: \"kubernetes.io/projected/aa86720d-448c-4782-8625-e81428fa69bd-kube-api-access-6qhb7\") pod \"llmisvc-controller-manager-777c6bd7d5-vzsdk\" (UID: \"aa86720d-448c-4782-8625-e81428fa69bd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk"
Jul 14 21:42:50.881983 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.881909    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4a21f3c-0409-4544-b9a4-2417a5f45581-cert\") pod \"kserve-controller-manager-d6f4b65b8-tt2wj\" (UID: \"a4a21f3c-0409-4544-b9a4-2417a5f45581\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"
Jul 14 21:42:50.881983 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.881953    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa86720d-448c-4782-8625-e81428fa69bd-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vzsdk\" (UID: \"aa86720d-448c-4782-8625-e81428fa69bd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk"
Jul 14 21:42:50.882135 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:42:50.882063    2572 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 14 21:42:50.882196 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:42:50.882150    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4a21f3c-0409-4544-b9a4-2417a5f45581-cert podName:a4a21f3c-0409-4544-b9a4-2417a5f45581 nodeName:}" failed. No retries permitted until 2026-07-14 21:42:51.382129472 +0000 UTC m=+309.867222111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a4a21f3c-0409-4544-b9a4-2417a5f45581-cert") pod "kserve-controller-manager-d6f4b65b8-tt2wj" (UID: "a4a21f3c-0409-4544-b9a4-2417a5f45581") : secret "kserve-webhook-server-cert" not found
Jul 14 21:42:50.884513 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.884488    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa86720d-448c-4782-8625-e81428fa69bd-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vzsdk\" (UID: \"aa86720d-448c-4782-8625-e81428fa69bd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk"
Jul 14 21:42:50.894877 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.894856    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qhb7\" (UniqueName: \"kubernetes.io/projected/aa86720d-448c-4782-8625-e81428fa69bd-kube-api-access-6qhb7\") pod \"llmisvc-controller-manager-777c6bd7d5-vzsdk\" (UID: \"aa86720d-448c-4782-8625-e81428fa69bd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk"
Jul 14 21:42:50.908079 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:50.908054    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mdd6\" (UniqueName: \"kubernetes.io/projected/a4a21f3c-0409-4544-b9a4-2417a5f45581-kube-api-access-2mdd6\") pod \"kserve-controller-manager-d6f4b65b8-tt2wj\" (UID: \"a4a21f3c-0409-4544-b9a4-2417a5f45581\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"
Jul 14 21:42:51.013438 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:51.013410    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk"
Jul 14 21:42:51.047626 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:51.047592    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 21:42:51.047732 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:51.047679    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 21:42:51.047732 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:51.047708    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 21:42:51.228843 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:51.228810    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk"]
Jul 14 21:42:51.240507 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:42:51.240470    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaa86720d_448c_4782_8625_e81428fa69bd.slice/crio-6b2f20fad26d08198bcd7e93c70ed2e4bd0520f60f2d6c706dd90249215cafcb WatchSource:0}: Error finding container 6b2f20fad26d08198bcd7e93c70ed2e4bd0520f60f2d6c706dd90249215cafcb: Status 404 returned error can't find the container with id 6b2f20fad26d08198bcd7e93c70ed2e4bd0520f60f2d6c706dd90249215cafcb
Jul 14 21:42:51.387856 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:51.387755    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4a21f3c-0409-4544-b9a4-2417a5f45581-cert\") pod \"kserve-controller-manager-d6f4b65b8-tt2wj\" (UID: \"a4a21f3c-0409-4544-b9a4-2417a5f45581\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"
Jul 14 21:42:51.388017 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:42:51.387974    2572 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 14 21:42:51.388084 ip-10-0-128-31 kubenswrapper[2572]: E0714 21:42:51.388048    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4a21f3c-0409-4544-b9a4-2417a5f45581-cert podName:a4a21f3c-0409-4544-b9a4-2417a5f45581 nodeName:}" failed. No retries permitted until 2026-07-14 21:42:52.388028689 +0000 UTC m=+310.873121326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a4a21f3c-0409-4544-b9a4-2417a5f45581-cert") pod "kserve-controller-manager-d6f4b65b8-tt2wj" (UID: "a4a21f3c-0409-4544-b9a4-2417a5f45581") : secret "kserve-webhook-server-cert" not found
Jul 14 21:42:51.397707 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:51.397647    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk" event={"ID":"aa86720d-448c-4782-8625-e81428fa69bd","Type":"ContainerStarted","Data":"6b2f20fad26d08198bcd7e93c70ed2e4bd0520f60f2d6c706dd90249215cafcb"}
Jul 14 21:42:51.399991 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:51.399719    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb" event={"ID":"77b8c1e6-0ede-4d79-9039-1b79b92a8719","Type":"ContainerStarted","Data":"019a45317110b3311e6b79c09f14d36795715f01680cfba88e1a4e77c5247555"}
Jul 14 21:42:51.435437 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:51.434362    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb" podStartSLOduration=1.480879034 podStartE2EDuration="4.434344887s" totalImagesPullingTime="2.953465853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:42:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:42:51.433138065 +0000 UTC m=+309.918230719" watchObservedRunningTime="2026-07-14 21:42:51.434344887 +0000 UTC m=+309.919437544"
Jul 14 21:42:51.956178 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:51.956079    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:52.398639 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:52.398605    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4a21f3c-0409-4544-b9a4-2417a5f45581-cert\") pod \"kserve-controller-manager-d6f4b65b8-tt2wj\" (UID: \"a4a21f3c-0409-4544-b9a4-2417a5f45581\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"
Jul 14 21:42:52.403195 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:52.402090    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4a21f3c-0409-4544-b9a4-2417a5f45581-cert\") pod \"kserve-controller-manager-d6f4b65b8-tt2wj\" (UID: \"a4a21f3c-0409-4544-b9a4-2417a5f45581\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"
Jul 14 21:42:52.506516 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:52.506481    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"
Jul 14 21:42:52.962697 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:52.962531    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:53.050272 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:53.050251    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"]
Jul 14 21:42:53.081970 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:42:53.081939    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a21f3c_0409_4544_b9a4_2417a5f45581.slice/crio-67b2e218aa5af22bc6eb3fb4827eeae53a4d6e110b89ea5b91bffd2db8b74b67 WatchSource:0}: Error finding container 67b2e218aa5af22bc6eb3fb4827eeae53a4d6e110b89ea5b91bffd2db8b74b67: Status 404 returned error can't find the container with id 67b2e218aa5af22bc6eb3fb4827eeae53a4d6e110b89ea5b91bffd2db8b74b67
Jul 14 21:42:53.413924 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:53.413893    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj" event={"ID":"a4a21f3c-0409-4544-b9a4-2417a5f45581","Type":"ContainerStarted","Data":"67b2e218aa5af22bc6eb3fb4827eeae53a4d6e110b89ea5b91bffd2db8b74b67"}
Jul 14 21:42:53.414316 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:53.414140    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:53.415167 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:53.415148    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf478mvb"
Jul 14 21:42:54.419705 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:54.419648    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms" event={"ID":"073abdaf-3293-41cc-9b7c-8e10e9ba49e2","Type":"ContainerStarted","Data":"4fa6b26ffeafbece2b32f4a86376b543b074c226faad90f0661bba1821c67539"}
Jul 14 21:42:54.420171 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:54.419730    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:42:56.435658 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:56.435622    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk" event={"ID":"aa86720d-448c-4782-8625-e81428fa69bd","Type":"ContainerStarted","Data":"9e1babef9665270eecd575627214c8e431ae7cb03ebbd2d255a337c8c75e5898"}
Jul 14 21:42:56.436144 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:56.435709    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk"
Jul 14 21:42:56.437233 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:56.437212    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj" event={"ID":"a4a21f3c-0409-4544-b9a4-2417a5f45581","Type":"ContainerStarted","Data":"c52ab40b8ddc846b5a15f804b8cccc5c4e0b6bc05e6b4303b6749c80b82c2f94"}
Jul 14 21:42:56.437334 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:56.437259    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"
Jul 14 21:42:56.455340 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:56.455295    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk" podStartSLOduration=1.738228479 podStartE2EDuration="6.455282457s" totalImagesPullingTime="4.717053978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:42:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:42:56.454516487 +0000 UTC m=+314.939609139" watchObservedRunningTime="2026-07-14 21:42:56.455282457 +0000 UTC m=+314.940375158"
Jul 14 21:42:56.455900 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:56.455878    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms" podStartSLOduration=4.193510196 podStartE2EDuration="7.455872223s" totalImagesPullingTime="3.262362027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:42:54.452065586 +0000 UTC m=+312.937158240" watchObservedRunningTime="2026-07-14 21:42:56.455872223 +0000 UTC m=+314.940964876"
Jul 14 21:42:56.473229 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:42:56.473189    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj" podStartSLOduration=3.59514526 podStartE2EDuration="6.473178536s" totalImagesPullingTime="2.878033276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:42:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:42:56.472312694 +0000 UTC m=+314.957405359" watchObservedRunningTime="2026-07-14 21:42:56.473178536 +0000 UTC m=+314.958271188"
Jul 14 21:43:05.432280 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:05.432245    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65d6b5d88-zqwms"
Jul 14 21:43:27.444903 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:27.444873    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vzsdk"
Jul 14 21:43:27.448026 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:27.448006    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tt2wj"
Jul 14 21:43:41.430929 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:41.430884    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jjwrg"]
Jul 14 21:43:41.433283 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:41.433264    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jjwrg"
Jul 14 21:43:41.437574 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:41.437554    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 21:43:41.438327 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:41.438309    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2xn99\""
Jul 14 21:43:41.438384 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:41.438314    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 21:43:41.444119 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:41.444082    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jjwrg"]
Jul 14 21:43:41.477721 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:41.477701    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbpx7\" (UniqueName: \"kubernetes.io/projected/5f0db111-0cc0-4a6e-9947-8f227addfa0a-kube-api-access-fbpx7\") pod \"kuadrant-operator-catalog-jjwrg\" (UID: \"5f0db111-0cc0-4a6e-9947-8f227addfa0a\") " pod="kuadrant-system/kuadrant-operator-catalog-jjwrg"
Jul 14 21:43:41.579083 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:41.579043    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbpx7\" (UniqueName: \"kubernetes.io/projected/5f0db111-0cc0-4a6e-9947-8f227addfa0a-kube-api-access-fbpx7\") pod \"kuadrant-operator-catalog-jjwrg\" (UID: \"5f0db111-0cc0-4a6e-9947-8f227addfa0a\") " pod="kuadrant-system/kuadrant-operator-catalog-jjwrg"
Jul 14 21:43:41.593930 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:41.593906    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbpx7\" (UniqueName: \"kubernetes.io/projected/5f0db111-0cc0-4a6e-9947-8f227addfa0a-kube-api-access-fbpx7\") pod \"kuadrant-operator-catalog-jjwrg\" (UID: \"5f0db111-0cc0-4a6e-9947-8f227addfa0a\") " pod="kuadrant-system/kuadrant-operator-catalog-jjwrg"
Jul 14 21:43:41.743082 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:41.742999    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jjwrg"
Jul 14 21:43:41.903655 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:41.903625    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jjwrg"]
Jul 14 21:43:41.906567 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:43:41.906544    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0db111_0cc0_4a6e_9947_8f227addfa0a.slice/crio-220ffca27b1d860e6f1c78744e7161cf423fd2d0c345d72715e8081b5369b2ad WatchSource:0}: Error finding container 220ffca27b1d860e6f1c78744e7161cf423fd2d0c345d72715e8081b5369b2ad: Status 404 returned error can't find the container with id 220ffca27b1d860e6f1c78744e7161cf423fd2d0c345d72715e8081b5369b2ad
Jul 14 21:43:42.653936 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:42.653892    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jjwrg" event={"ID":"5f0db111-0cc0-4a6e-9947-8f227addfa0a","Type":"ContainerStarted","Data":"220ffca27b1d860e6f1c78744e7161cf423fd2d0c345d72715e8081b5369b2ad"}
Jul 14 21:43:44.665025 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:44.664986    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jjwrg" event={"ID":"5f0db111-0cc0-4a6e-9947-8f227addfa0a","Type":"ContainerStarted","Data":"3f29432fe405177b58de38bb1dbe42617715f6a9b4bfb88d2489679fb75f6e16"}
Jul 14 21:43:44.683782 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:44.683732    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jjwrg" podStartSLOduration=1.834482945 podStartE2EDuration="3.683716462s" totalImagesPullingTime="1.849233517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:43:44.681881118 +0000 UTC m=+363.166973770" watchObservedRunningTime="2026-07-14 21:43:44.683716462 +0000 UTC m=+363.168809113"
Jul 14 21:43:51.744002 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:51.743971    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-jjwrg"
Jul 14 21:43:51.744505 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:51.744022    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-jjwrg"
Jul 14 21:43:51.766057 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:51.766035    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-jjwrg"
Jul 14 21:43:52.724931 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:43:52.724908    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-jjwrg"
Jul 14 21:44:16.749336 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:44:16.749302    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n8npt"]
Jul 14 21:44:16.751795 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:44:16.751777    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8npt"
Jul 14 21:44:16.754355 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:44:16.754331    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-52gw7\""
Jul 14 21:44:16.768087 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:44:16.768062    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n8npt"]
Jul 14 21:44:16.769685 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:44:16.769662    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l4gw\" (UniqueName: \"kubernetes.io/projected/257376ae-58e6-4a2e-9c67-58ec2db47968-kube-api-access-8l4gw\") pod \"authorino-operator-75cc8d5cb7-n8npt\" (UID: \"257376ae-58e6-4a2e-9c67-58ec2db47968\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8npt"
Jul 14 21:44:16.870979 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:44:16.870943    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l4gw\" (UniqueName: \"kubernetes.io/projected/257376ae-58e6-4a2e-9c67-58ec2db47968-kube-api-access-8l4gw\") pod \"authorino-operator-75cc8d5cb7-n8npt\" (UID: \"257376ae-58e6-4a2e-9c67-58ec2db47968\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8npt"
Jul 14 21:44:16.884930 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:44:16.884903    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l4gw\" (UniqueName: \"kubernetes.io/projected/257376ae-58e6-4a2e-9c67-58ec2db47968-kube-api-access-8l4gw\") pod \"authorino-operator-75cc8d5cb7-n8npt\" (UID: \"257376ae-58e6-4a2e-9c67-58ec2db47968\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8npt"
Jul 14 21:44:17.062155 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:44:17.062119    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8npt"
Jul 14 21:44:17.233481 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:44:17.233449    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n8npt"]
Jul 14 21:44:17.246499 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:44:17.246469    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257376ae_58e6_4a2e_9c67_58ec2db47968.slice/crio-225b3f736465667e0494b90c25c44cb3b0d8785b77b2827743d04d4379a7a1dd WatchSource:0}: Error finding container 225b3f736465667e0494b90c25c44cb3b0d8785b77b2827743d04d4379a7a1dd: Status 404 returned error can't find the container with id 225b3f736465667e0494b90c25c44cb3b0d8785b77b2827743d04d4379a7a1dd
Jul 14 21:44:17.828814 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:44:17.828780    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8npt" event={"ID":"257376ae-58e6-4a2e-9c67-58ec2db47968","Type":"ContainerStarted","Data":"225b3f736465667e0494b90c25c44cb3b0d8785b77b2827743d04d4379a7a1dd"}
Jul 14 21:44:19.841592 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:44:19.841510    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8npt" event={"ID":"257376ae-58e6-4a2e-9c67-58ec2db47968","Type":"ContainerStarted","Data":"58fab548f026007507abc0129668c2414d7cc77b08811bd98d3cd6cdb87131dc"}
Jul 14 21:44:19.841957 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:44:19.841607    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8npt"
Jul 14 21:44:19.867121 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:44:19.867061    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8npt" podStartSLOduration=1.577146747 podStartE2EDuration="3.86704552s" totalImagesPullingTime="2.289898773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:44:19.865283711 +0000 UTC m=+398.350376364" watchObservedRunningTime="2026-07-14 21:44:19.86704552 +0000 UTC m=+398.352138173"
Jul 14 21:44:30.847809 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:44:30.847780    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8npt"
Jul 14 21:45:02.980505 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:02.980475    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"]
Jul 14 21:45:02.986503 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:02.986456    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:02.990009 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:02.989991    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-q9z68\""
Jul 14 21:45:02.999432 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:02.999411    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"]
Jul 14 21:45:03.066484 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.066460    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.066615 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.066498    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.066615 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.066517    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r9jn\" (UniqueName: \"kubernetes.io/projected/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-kube-api-access-6r9jn\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.066615 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.066561    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.066615 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.066602    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.066754 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.066627    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.066754 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.066722    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.066815 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.066752    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.066815 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.066773    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.167707 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.167679    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.167849 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.167729    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.167849 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.167751    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.167849 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.167774    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.167849 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.167793    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.167849 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.167810    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r9jn\" (UniqueName: \"kubernetes.io/projected/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-kube-api-access-6r9jn\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.167849 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.167837    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.168180 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.167871    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.168180 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.167896    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.168180 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.168157    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.168326 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.168257    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.168525 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.168506    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.168632 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.168579    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.168712 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.168693    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.169981 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.169959    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.170215 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.170199    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.179472 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.179451    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r9jn\" (UniqueName: \"kubernetes.io/projected/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-kube-api-access-6r9jn\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.181834 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.181817    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fd51fe4-61c0-418c-bd03-0889b3ae7c71-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-h7lss\" (UID: \"4fd51fe4-61c0-418c-bd03-0889b3ae7c71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.296999 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.296974    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:03.440757 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.440732    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"]
Jul 14 21:45:03.442758 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:45:03.442730    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fd51fe4_61c0_418c_bd03_0889b3ae7c71.slice/crio-0da96a2c8675cb302652af842ac446c2fe1d5c230385bdcaefb3ab299bcf81ed WatchSource:0}: Error finding container 0da96a2c8675cb302652af842ac446c2fe1d5c230385bdcaefb3ab299bcf81ed: Status 404 returned error can't find the container with id 0da96a2c8675cb302652af842ac446c2fe1d5c230385bdcaefb3ab299bcf81ed
Jul 14 21:45:03.444715 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.444683    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 21:45:03.444793 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.444744    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 21:45:03.444793 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:03.444772    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 21:45:04.042900 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:04.042867    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss" event={"ID":"4fd51fe4-61c0-418c-bd03-0889b3ae7c71","Type":"ContainerStarted","Data":"f88a36ebe530b1d784763393779a873a51f0c855e5ff4dcabbf596856d38dc4e"}
Jul 14 21:45:04.043282 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:04.042914    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss" event={"ID":"4fd51fe4-61c0-418c-bd03-0889b3ae7c71","Type":"ContainerStarted","Data":"0da96a2c8675cb302652af842ac446c2fe1d5c230385bdcaefb3ab299bcf81ed"}
Jul 14 21:45:04.074677 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:04.074632    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss" podStartSLOduration=2.074618878 podStartE2EDuration="2.074618878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:45:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:45:04.073290728 +0000 UTC m=+442.558383379" watchObservedRunningTime="2026-07-14 21:45:04.074618878 +0000 UTC m=+442.559711528"
Jul 14 21:45:04.297436 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:04.297358    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:04.301854 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:04.301831    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:05.047511 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.047481    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:05.048557 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.048534    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:45:05.277191 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.277160    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cnht8"]
Jul 14 21:45:05.280656 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.280639    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8"
Jul 14 21:45:05.283573 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.283554    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 14 21:45:05.283915 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.283897    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mgtcm\""
Jul 14 21:45:05.291804 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.291783    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cnht8"]
Jul 14 21:45:05.379758 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.379688    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cnht8"]
Jul 14 21:45:05.388264 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.388238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvdgr\" (UniqueName: \"kubernetes.io/projected/b6bb23fc-d54b-438a-8d0c-903128c66e68-kube-api-access-rvdgr\") pod \"limitador-limitador-64c94fd64f-cnht8\" (UID: \"b6bb23fc-d54b-438a-8d0c-903128c66e68\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8"
Jul 14 21:45:05.388389 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.388339    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6bb23fc-d54b-438a-8d0c-903128c66e68-config-file\") pod \"limitador-limitador-64c94fd64f-cnht8\" (UID: \"b6bb23fc-d54b-438a-8d0c-903128c66e68\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8"
Jul 14 21:45:05.489522 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.489494    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6bb23fc-d54b-438a-8d0c-903128c66e68-config-file\") pod \"limitador-limitador-64c94fd64f-cnht8\" (UID: \"b6bb23fc-d54b-438a-8d0c-903128c66e68\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8"
Jul 14 21:45:05.489664 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.489565    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvdgr\" (UniqueName: \"kubernetes.io/projected/b6bb23fc-d54b-438a-8d0c-903128c66e68-kube-api-access-rvdgr\") pod \"limitador-limitador-64c94fd64f-cnht8\" (UID: \"b6bb23fc-d54b-438a-8d0c-903128c66e68\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8"
Jul 14 21:45:05.490068 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.490051    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6bb23fc-d54b-438a-8d0c-903128c66e68-config-file\") pod \"limitador-limitador-64c94fd64f-cnht8\" (UID: \"b6bb23fc-d54b-438a-8d0c-903128c66e68\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8"
Jul 14 21:45:05.500958 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.500930    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvdgr\" (UniqueName: \"kubernetes.io/projected/b6bb23fc-d54b-438a-8d0c-903128c66e68-kube-api-access-rvdgr\") pod \"limitador-limitador-64c94fd64f-cnht8\" (UID: \"b6bb23fc-d54b-438a-8d0c-903128c66e68\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8"
Jul 14 21:45:05.591076 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.591048    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8"
Jul 14 21:45:05.715904 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:05.715881    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cnht8"]
Jul 14 21:45:05.718150 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:45:05.718121    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6bb23fc_d54b_438a_8d0c_903128c66e68.slice/crio-eac158449f5e8c898fa830c162f6901f10cbb12dae59c5242489350629120fbf WatchSource:0}: Error finding container eac158449f5e8c898fa830c162f6901f10cbb12dae59c5242489350629120fbf: Status 404 returned error can't find the container with id eac158449f5e8c898fa830c162f6901f10cbb12dae59c5242489350629120fbf
Jul 14 21:45:06.053048 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:06.053018    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8" event={"ID":"b6bb23fc-d54b-438a-8d0c-903128c66e68","Type":"ContainerStarted","Data":"eac158449f5e8c898fa830c162f6901f10cbb12dae59c5242489350629120fbf"}
Jul 14 21:45:09.071600 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:09.071557    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8" event={"ID":"b6bb23fc-d54b-438a-8d0c-903128c66e68","Type":"ContainerStarted","Data":"e5b9ce0174dde41946c237b4fa1a85e6996cb8e168f74ed744678b25af6e577f"}
Jul 14 21:45:09.071920 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:09.071612    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8"
Jul 14 21:45:09.097991 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:09.097957    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8" podStartSLOduration=1.202039028 podStartE2EDuration="4.097945931s" totalImagesPullingTime="2.895906903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:45:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:45:09.097661556 +0000 UTC m=+447.582754208" watchObservedRunningTime="2026-07-14 21:45:09.097945931 +0000 UTC m=+447.583038581"
Jul 14 21:45:20.077877 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:20.077852    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8"
Jul 14 21:45:20.686862 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:20.686832    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cnht8"]
Jul 14 21:45:20.687037 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:20.687015    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8" podUID="b6bb23fc-d54b-438a-8d0c-903128c66e68" containerName="limitador" containerID="cri-o://e5b9ce0174dde41946c237b4fa1a85e6996cb8e168f74ed744678b25af6e577f" gracePeriod=30
Jul 14 21:45:21.128659 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:21.128628    2572 generic.go:356] "Generic (PLEG): container finished" podID="b6bb23fc-d54b-438a-8d0c-903128c66e68" containerID="e5b9ce0174dde41946c237b4fa1a85e6996cb8e168f74ed744678b25af6e577f" exitCode=0
Jul 14 21:45:21.129044 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:21.128697    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8" event={"ID":"b6bb23fc-d54b-438a-8d0c-903128c66e68","Type":"ContainerDied","Data":"e5b9ce0174dde41946c237b4fa1a85e6996cb8e168f74ed744678b25af6e577f"}
Jul 14 21:45:21.228322 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:21.228301    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8"
Jul 14 21:45:21.319501 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:21.319479    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvdgr\" (UniqueName: \"kubernetes.io/projected/b6bb23fc-d54b-438a-8d0c-903128c66e68-kube-api-access-rvdgr\") pod \"b6bb23fc-d54b-438a-8d0c-903128c66e68\" (UID: \"b6bb23fc-d54b-438a-8d0c-903128c66e68\") "
Jul 14 21:45:21.319618 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:21.319547    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6bb23fc-d54b-438a-8d0c-903128c66e68-config-file\") pod \"b6bb23fc-d54b-438a-8d0c-903128c66e68\" (UID: \"b6bb23fc-d54b-438a-8d0c-903128c66e68\") "
Jul 14 21:45:21.319856 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:21.319835    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6bb23fc-d54b-438a-8d0c-903128c66e68-config-file" (OuterVolumeSpecName: "config-file") pod "b6bb23fc-d54b-438a-8d0c-903128c66e68" (UID: "b6bb23fc-d54b-438a-8d0c-903128c66e68"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:45:21.321484 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:21.321461    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6bb23fc-d54b-438a-8d0c-903128c66e68-kube-api-access-rvdgr" (OuterVolumeSpecName: "kube-api-access-rvdgr") pod "b6bb23fc-d54b-438a-8d0c-903128c66e68" (UID: "b6bb23fc-d54b-438a-8d0c-903128c66e68"). InnerVolumeSpecName "kube-api-access-rvdgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 21:45:21.421059 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:21.421038    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvdgr\" (UniqueName: \"kubernetes.io/projected/b6bb23fc-d54b-438a-8d0c-903128c66e68-kube-api-access-rvdgr\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:45:21.421059 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:21.421059    2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6bb23fc-d54b-438a-8d0c-903128c66e68-config-file\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:45:22.134313 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:22.134284    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8"
Jul 14 21:45:22.134653 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:22.134334    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-cnht8" event={"ID":"b6bb23fc-d54b-438a-8d0c-903128c66e68","Type":"ContainerDied","Data":"eac158449f5e8c898fa830c162f6901f10cbb12dae59c5242489350629120fbf"}
Jul 14 21:45:22.134653 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:22.134388    2572 scope.go:117] "RemoveContainer" containerID="e5b9ce0174dde41946c237b4fa1a85e6996cb8e168f74ed744678b25af6e577f"
Jul 14 21:45:22.154537 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:22.154516    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cnht8"]
Jul 14 21:45:22.162100 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:22.162081    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cnht8"]
Jul 14 21:45:23.978378 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:23.978347    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6bb23fc-d54b-438a-8d0c-903128c66e68" path="/var/lib/kubelet/pods/b6bb23fc-d54b-438a-8d0c-903128c66e68/volumes"
Jul 14 21:45:25.132899 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.132869    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d7cd67df7-tg59k"]
Jul 14 21:45:25.133289 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.133276    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6bb23fc-d54b-438a-8d0c-903128c66e68" containerName="limitador"
Jul 14 21:45:25.133289 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.133290    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6bb23fc-d54b-438a-8d0c-903128c66e68" containerName="limitador"
Jul 14 21:45:25.133381 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.133373    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6bb23fc-d54b-438a-8d0c-903128c66e68" containerName="limitador"
Jul 14 21:45:25.136379 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.136359    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.139354 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.139328    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 21:45:25.139466 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.139410    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 21:45:25.140682 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.140665    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 21:45:25.140770 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.140695    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6thlj\""
Jul 14 21:45:25.140770 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.140748    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 14 21:45:25.140770 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.140760    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 21:45:25.140932 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.140785    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 14 21:45:25.140932 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.140881    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 21:45:25.145348 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.145330    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 14 21:45:25.153865 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.153842    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7cd67df7-tg59k"]
Jul 14 21:45:25.251591 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.251564    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1195769f-a892-4f15-9246-9f8774aa0b47-console-oauth-config\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.251685 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.251617    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1195769f-a892-4f15-9246-9f8774aa0b47-console-config\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.251685 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.251655    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1195769f-a892-4f15-9246-9f8774aa0b47-trusted-ca-bundle\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.251766 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.251683    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1195769f-a892-4f15-9246-9f8774aa0b47-service-ca\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.251766 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.251727    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf6vf\" (UniqueName: \"kubernetes.io/projected/1195769f-a892-4f15-9246-9f8774aa0b47-kube-api-access-gf6vf\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.251766 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.251756    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1195769f-a892-4f15-9246-9f8774aa0b47-oauth-serving-cert\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.251873 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.251786    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1195769f-a892-4f15-9246-9f8774aa0b47-console-serving-cert\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.352825 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.352801    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf6vf\" (UniqueName: \"kubernetes.io/projected/1195769f-a892-4f15-9246-9f8774aa0b47-kube-api-access-gf6vf\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.352908 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.352838    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1195769f-a892-4f15-9246-9f8774aa0b47-oauth-serving-cert\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.352908 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.352855    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1195769f-a892-4f15-9246-9f8774aa0b47-console-serving-cert\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.352908 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.352885    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1195769f-a892-4f15-9246-9f8774aa0b47-console-oauth-config\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.353073 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.352915    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1195769f-a892-4f15-9246-9f8774aa0b47-console-config\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.353073 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.352931    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1195769f-a892-4f15-9246-9f8774aa0b47-trusted-ca-bundle\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.353073 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.352955    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1195769f-a892-4f15-9246-9f8774aa0b47-service-ca\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.353588 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.353567    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1195769f-a892-4f15-9246-9f8774aa0b47-console-config\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.353684 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.353626    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1195769f-a892-4f15-9246-9f8774aa0b47-oauth-serving-cert\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.353745 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.353698    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1195769f-a892-4f15-9246-9f8774aa0b47-service-ca\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.353858 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.353840    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1195769f-a892-4f15-9246-9f8774aa0b47-trusted-ca-bundle\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.355304 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.355282    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1195769f-a892-4f15-9246-9f8774aa0b47-console-serving-cert\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.355364 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.355343    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1195769f-a892-4f15-9246-9f8774aa0b47-console-oauth-config\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.363019 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.362996    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf6vf\" (UniqueName: \"kubernetes.io/projected/1195769f-a892-4f15-9246-9f8774aa0b47-kube-api-access-gf6vf\") pod \"console-6d7cd67df7-tg59k\" (UID: \"1195769f-a892-4f15-9246-9f8774aa0b47\") " pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.446085 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.446037    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:25.582840 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:25.582818    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7cd67df7-tg59k"]
Jul 14 21:45:25.584793 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:45:25.584768    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1195769f_a892_4f15_9246_9f8774aa0b47.slice/crio-4a1e81b96832656eda2814df418e771595b5b1299a4a02b777603469370b5d9b WatchSource:0}: Error finding container 4a1e81b96832656eda2814df418e771595b5b1299a4a02b777603469370b5d9b: Status 404 returned error can't find the container with id 4a1e81b96832656eda2814df418e771595b5b1299a4a02b777603469370b5d9b
Jul 14 21:45:26.155406 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:26.155373    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7cd67df7-tg59k" event={"ID":"1195769f-a892-4f15-9246-9f8774aa0b47","Type":"ContainerStarted","Data":"ce4db165cd2333e9e82bf02c429012f1971574a63d822c191107a303dd016b9f"}
Jul 14 21:45:26.155834 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:26.155427    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7cd67df7-tg59k" event={"ID":"1195769f-a892-4f15-9246-9f8774aa0b47","Type":"ContainerStarted","Data":"4a1e81b96832656eda2814df418e771595b5b1299a4a02b777603469370b5d9b"}
Jul 14 21:45:26.178517 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:26.178475    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d7cd67df7-tg59k" podStartSLOduration=1.1784606850000001 podStartE2EDuration="1.178460685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:45:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:45:26.176965637 +0000 UTC m=+464.662058288" watchObservedRunningTime="2026-07-14 21:45:26.178460685 +0000 UTC m=+464.663553336"
Jul 14 21:45:26.949855 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:26.949826    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-95pfb"]
Jul 14 21:45:26.953416 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:26.953392    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-95pfb"
Jul 14 21:45:26.956147 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:26.956128    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 14 21:45:26.956349 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:26.956334    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vwd7s\""
Jul 14 21:45:26.967940 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:26.967914    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-95pfb"]
Jul 14 21:45:27.067787 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:27.067759    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlsqp\" (UniqueName: \"kubernetes.io/projected/18af709a-7505-4845-a38d-c796a2d9c485-kube-api-access-mlsqp\") pod \"postgres-69fb4594cf-95pfb\" (UID: \"18af709a-7505-4845-a38d-c796a2d9c485\") " pod="opendatahub/postgres-69fb4594cf-95pfb"
Jul 14 21:45:27.067996 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:27.067977    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/18af709a-7505-4845-a38d-c796a2d9c485-data\") pod \"postgres-69fb4594cf-95pfb\" (UID: \"18af709a-7505-4845-a38d-c796a2d9c485\") " pod="opendatahub/postgres-69fb4594cf-95pfb"
Jul 14 21:45:27.168721 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:27.168697    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlsqp\" (UniqueName: \"kubernetes.io/projected/18af709a-7505-4845-a38d-c796a2d9c485-kube-api-access-mlsqp\") pod \"postgres-69fb4594cf-95pfb\" (UID: \"18af709a-7505-4845-a38d-c796a2d9c485\") " pod="opendatahub/postgres-69fb4594cf-95pfb"
Jul 14 21:45:27.169144 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:27.168755    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/18af709a-7505-4845-a38d-c796a2d9c485-data\") pod \"postgres-69fb4594cf-95pfb\" (UID: \"18af709a-7505-4845-a38d-c796a2d9c485\") " pod="opendatahub/postgres-69fb4594cf-95pfb"
Jul 14 21:45:27.169220 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:27.169185    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/18af709a-7505-4845-a38d-c796a2d9c485-data\") pod \"postgres-69fb4594cf-95pfb\" (UID: \"18af709a-7505-4845-a38d-c796a2d9c485\") " pod="opendatahub/postgres-69fb4594cf-95pfb"
Jul 14 21:45:27.190697 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:27.190670    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlsqp\" (UniqueName: \"kubernetes.io/projected/18af709a-7505-4845-a38d-c796a2d9c485-kube-api-access-mlsqp\") pod \"postgres-69fb4594cf-95pfb\" (UID: \"18af709a-7505-4845-a38d-c796a2d9c485\") " pod="opendatahub/postgres-69fb4594cf-95pfb"
Jul 14 21:45:27.268773 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:27.268755    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-95pfb"
Jul 14 21:45:27.395276 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:27.395249    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-95pfb"]
Jul 14 21:45:27.397269 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:45:27.397235    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18af709a_7505_4845_a38d_c796a2d9c485.slice/crio-2639685ccc206be653bb3f3e9eda950ee5e1cdb92de2bd25dc39240a7a8cc0ca WatchSource:0}: Error finding container 2639685ccc206be653bb3f3e9eda950ee5e1cdb92de2bd25dc39240a7a8cc0ca: Status 404 returned error can't find the container with id 2639685ccc206be653bb3f3e9eda950ee5e1cdb92de2bd25dc39240a7a8cc0ca
Jul 14 21:45:28.168528 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:28.168491    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-95pfb" event={"ID":"18af709a-7505-4845-a38d-c796a2d9c485","Type":"ContainerStarted","Data":"2639685ccc206be653bb3f3e9eda950ee5e1cdb92de2bd25dc39240a7a8cc0ca"}
Jul 14 21:45:32.193174 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:32.193137    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-95pfb" event={"ID":"18af709a-7505-4845-a38d-c796a2d9c485","Type":"ContainerStarted","Data":"81b57d582e5596fb68165167e06ee65bd3cf1f9ab0674d77fc4248dd7c4c1631"}
Jul 14 21:45:32.193514 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:32.193200    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-95pfb"
Jul 14 21:45:32.213511 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:32.213468    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-95pfb" podStartSLOduration=1.6211644870000002 podStartE2EDuration="6.213452475s" totalImagesPullingTime="4.592287988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:45:32.211551451 +0000 UTC m=+470.696644102" watchObservedRunningTime="2026-07-14 21:45:32.213452475 +0000 UTC m=+470.698545121"
Jul 14 21:45:35.446784 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:35.446756    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:35.447366 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:35.446803    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:35.450817 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:35.450793    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:36.216449 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:36.216424    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d7cd67df7-tg59k"
Jul 14 21:45:38.227643 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:38.227611    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-95pfb"
Jul 14 21:45:45.351463 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:45.351435    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7469c76db5-fwzdf"]
Jul 14 21:45:45.374599 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:45.374570    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7469c76db5-fwzdf"]
Jul 14 21:45:45.374764 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:45.374658    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7469c76db5-fwzdf"
Jul 14 21:45:45.377377 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:45.377352    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 21:45:45.377505 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:45.377352    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9dr4p\""
Jul 14 21:45:45.377505 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:45.377410    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 21:45:45.531465 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:45.531435    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d70b07b-3707-4393-85c7-63796f7d47d1-webhook-cert\") pod \"maas-controller-7469c76db5-fwzdf\" (UID: \"6d70b07b-3707-4393-85c7-63796f7d47d1\") " pod="opendatahub/maas-controller-7469c76db5-fwzdf"
Jul 14 21:45:45.531597 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:45.531486    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cwrt\" (UniqueName: \"kubernetes.io/projected/6d70b07b-3707-4393-85c7-63796f7d47d1-kube-api-access-6cwrt\") pod \"maas-controller-7469c76db5-fwzdf\" (UID: \"6d70b07b-3707-4393-85c7-63796f7d47d1\") " pod="opendatahub/maas-controller-7469c76db5-fwzdf"
Jul 14 21:45:45.632490 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:45.632396    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d70b07b-3707-4393-85c7-63796f7d47d1-webhook-cert\") pod \"maas-controller-7469c76db5-fwzdf\" (UID: \"6d70b07b-3707-4393-85c7-63796f7d47d1\") " pod="opendatahub/maas-controller-7469c76db5-fwzdf"
Jul 14 21:45:45.632490 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:45.632480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cwrt\" (UniqueName: \"kubernetes.io/projected/6d70b07b-3707-4393-85c7-63796f7d47d1-kube-api-access-6cwrt\") pod \"maas-controller-7469c76db5-fwzdf\" (UID: \"6d70b07b-3707-4393-85c7-63796f7d47d1\") " pod="opendatahub/maas-controller-7469c76db5-fwzdf"
Jul 14 21:45:45.634811 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:45.634780    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d70b07b-3707-4393-85c7-63796f7d47d1-webhook-cert\") pod \"maas-controller-7469c76db5-fwzdf\" (UID: \"6d70b07b-3707-4393-85c7-63796f7d47d1\") " pod="opendatahub/maas-controller-7469c76db5-fwzdf"
Jul 14 21:45:45.642601 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:45.642574    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cwrt\" (UniqueName: \"kubernetes.io/projected/6d70b07b-3707-4393-85c7-63796f7d47d1-kube-api-access-6cwrt\") pod \"maas-controller-7469c76db5-fwzdf\" (UID: \"6d70b07b-3707-4393-85c7-63796f7d47d1\") " pod="opendatahub/maas-controller-7469c76db5-fwzdf"
Jul 14 21:45:45.685542 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:45.685501    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7469c76db5-fwzdf"
Jul 14 21:45:45.818487 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:45.818467    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7469c76db5-fwzdf"]
Jul 14 21:45:45.820078 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:45:45.820048    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d70b07b_3707_4393_85c7_63796f7d47d1.slice/crio-1864b5fb35dc8128ffee03000c3f8ab95c8aefda6fae811c00f7d2c8e2f05680 WatchSource:0}: Error finding container 1864b5fb35dc8128ffee03000c3f8ab95c8aefda6fae811c00f7d2c8e2f05680: Status 404 returned error can't find the container with id 1864b5fb35dc8128ffee03000c3f8ab95c8aefda6fae811c00f7d2c8e2f05680
Jul 14 21:45:46.262169 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:46.262134    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7469c76db5-fwzdf" event={"ID":"6d70b07b-3707-4393-85c7-63796f7d47d1","Type":"ContainerStarted","Data":"1864b5fb35dc8128ffee03000c3f8ab95c8aefda6fae811c00f7d2c8e2f05680"}
Jul 14 21:45:49.282495 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:49.282459    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7469c76db5-fwzdf" event={"ID":"6d70b07b-3707-4393-85c7-63796f7d47d1","Type":"ContainerStarted","Data":"f9e315ec03d49d4d1e4cee36861974ffba09a13a7718ebd582dfb21e57152333"}
Jul 14 21:45:49.282868 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:49.282531    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7469c76db5-fwzdf"
Jul 14 21:45:49.310226 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:45:49.310185    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7469c76db5-fwzdf" podStartSLOduration=1.8302085959999999 podStartE2EDuration="4.310168162s" totalImagesPullingTime="2.479959566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:45:49.308871049 +0000 UTC m=+487.793963700" watchObservedRunningTime="2026-07-14 21:45:49.310168162 +0000 UTC m=+487.795260812"
Jul 14 21:46:00.293067 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:00.293037    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7469c76db5-fwzdf"
Jul 14 21:46:20.461782 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.461752    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-64ddf4d64b-xmzrx"]
Jul 14 21:46:20.465337 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.465319    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-64ddf4d64b-xmzrx"
Jul 14 21:46:20.468238 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.468217    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 14 21:46:20.468351 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.468278    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-s6ht2\""
Jul 14 21:46:20.478241 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.478222    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-64ddf4d64b-xmzrx"]
Jul 14 21:46:20.530176 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.530140    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738bc2f4-8810-4172-9281-2627a8738d24-maas-api-tls\") pod \"maas-api-64ddf4d64b-xmzrx\" (UID: \"738bc2f4-8810-4172-9281-2627a8738d24\") " pod="opendatahub/maas-api-64ddf4d64b-xmzrx"
Jul 14 21:46:20.530332 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.530259    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqxrb\" (UniqueName: \"kubernetes.io/projected/738bc2f4-8810-4172-9281-2627a8738d24-kube-api-access-hqxrb\") pod \"maas-api-64ddf4d64b-xmzrx\" (UID: \"738bc2f4-8810-4172-9281-2627a8738d24\") " pod="opendatahub/maas-api-64ddf4d64b-xmzrx"
Jul 14 21:46:20.530332 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.530301    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738bc2f4-8810-4172-9281-2627a8738d24-openshift-service-ca\") pod \"maas-api-64ddf4d64b-xmzrx\" (UID: \"738bc2f4-8810-4172-9281-2627a8738d24\") " pod="opendatahub/maas-api-64ddf4d64b-xmzrx"
Jul 14 21:46:20.630835 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.630804    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738bc2f4-8810-4172-9281-2627a8738d24-maas-api-tls\") pod \"maas-api-64ddf4d64b-xmzrx\" (UID: \"738bc2f4-8810-4172-9281-2627a8738d24\") " pod="opendatahub/maas-api-64ddf4d64b-xmzrx"
Jul 14 21:46:20.631005 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.630877    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxrb\" (UniqueName: \"kubernetes.io/projected/738bc2f4-8810-4172-9281-2627a8738d24-kube-api-access-hqxrb\") pod \"maas-api-64ddf4d64b-xmzrx\" (UID: \"738bc2f4-8810-4172-9281-2627a8738d24\") " pod="opendatahub/maas-api-64ddf4d64b-xmzrx"
Jul 14 21:46:20.631005 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.630905    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738bc2f4-8810-4172-9281-2627a8738d24-openshift-service-ca\") pod \"maas-api-64ddf4d64b-xmzrx\" (UID: \"738bc2f4-8810-4172-9281-2627a8738d24\") " pod="opendatahub/maas-api-64ddf4d64b-xmzrx"
Jul 14 21:46:20.631540 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.631522    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738bc2f4-8810-4172-9281-2627a8738d24-openshift-service-ca\") pod \"maas-api-64ddf4d64b-xmzrx\" (UID: \"738bc2f4-8810-4172-9281-2627a8738d24\") " pod="opendatahub/maas-api-64ddf4d64b-xmzrx"
Jul 14 21:46:20.633285 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.633265    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738bc2f4-8810-4172-9281-2627a8738d24-maas-api-tls\") pod \"maas-api-64ddf4d64b-xmzrx\" (UID: \"738bc2f4-8810-4172-9281-2627a8738d24\") " pod="opendatahub/maas-api-64ddf4d64b-xmzrx"
Jul 14 21:46:20.640897 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.640877    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqxrb\" (UniqueName: \"kubernetes.io/projected/738bc2f4-8810-4172-9281-2627a8738d24-kube-api-access-hqxrb\") pod \"maas-api-64ddf4d64b-xmzrx\" (UID: \"738bc2f4-8810-4172-9281-2627a8738d24\") " pod="opendatahub/maas-api-64ddf4d64b-xmzrx"
Jul 14 21:46:20.775116 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.775082    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-64ddf4d64b-xmzrx"
Jul 14 21:46:20.915197 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:20.915175    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-64ddf4d64b-xmzrx"]
Jul 14 21:46:20.917550 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:46:20.917522    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738bc2f4_8810_4172_9281_2627a8738d24.slice/crio-41488709dde175e8309c94e5530487ffe690cf56eb2da1f1d99c540cadf11701 WatchSource:0}: Error finding container 41488709dde175e8309c94e5530487ffe690cf56eb2da1f1d99c540cadf11701: Status 404 returned error can't find the container with id 41488709dde175e8309c94e5530487ffe690cf56eb2da1f1d99c540cadf11701
Jul 14 21:46:21.184555 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:21.184461    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-z7vtb"]
Jul 14 21:46:21.188699 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:21.188647    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-z7vtb"
Jul 14 21:46:21.193863 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:21.193388    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vbhsp\""
Jul 14 21:46:21.193863 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:21.193421    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 14 21:46:21.199373 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:21.199350    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-z7vtb"]
Jul 14 21:46:21.338057 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:21.338020    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cwf7\" (UniqueName: \"kubernetes.io/projected/dbab53ae-c2e1-483d-9b76-4b0232031f77-kube-api-access-9cwf7\") pod \"payload-pre-processing-7964457696-z7vtb\" (UID: \"dbab53ae-c2e1-483d-9b76-4b0232031f77\") " pod="openshift-ingress/payload-pre-processing-7964457696-z7vtb"
Jul 14 21:46:21.338241 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:21.338076    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbab53ae-c2e1-483d-9b76-4b0232031f77-plugins-config-volume\") pod \"payload-pre-processing-7964457696-z7vtb\" (UID: \"dbab53ae-c2e1-483d-9b76-4b0232031f77\") " pod="openshift-ingress/payload-pre-processing-7964457696-z7vtb"
Jul 14 21:46:21.438659 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:21.438573    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cwf7\" (UniqueName: \"kubernetes.io/projected/dbab53ae-c2e1-483d-9b76-4b0232031f77-kube-api-access-9cwf7\") pod \"payload-pre-processing-7964457696-z7vtb\" (UID: \"dbab53ae-c2e1-483d-9b76-4b0232031f77\") " pod="openshift-ingress/payload-pre-processing-7964457696-z7vtb"
Jul 14 21:46:21.438659 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:21.438635    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbab53ae-c2e1-483d-9b76-4b0232031f77-plugins-config-volume\") pod \"payload-pre-processing-7964457696-z7vtb\" (UID: \"dbab53ae-c2e1-483d-9b76-4b0232031f77\") " pod="openshift-ingress/payload-pre-processing-7964457696-z7vtb"
Jul 14 21:46:21.439347 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:21.439307    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-64ddf4d64b-xmzrx" event={"ID":"738bc2f4-8810-4172-9281-2627a8738d24","Type":"ContainerStarted","Data":"41488709dde175e8309c94e5530487ffe690cf56eb2da1f1d99c540cadf11701"}
Jul 14 21:46:21.439453 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:21.439322    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dbab53ae-c2e1-483d-9b76-4b0232031f77-plugins-config-volume\") pod \"payload-pre-processing-7964457696-z7vtb\" (UID: \"dbab53ae-c2e1-483d-9b76-4b0232031f77\") " pod="openshift-ingress/payload-pre-processing-7964457696-z7vtb"
Jul 14 21:46:21.450838 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:21.450815    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cwf7\" (UniqueName: \"kubernetes.io/projected/dbab53ae-c2e1-483d-9b76-4b0232031f77-kube-api-access-9cwf7\") pod \"payload-pre-processing-7964457696-z7vtb\" (UID: \"dbab53ae-c2e1-483d-9b76-4b0232031f77\") " pod="openshift-ingress/payload-pre-processing-7964457696-z7vtb"
Jul 14 21:46:21.503782 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:21.503759    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-z7vtb"
Jul 14 21:46:21.643704 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:21.643679    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-z7vtb"]
Jul 14 21:46:21.645910 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:46:21.645881    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbab53ae_c2e1_483d_9b76_4b0232031f77.slice/crio-cdc22391ee815918c9b16f9ea1e0ccc67fd33493a53368182904fec99fda153b WatchSource:0}: Error finding container cdc22391ee815918c9b16f9ea1e0ccc67fd33493a53368182904fec99fda153b: Status 404 returned error can't find the container with id cdc22391ee815918c9b16f9ea1e0ccc67fd33493a53368182904fec99fda153b
Jul 14 21:46:22.452220 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:22.452142    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-z7vtb" event={"ID":"dbab53ae-c2e1-483d-9b76-4b0232031f77","Type":"ContainerStarted","Data":"cdc22391ee815918c9b16f9ea1e0ccc67fd33493a53368182904fec99fda153b"}
Jul 14 21:46:23.458648 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:23.458609    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-z7vtb" event={"ID":"dbab53ae-c2e1-483d-9b76-4b0232031f77","Type":"ContainerStarted","Data":"d2518f25e412b1aaa923e9c392ce10c46c69fc55af52475806fc5ebefc932edf"}
Jul 14 21:46:23.459027 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:23.458687    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-z7vtb"
Jul 14 21:46:23.460076 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:23.460054    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-64ddf4d64b-xmzrx" event={"ID":"738bc2f4-8810-4172-9281-2627a8738d24","Type":"ContainerStarted","Data":"0783d7be1c994e633fa9bd8b3333c973b2ce040867c5d8089aa5ab0a7742a63a"}
Jul 14 21:46:23.460196 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:23.460156    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-64ddf4d64b-xmzrx"
Jul 14 21:46:23.481836 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:23.481794    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-z7vtb" podStartSLOduration=0.864200385 podStartE2EDuration="2.481779682s" totalImagesPullingTime="1.617579297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:46:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:46:23.47957944 +0000 UTC m=+521.964672092" watchObservedRunningTime="2026-07-14 21:46:23.481779682 +0000 UTC m=+521.966872334"
Jul 14 21:46:23.499437 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:23.499387    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-64ddf4d64b-xmzrx" podStartSLOduration=1.154434482 podStartE2EDuration="3.499370959s" totalImagesPullingTime="2.344936477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:46:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:46:23.499053867 +0000 UTC m=+521.984146518" watchObservedRunningTime="2026-07-14 21:46:23.499370959 +0000 UTC m=+521.984463631"
Jul 14 21:46:29.470067 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:29.470039    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-64ddf4d64b-xmzrx"
Jul 14 21:46:29.495080 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:29.495052    2572 generic.go:356] "Generic (PLEG): container finished" podID="4fd51fe4-61c0-418c-bd03-0889b3ae7c71" containerID="f88a36ebe530b1d784763393779a873a51f0c855e5ff4dcabbf596856d38dc4e" exitCode=0
Jul 14 21:46:29.495238 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:29.495123    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss" event={"ID":"4fd51fe4-61c0-418c-bd03-0889b3ae7c71","Type":"ContainerDied","Data":"f88a36ebe530b1d784763393779a873a51f0c855e5ff4dcabbf596856d38dc4e"}
Jul 14 21:46:29.495502 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:29.495488    2572 scope.go:117] "RemoveContainer" containerID="f88a36ebe530b1d784763393779a873a51f0c855e5ff4dcabbf596856d38dc4e"
Jul 14 21:46:29.496432 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:29.496399    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 21:46:29.496484 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:29.496470    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 21:46:29.496517 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:29.496504    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 21:46:30.501778 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:30.501740    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss" event={"ID":"4fd51fe4-61c0-418c-bd03-0889b3ae7c71","Type":"ContainerStarted","Data":"71c2d078f65f66d393ca66a3ce1f3d7d2dae066f5262029a2df0fde800dfb311"}
Jul 14 21:46:31.297787 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:31.297745    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:46:31.298725 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:31.298691    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-h7lss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 14 21:46:31.298835 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:31.298743    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss" podUID="4fd51fe4-61c0-418c-bd03-0889b3ae7c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 14 21:46:32.298197 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:32.298162    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-h7lss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 14 21:46:32.298562 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:32.298220    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss" podUID="4fd51fe4-61c0-418c-bd03-0889b3ae7c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 14 21:46:33.298229 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:33.298139    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-h7lss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 14 21:46:33.298229 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:33.298214    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss" podUID="4fd51fe4-61c0-418c-bd03-0889b3ae7c71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 14 21:46:34.300846 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:34.300816    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:46:34.301234 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:34.301079    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:46:34.301841 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:34.301827    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-h7lss"
Jul 14 21:46:34.467036 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:34.467005    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-z7vtb"
Jul 14 21:46:36.929461 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:36.929428    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"]
Jul 14 21:46:36.931939 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:36.931924    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:36.941776 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:36.941754    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 14 21:46:36.941776 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:36.941770    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gch6t\""
Jul 14 21:46:36.942437 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:36.942422    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 14 21:46:36.942488 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:36.942443    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 14 21:46:36.963479 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:36.963456    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"]
Jul 14 21:46:36.995582 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:36.995550    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0593c40-e055-424a-ab8e-ab79ecf87784-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:36.995738 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:36.995597    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0593c40-e055-424a-ab8e-ab79ecf87784-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:36.995738 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:36.995627    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0593c40-e055-424a-ab8e-ab79ecf87784-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:36.995738 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:36.995656    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc9xf\" (UniqueName: \"kubernetes.io/projected/b0593c40-e055-424a-ab8e-ab79ecf87784-kube-api-access-rc9xf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:36.995738 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:36.995718    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0593c40-e055-424a-ab8e-ab79ecf87784-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:36.995966 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:36.995750    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0593c40-e055-424a-ab8e-ab79ecf87784-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:37.096248 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.096213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0593c40-e055-424a-ab8e-ab79ecf87784-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:37.096248 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.096253    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0593c40-e055-424a-ab8e-ab79ecf87784-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:37.096489 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.096273    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0593c40-e055-424a-ab8e-ab79ecf87784-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:37.096489 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.096299    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc9xf\" (UniqueName: \"kubernetes.io/projected/b0593c40-e055-424a-ab8e-ab79ecf87784-kube-api-access-rc9xf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:37.096489 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.096373    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0593c40-e055-424a-ab8e-ab79ecf87784-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:37.096489 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.096407    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0593c40-e055-424a-ab8e-ab79ecf87784-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:37.096700 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.096676    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0593c40-e055-424a-ab8e-ab79ecf87784-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:37.096788 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.096768    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0593c40-e055-424a-ab8e-ab79ecf87784-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:37.096848 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.096836    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0593c40-e055-424a-ab8e-ab79ecf87784-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:37.098561 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.098541    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0593c40-e055-424a-ab8e-ab79ecf87784-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:37.098857 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.098838    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0593c40-e055-424a-ab8e-ab79ecf87784-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:37.110053 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.110025    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc9xf\" (UniqueName: \"kubernetes.io/projected/b0593c40-e055-424a-ab8e-ab79ecf87784-kube-api-access-rc9xf\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr\" (UID: \"b0593c40-e055-424a-ab8e-ab79ecf87784\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:37.242129 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.242012    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:37.378473 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.378453    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"]
Jul 14 21:46:37.380233 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:46:37.380209    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0593c40_e055_424a_ab8e_ab79ecf87784.slice/crio-29237435bd2c541c3bb3c4eaebd9f3c932583118a606c4dd4dc9ad90599230d2 WatchSource:0}: Error finding container 29237435bd2c541c3bb3c4eaebd9f3c932583118a606c4dd4dc9ad90599230d2: Status 404 returned error can't find the container with id 29237435bd2c541c3bb3c4eaebd9f3c932583118a606c4dd4dc9ad90599230d2
Jul 14 21:46:37.547279 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:37.547246    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr" event={"ID":"b0593c40-e055-424a-ab8e-ab79ecf87784","Type":"ContainerStarted","Data":"29237435bd2c541c3bb3c4eaebd9f3c932583118a606c4dd4dc9ad90599230d2"}
Jul 14 21:46:39.560557 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:39.560519    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr" event={"ID":"b0593c40-e055-424a-ab8e-ab79ecf87784","Type":"ContainerStarted","Data":"9f356b41c95750747cb1ca8de0143f6a1d943679d2d909853fdcec2c6d28681d"}
Jul 14 21:46:39.587805 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:39.587725    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr" podStartSLOduration=2.468637482 podStartE2EDuration="3.587670574s" totalImagesPullingTime="1.119033092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:46:39.586905186 +0000 UTC m=+538.071997837" watchObservedRunningTime="2026-07-14 21:46:39.587670574 +0000 UTC m=+538.072763227"
Jul 14 21:46:47.243135 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:47.243077    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:47.243584 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:47.243170    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:47.256067 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:47.256038    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:46:47.611935 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:46:47.611904    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr"
Jul 14 21:47:02.792858 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:02.792823    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"]
Jul 14 21:47:02.797089 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:02.797066    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:02.801285 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:02.801263    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 14 21:47:02.812046 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:02.812022    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"]
Jul 14 21:47:02.951647 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:02.951617    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:02.951780 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:02.951657    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:02.951780 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:02.951698    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:02.951780 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:02.951735    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jnt6\" (UniqueName: \"kubernetes.io/projected/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-kube-api-access-4jnt6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:02.951887 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:02.951798    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:02.951887 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:02.951835    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:03.052938 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.052876    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:03.052938 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.052914    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:03.053094 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.053075    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:03.053263 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.053243    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:03.053329 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.053304    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:03.053404 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.053343    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jnt6\" (UniqueName: \"kubernetes.io/projected/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-kube-api-access-4jnt6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:03.053463 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.053400    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:03.053575 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.053556    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:03.053638 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.053607    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:03.055511 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.055490    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:03.055772 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.055755    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:03.064201 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.064180    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jnt6\" (UniqueName: \"kubernetes.io/projected/f974b4d2-14ae-4b32-88f5-2cc5a40213ea-kube-api-access-4jnt6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd\" (UID: \"f974b4d2-14ae-4b32-88f5-2cc5a40213ea\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:03.107608 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.107584    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:03.251313 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.251288    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"]
Jul 14 21:47:03.252243 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:47:03.252218    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf974b4d2_14ae_4b32_88f5_2cc5a40213ea.slice/crio-452ab99c656f99813634283b1120e6c3d8fefd7cdb117f41132b805eba8efae1 WatchSource:0}: Error finding container 452ab99c656f99813634283b1120e6c3d8fefd7cdb117f41132b805eba8efae1: Status 404 returned error can't find the container with id 452ab99c656f99813634283b1120e6c3d8fefd7cdb117f41132b805eba8efae1
Jul 14 21:47:03.678399 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.678365    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd" event={"ID":"f974b4d2-14ae-4b32-88f5-2cc5a40213ea","Type":"ContainerStarted","Data":"0ab7d8695ee433741c34b0e2160e323a3f5f9b9d8c176023b714f9eb035144b2"}
Jul 14 21:47:03.678559 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.678417    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd" event={"ID":"f974b4d2-14ae-4b32-88f5-2cc5a40213ea","Type":"ContainerStarted","Data":"452ab99c656f99813634283b1120e6c3d8fefd7cdb117f41132b805eba8efae1"}
Jul 14 21:47:03.701754 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:03.701651    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd" podStartSLOduration=1.5143796520000001 podStartE2EDuration="1.70162821s" totalImagesPullingTime="187.248558ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:47:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:47:03.696461364 +0000 UTC m=+562.181554022" watchObservedRunningTime="2026-07-14 21:47:03.70162821 +0000 UTC m=+562.186720864"
Jul 14 21:47:13.108240 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:13.108209    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:13.108753 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:13.108292    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:13.120986 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:13.120964    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:13.741673 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:13.741648    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd"
Jul 14 21:47:41.889150 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:41.889118    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 21:47:41.889592 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:47:41.889530    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 21:49:28.276805 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:28.276771    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7469c76db5-fwzdf"]
Jul 14 21:49:28.277393 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:28.276962    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7469c76db5-fwzdf" podUID="6d70b07b-3707-4393-85c7-63796f7d47d1" containerName="manager" containerID="cri-o://f9e315ec03d49d4d1e4cee36861974ffba09a13a7718ebd582dfb21e57152333" gracePeriod=30
Jul 14 21:49:28.426691 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:28.426660    2572 generic.go:356] "Generic (PLEG): container finished" podID="6d70b07b-3707-4393-85c7-63796f7d47d1" containerID="f9e315ec03d49d4d1e4cee36861974ffba09a13a7718ebd582dfb21e57152333" exitCode=0
Jul 14 21:49:28.426848 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:28.426740    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7469c76db5-fwzdf" event={"ID":"6d70b07b-3707-4393-85c7-63796f7d47d1","Type":"ContainerDied","Data":"f9e315ec03d49d4d1e4cee36861974ffba09a13a7718ebd582dfb21e57152333"}
Jul 14 21:49:28.537241 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:28.537172    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7469c76db5-fwzdf"
Jul 14 21:49:28.655244 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:28.655198    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cwrt\" (UniqueName: \"kubernetes.io/projected/6d70b07b-3707-4393-85c7-63796f7d47d1-kube-api-access-6cwrt\") pod \"6d70b07b-3707-4393-85c7-63796f7d47d1\" (UID: \"6d70b07b-3707-4393-85c7-63796f7d47d1\") "
Jul 14 21:49:28.655424 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:28.655258    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d70b07b-3707-4393-85c7-63796f7d47d1-webhook-cert\") pod \"6d70b07b-3707-4393-85c7-63796f7d47d1\" (UID: \"6d70b07b-3707-4393-85c7-63796f7d47d1\") "
Jul 14 21:49:28.657533 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:28.657496    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d70b07b-3707-4393-85c7-63796f7d47d1-kube-api-access-6cwrt" (OuterVolumeSpecName: "kube-api-access-6cwrt") pod "6d70b07b-3707-4393-85c7-63796f7d47d1" (UID: "6d70b07b-3707-4393-85c7-63796f7d47d1"). InnerVolumeSpecName "kube-api-access-6cwrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 21:49:28.657658 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:28.657591    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d70b07b-3707-4393-85c7-63796f7d47d1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6d70b07b-3707-4393-85c7-63796f7d47d1" (UID: "6d70b07b-3707-4393-85c7-63796f7d47d1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:49:28.756473 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:28.756433    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cwrt\" (UniqueName: \"kubernetes.io/projected/6d70b07b-3707-4393-85c7-63796f7d47d1-kube-api-access-6cwrt\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:49:28.756473 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:28.756470    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d70b07b-3707-4393-85c7-63796f7d47d1-webhook-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 21:49:29.432881 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:29.432850    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7469c76db5-fwzdf" event={"ID":"6d70b07b-3707-4393-85c7-63796f7d47d1","Type":"ContainerDied","Data":"1864b5fb35dc8128ffee03000c3f8ab95c8aefda6fae811c00f7d2c8e2f05680"}
Jul 14 21:49:29.433363 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:29.432881    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7469c76db5-fwzdf"
Jul 14 21:49:29.433363 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:29.432912    2572 scope.go:117] "RemoveContainer" containerID="f9e315ec03d49d4d1e4cee36861974ffba09a13a7718ebd582dfb21e57152333"
Jul 14 21:49:29.456183 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:29.456118    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7469c76db5-fwzdf"]
Jul 14 21:49:29.458468 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:29.458444    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7469c76db5-fwzdf"]
Jul 14 21:49:29.979825 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:29.979796    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d70b07b-3707-4393-85c7-63796f7d47d1" path="/var/lib/kubelet/pods/6d70b07b-3707-4393-85c7-63796f7d47d1/volumes"
Jul 14 21:49:30.363463 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.363428    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7469c76db5-65kcr"]
Jul 14 21:49:30.363883 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.363867    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d70b07b-3707-4393-85c7-63796f7d47d1" containerName="manager"
Jul 14 21:49:30.363883 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.363883    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d70b07b-3707-4393-85c7-63796f7d47d1" containerName="manager"
Jul 14 21:49:30.363994 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.363946    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d70b07b-3707-4393-85c7-63796f7d47d1" containerName="manager"
Jul 14 21:49:30.368556 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.368539    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7469c76db5-65kcr"
Jul 14 21:49:30.378812 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.378792    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9dr4p\""
Jul 14 21:49:30.378939 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.378859    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 21:49:30.379150 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.379133    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 21:49:30.452409 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.452378    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7469c76db5-65kcr"]
Jul 14 21:49:30.473427 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.473397    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d23bb74-b975-4669-8ce2-f83a79a66622-webhook-cert\") pod \"maas-controller-7469c76db5-65kcr\" (UID: \"6d23bb74-b975-4669-8ce2-f83a79a66622\") " pod="opendatahub/maas-controller-7469c76db5-65kcr"
Jul 14 21:49:30.473576 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.473515    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5rpb\" (UniqueName: \"kubernetes.io/projected/6d23bb74-b975-4669-8ce2-f83a79a66622-kube-api-access-r5rpb\") pod \"maas-controller-7469c76db5-65kcr\" (UID: \"6d23bb74-b975-4669-8ce2-f83a79a66622\") " pod="opendatahub/maas-controller-7469c76db5-65kcr"
Jul 14 21:49:30.575078 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.575038    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5rpb\" (UniqueName: \"kubernetes.io/projected/6d23bb74-b975-4669-8ce2-f83a79a66622-kube-api-access-r5rpb\") pod \"maas-controller-7469c76db5-65kcr\" (UID: \"6d23bb74-b975-4669-8ce2-f83a79a66622\") " pod="opendatahub/maas-controller-7469c76db5-65kcr"
Jul 14 21:49:30.575292 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.575134    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d23bb74-b975-4669-8ce2-f83a79a66622-webhook-cert\") pod \"maas-controller-7469c76db5-65kcr\" (UID: \"6d23bb74-b975-4669-8ce2-f83a79a66622\") " pod="opendatahub/maas-controller-7469c76db5-65kcr"
Jul 14 21:49:30.577536 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.577512    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d23bb74-b975-4669-8ce2-f83a79a66622-webhook-cert\") pod \"maas-controller-7469c76db5-65kcr\" (UID: \"6d23bb74-b975-4669-8ce2-f83a79a66622\") " pod="opendatahub/maas-controller-7469c76db5-65kcr"
Jul 14 21:49:30.586407 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.586380    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5rpb\" (UniqueName: \"kubernetes.io/projected/6d23bb74-b975-4669-8ce2-f83a79a66622-kube-api-access-r5rpb\") pod \"maas-controller-7469c76db5-65kcr\" (UID: \"6d23bb74-b975-4669-8ce2-f83a79a66622\") " pod="opendatahub/maas-controller-7469c76db5-65kcr"
Jul 14 21:49:30.678473 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.678380    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7469c76db5-65kcr"
Jul 14 21:49:30.817706 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.817666    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7469c76db5-65kcr"]
Jul 14 21:49:30.819851 ip-10-0-128-31 kubenswrapper[2572]: W0714 21:49:30.819814    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d23bb74_b975_4669_8ce2_f83a79a66622.slice/crio-68762d637966e98320a3cab8d790759b704c0544a0516c1e827c0a470bb9f2df WatchSource:0}: Error finding container 68762d637966e98320a3cab8d790759b704c0544a0516c1e827c0a470bb9f2df: Status 404 returned error can't find the container with id 68762d637966e98320a3cab8d790759b704c0544a0516c1e827c0a470bb9f2df
Jul 14 21:49:30.821296 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:30.821277    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 21:49:31.446816 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:31.446781    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7469c76db5-65kcr" event={"ID":"6d23bb74-b975-4669-8ce2-f83a79a66622","Type":"ContainerStarted","Data":"e6ffae6c0d1e65917552671fa1003c1377331131258d6959dee27bf8b799057f"}
Jul 14 21:49:31.446993 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:31.446839    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7469c76db5-65kcr" event={"ID":"6d23bb74-b975-4669-8ce2-f83a79a66622","Type":"ContainerStarted","Data":"68762d637966e98320a3cab8d790759b704c0544a0516c1e827c0a470bb9f2df"}
Jul 14 21:49:31.446993 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:31.446868    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7469c76db5-65kcr"
Jul 14 21:49:31.467429 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:31.467334    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7469c76db5-65kcr" podStartSLOduration=1.075352925 podStartE2EDuration="1.467317915s" totalImagesPullingTime="391.96499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:49:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:49:31.4653488 +0000 UTC m=+709.950441491" watchObservedRunningTime="2026-07-14 21:49:31.467317915 +0000 UTC m=+709.952410566"
Jul 14 21:49:42.457630 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:49:42.457599    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7469c76db5-65kcr"
Jul 14 21:52:41.922591 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:52:41.922513    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 21:52:41.924448 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:52:41.924419    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 21:57:41.955095 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:57:41.955066    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 21:57:41.957792 ip-10-0-128-31 kubenswrapper[2572]: I0714 21:57:41.957769    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 22:01:38.981093 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:38.981060    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"]
Jul 14 22:01:38.985574 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:38.985555    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:38.988976 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:38.988958    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f2e0149b-openshift-default-dockercfg-5n66n\""
Jul 14 22:01:39.007509 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.007480    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"]
Jul 14 22:01:39.045547 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.045523    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-envoy\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.045665 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.045561    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-workload-socket\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.045665 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.045580    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-data\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.045665 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.045636    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-workload-certs\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.045811 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.045692    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9bgv\" (UniqueName: \"kubernetes.io/projected/b8982e7d-cf72-42af-9d1d-ba8483398219-kube-api-access-c9bgv\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.045811 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.045730    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8982e7d-cf72-42af-9d1d-ba8483398219-istiod-ca-cert\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.045811 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.045800    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-podinfo\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.045956 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.045832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-credential-socket\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.045956 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.045904    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-token\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.146689 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.146664    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-credential-socket\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.146826 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.146710    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-token\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.146826 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.146744    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-envoy\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.146826 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.146768    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-workload-socket\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.146826 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.146787    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-data\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.146826 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.146820    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-workload-certs\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.147124 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.146858    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9bgv\" (UniqueName: \"kubernetes.io/projected/b8982e7d-cf72-42af-9d1d-ba8483398219-kube-api-access-c9bgv\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.147124 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.146891    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8982e7d-cf72-42af-9d1d-ba8483398219-istiod-ca-cert\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.147124 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.146915    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-podinfo\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.147272 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.147144    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-credential-socket\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.147323 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.147306    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-data\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.147515 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.147492    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-workload-certs\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.147678 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.147555    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-workload-socket\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.147840 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.147813    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8982e7d-cf72-42af-9d1d-ba8483398219-istiod-ca-cert\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.149317 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.149291    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-envoy\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.149408 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.149372    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-podinfo\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.155621 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.155591    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9bgv\" (UniqueName: \"kubernetes.io/projected/b8982e7d-cf72-42af-9d1d-ba8483398219-kube-api-access-c9bgv\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.156063 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.156047    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-token\") pod \"e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") " pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.296166 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.296136    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:39.438449 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.438426    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"]
Jul 14 22:01:39.439890 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:01:39.439867    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8982e7d_cf72_42af_9d1d_ba8483398219.slice/crio-aa8600eba7fe85e402aa18ff4ad4c1418cc8842630ac741705dfba14700c80bc WatchSource:0}: Error finding container aa8600eba7fe85e402aa18ff4ad4c1418cc8842630ac741705dfba14700c80bc: Status 404 returned error can't find the container with id aa8600eba7fe85e402aa18ff4ad4c1418cc8842630ac741705dfba14700c80bc
Jul 14 22:01:39.441938 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.441908    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:01:39.441997 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.441982    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:01:39.442035 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:39.442025    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:01:40.160606 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.160575    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp" event={"ID":"b8982e7d-cf72-42af-9d1d-ba8483398219","Type":"ContainerStarted","Data":"0959d754fbc55459b4913245ee2c7514df8ccd91b7fcde9416f5f9676e1f1a8a"}
Jul 14 22:01:40.160971 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.160632    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp" event={"ID":"b8982e7d-cf72-42af-9d1d-ba8483398219","Type":"ContainerStarted","Data":"aa8600eba7fe85e402aa18ff4ad4c1418cc8842630ac741705dfba14700c80bc"}
Jul 14 22:01:40.194098 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.194039    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp" podStartSLOduration=2.194017158 podStartE2EDuration="2.194017158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:01:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:01:40.185223354 +0000 UTC m=+1438.670316011" watchObservedRunningTime="2026-07-14 22:01:40.194017158 +0000 UTC m=+1438.679109815"
Jul 14 22:01:40.280030 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.280001    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"]
Jul 14 22:01:40.284709 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.284688    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:40.287785 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.287767    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-f2e0149b-serving-cert\""
Jul 14 22:01:40.296891 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.296868    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"]
Jul 14 22:01:40.296975 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.296920    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:40.302229 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.302209    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:40.359752 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.359723    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czj9l\" (UniqueName: \"kubernetes.io/projected/c5559b37-311c-45b7-b370-fffd97482a9c-kube-api-access-czj9l\") pod \"maas-api-e2e-ait-f2e0149b-78fc694854-gksw8\" (UID: \"c5559b37-311c-45b7-b370-fffd97482a9c\") " pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:40.359874 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.359760    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5559b37-311c-45b7-b370-fffd97482a9c-openshift-service-ca\") pod \"maas-api-e2e-ait-f2e0149b-78fc694854-gksw8\" (UID: \"c5559b37-311c-45b7-b370-fffd97482a9c\") " pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:40.359939 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.359883    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5559b37-311c-45b7-b370-fffd97482a9c-maas-api-tls\") pod \"maas-api-e2e-ait-f2e0149b-78fc694854-gksw8\" (UID: \"c5559b37-311c-45b7-b370-fffd97482a9c\") " pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:40.460868 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.460785    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czj9l\" (UniqueName: \"kubernetes.io/projected/c5559b37-311c-45b7-b370-fffd97482a9c-kube-api-access-czj9l\") pod \"maas-api-e2e-ait-f2e0149b-78fc694854-gksw8\" (UID: \"c5559b37-311c-45b7-b370-fffd97482a9c\") " pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:40.460868 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.460822    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5559b37-311c-45b7-b370-fffd97482a9c-openshift-service-ca\") pod \"maas-api-e2e-ait-f2e0149b-78fc694854-gksw8\" (UID: \"c5559b37-311c-45b7-b370-fffd97482a9c\") " pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:40.461044 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.460893    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5559b37-311c-45b7-b370-fffd97482a9c-maas-api-tls\") pod \"maas-api-e2e-ait-f2e0149b-78fc694854-gksw8\" (UID: \"c5559b37-311c-45b7-b370-fffd97482a9c\") " pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:40.461096 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:01:40.461077    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-f2e0149b-serving-cert: secret "maas-api-e2e-ait-f2e0149b-serving-cert" not found
Jul 14 22:01:40.461205 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:01:40.461168    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5559b37-311c-45b7-b370-fffd97482a9c-maas-api-tls podName:c5559b37-311c-45b7-b370-fffd97482a9c nodeName:}" failed. No retries permitted until 2026-07-14 22:01:40.96115069 +0000 UTC m=+1439.446243320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c5559b37-311c-45b7-b370-fffd97482a9c-maas-api-tls") pod "maas-api-e2e-ait-f2e0149b-78fc694854-gksw8" (UID: "c5559b37-311c-45b7-b370-fffd97482a9c") : secret "maas-api-e2e-ait-f2e0149b-serving-cert" not found
Jul 14 22:01:40.461581 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.461563    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5559b37-311c-45b7-b370-fffd97482a9c-openshift-service-ca\") pod \"maas-api-e2e-ait-f2e0149b-78fc694854-gksw8\" (UID: \"c5559b37-311c-45b7-b370-fffd97482a9c\") " pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:40.477890 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.477866    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czj9l\" (UniqueName: \"kubernetes.io/projected/c5559b37-311c-45b7-b370-fffd97482a9c-kube-api-access-czj9l\") pod \"maas-api-e2e-ait-f2e0149b-78fc694854-gksw8\" (UID: \"c5559b37-311c-45b7-b370-fffd97482a9c\") " pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:40.966352 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.966321    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5559b37-311c-45b7-b370-fffd97482a9c-maas-api-tls\") pod \"maas-api-e2e-ait-f2e0149b-78fc694854-gksw8\" (UID: \"c5559b37-311c-45b7-b370-fffd97482a9c\") " pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:40.968607 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:40.968580    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5559b37-311c-45b7-b370-fffd97482a9c-maas-api-tls\") pod \"maas-api-e2e-ait-f2e0149b-78fc694854-gksw8\" (UID: \"c5559b37-311c-45b7-b370-fffd97482a9c\") " pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:41.166225 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:41.166192    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:41.167097 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:41.167078    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:41.196017 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:41.195990    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:41.348168 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:41.348139    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"]
Jul 14 22:01:41.349861 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:01:41.349829    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5559b37_311c_45b7_b370_fffd97482a9c.slice/crio-919e5b5c113e268894e7603b32834abb2397649cf0c61ab24555749d9e273e0f WatchSource:0}: Error finding container 919e5b5c113e268894e7603b32834abb2397649cf0c61ab24555749d9e273e0f: Status 404 returned error can't find the container with id 919e5b5c113e268894e7603b32834abb2397649cf0c61ab24555749d9e273e0f
Jul 14 22:01:41.353662 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:41.353638    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 22:01:42.172742 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:42.172706    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8" event={"ID":"c5559b37-311c-45b7-b370-fffd97482a9c","Type":"ContainerStarted","Data":"258279468ae21eda92a819cf6e77f0f47b62d43f5af06dcc6d81e33f1b6f43ed"}
Jul 14 22:01:42.173131 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:42.172767    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8" event={"ID":"c5559b37-311c-45b7-b370-fffd97482a9c","Type":"ContainerStarted","Data":"919e5b5c113e268894e7603b32834abb2397649cf0c61ab24555749d9e273e0f"}
Jul 14 22:01:42.173131 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:42.172902    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:42.194222 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:42.194141    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8" podStartSLOduration=1.6101064630000002 podStartE2EDuration="2.194124824s" totalImagesPullingTime="584.018361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:01:42.191890626 +0000 UTC m=+1440.676983304" watchObservedRunningTime="2026-07-14 22:01:42.194124824 +0000 UTC m=+1440.679217472"
Jul 14 22:01:45.526555 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:45.526514    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"]
Jul 14 22:01:45.527164 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:45.526766    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp" podUID="b8982e7d-cf72-42af-9d1d-ba8483398219" containerName="istio-proxy" containerID="cri-o://0959d754fbc55459b4913245ee2c7514df8ccd91b7fcde9416f5f9676e1f1a8a" gracePeriod=30
Jul 14 22:01:45.807201 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:45.807096    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"]
Jul 14 22:01:45.807363 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:45.807324    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8" podUID="c5559b37-311c-45b7-b370-fffd97482a9c" containerName="maas-api" containerID="cri-o://258279468ae21eda92a819cf6e77f0f47b62d43f5af06dcc6d81e33f1b6f43ed" gracePeriod=30
Jul 14 22:01:46.102873 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.102850    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:46.193588 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.193559    2572 generic.go:356] "Generic (PLEG): container finished" podID="c5559b37-311c-45b7-b370-fffd97482a9c" containerID="258279468ae21eda92a819cf6e77f0f47b62d43f5af06dcc6d81e33f1b6f43ed" exitCode=0
Jul 14 22:01:46.193741 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.193597    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"
Jul 14 22:01:46.193741 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.193642    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8" event={"ID":"c5559b37-311c-45b7-b370-fffd97482a9c","Type":"ContainerDied","Data":"258279468ae21eda92a819cf6e77f0f47b62d43f5af06dcc6d81e33f1b6f43ed"}
Jul 14 22:01:46.193741 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.193689    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8" event={"ID":"c5559b37-311c-45b7-b370-fffd97482a9c","Type":"ContainerDied","Data":"919e5b5c113e268894e7603b32834abb2397649cf0c61ab24555749d9e273e0f"}
Jul 14 22:01:46.193741 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.193710    2572 scope.go:117] "RemoveContainer" containerID="258279468ae21eda92a819cf6e77f0f47b62d43f5af06dcc6d81e33f1b6f43ed"
Jul 14 22:01:46.202031 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.202014    2572 scope.go:117] "RemoveContainer" containerID="258279468ae21eda92a819cf6e77f0f47b62d43f5af06dcc6d81e33f1b6f43ed"
Jul 14 22:01:46.202305 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:01:46.202289    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"258279468ae21eda92a819cf6e77f0f47b62d43f5af06dcc6d81e33f1b6f43ed\": container with ID starting with 258279468ae21eda92a819cf6e77f0f47b62d43f5af06dcc6d81e33f1b6f43ed not found: ID does not exist" containerID="258279468ae21eda92a819cf6e77f0f47b62d43f5af06dcc6d81e33f1b6f43ed"
Jul 14 22:01:46.202354 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.202315    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"258279468ae21eda92a819cf6e77f0f47b62d43f5af06dcc6d81e33f1b6f43ed"} err="failed to get container status \"258279468ae21eda92a819cf6e77f0f47b62d43f5af06dcc6d81e33f1b6f43ed\": rpc error: code = NotFound desc = could not find container \"258279468ae21eda92a819cf6e77f0f47b62d43f5af06dcc6d81e33f1b6f43ed\": container with ID starting with 258279468ae21eda92a819cf6e77f0f47b62d43f5af06dcc6d81e33f1b6f43ed not found: ID does not exist"
Jul 14 22:01:46.218540 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.218522    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czj9l\" (UniqueName: \"kubernetes.io/projected/c5559b37-311c-45b7-b370-fffd97482a9c-kube-api-access-czj9l\") pod \"c5559b37-311c-45b7-b370-fffd97482a9c\" (UID: \"c5559b37-311c-45b7-b370-fffd97482a9c\") "
Jul 14 22:01:46.218640 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.218594    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5559b37-311c-45b7-b370-fffd97482a9c-openshift-service-ca\") pod \"c5559b37-311c-45b7-b370-fffd97482a9c\" (UID: \"c5559b37-311c-45b7-b370-fffd97482a9c\") "
Jul 14 22:01:46.218640 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.218630    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5559b37-311c-45b7-b370-fffd97482a9c-maas-api-tls\") pod \"c5559b37-311c-45b7-b370-fffd97482a9c\" (UID: \"c5559b37-311c-45b7-b370-fffd97482a9c\") "
Jul 14 22:01:46.218919 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.218900    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5559b37-311c-45b7-b370-fffd97482a9c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c5559b37-311c-45b7-b370-fffd97482a9c" (UID: "c5559b37-311c-45b7-b370-fffd97482a9c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:01:46.218998 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.218976    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5559b37-311c-45b7-b370-fffd97482a9c-openshift-service-ca\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:01:46.241124 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.235491    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5559b37-311c-45b7-b370-fffd97482a9c-kube-api-access-czj9l" (OuterVolumeSpecName: "kube-api-access-czj9l") pod "c5559b37-311c-45b7-b370-fffd97482a9c" (UID: "c5559b37-311c-45b7-b370-fffd97482a9c"). InnerVolumeSpecName "kube-api-access-czj9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:01:46.246962 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.246245    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5559b37-311c-45b7-b370-fffd97482a9c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c5559b37-311c-45b7-b370-fffd97482a9c" (UID: "c5559b37-311c-45b7-b370-fffd97482a9c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:01:46.319643 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.319623    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5559b37-311c-45b7-b370-fffd97482a9c-maas-api-tls\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:01:46.319743 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.319645    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czj9l\" (UniqueName: \"kubernetes.io/projected/c5559b37-311c-45b7-b370-fffd97482a9c-kube-api-access-czj9l\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:01:46.519497 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.519467    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"]
Jul 14 22:01:46.522796 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:46.522764    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-f2e0149b-78fc694854-gksw8"]
Jul 14 22:01:47.979548 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:47.979511    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5559b37-311c-45b7-b370-fffd97482a9c" path="/var/lib/kubelet/pods/c5559b37-311c-45b7-b370-fffd97482a9c/volumes"
Jul 14 22:01:51.981414 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:51.981358    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:52.077523 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.077495    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-token\") pod \"b8982e7d-cf72-42af-9d1d-ba8483398219\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") "
Jul 14 22:01:52.077649 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.077534    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-podinfo\") pod \"b8982e7d-cf72-42af-9d1d-ba8483398219\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") "
Jul 14 22:01:52.077649 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.077557    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-workload-socket\") pod \"b8982e7d-cf72-42af-9d1d-ba8483398219\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") "
Jul 14 22:01:52.077649 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.077613    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-envoy\") pod \"b8982e7d-cf72-42af-9d1d-ba8483398219\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") "
Jul 14 22:01:52.077649 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.077635    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8982e7d-cf72-42af-9d1d-ba8483398219-istiod-ca-cert\") pod \"b8982e7d-cf72-42af-9d1d-ba8483398219\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") "
Jul 14 22:01:52.077850 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.077668    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-credential-socket\") pod \"b8982e7d-cf72-42af-9d1d-ba8483398219\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") "
Jul 14 22:01:52.077850 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.077697    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-data\") pod \"b8982e7d-cf72-42af-9d1d-ba8483398219\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") "
Jul 14 22:01:52.077850 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.077724    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9bgv\" (UniqueName: \"kubernetes.io/projected/b8982e7d-cf72-42af-9d1d-ba8483398219-kube-api-access-c9bgv\") pod \"b8982e7d-cf72-42af-9d1d-ba8483398219\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") "
Jul 14 22:01:52.077850 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.077770    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-workload-certs\") pod \"b8982e7d-cf72-42af-9d1d-ba8483398219\" (UID: \"b8982e7d-cf72-42af-9d1d-ba8483398219\") "
Jul 14 22:01:52.078050 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.077924    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8982e7d-cf72-42af-9d1d-ba8483398219" (UID: "b8982e7d-cf72-42af-9d1d-ba8483398219"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:01:52.078050 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.077944    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8982e7d-cf72-42af-9d1d-ba8483398219" (UID: "b8982e7d-cf72-42af-9d1d-ba8483398219"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:01:52.078195 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.078060    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8982e7d-cf72-42af-9d1d-ba8483398219-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8982e7d-cf72-42af-9d1d-ba8483398219" (UID: "b8982e7d-cf72-42af-9d1d-ba8483398219"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:01:52.078252 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.078186    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8982e7d-cf72-42af-9d1d-ba8483398219" (UID: "b8982e7d-cf72-42af-9d1d-ba8483398219"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:01:52.078395 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.078365    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8982e7d-cf72-42af-9d1d-ba8483398219-istiod-ca-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:01:52.078395 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.078394    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-credential-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:01:52.078577 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.078408    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-workload-certs\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:01:52.078577 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.078423    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-workload-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:01:52.078748 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.078721    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8982e7d-cf72-42af-9d1d-ba8483398219" (UID: "b8982e7d-cf72-42af-9d1d-ba8483398219"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:01:52.080060 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.080033    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8982e7d-cf72-42af-9d1d-ba8483398219-kube-api-access-c9bgv" (OuterVolumeSpecName: "kube-api-access-c9bgv") pod "b8982e7d-cf72-42af-9d1d-ba8483398219" (UID: "b8982e7d-cf72-42af-9d1d-ba8483398219"). InnerVolumeSpecName "kube-api-access-c9bgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:01:52.080060 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.080050    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8982e7d-cf72-42af-9d1d-ba8483398219" (UID: "b8982e7d-cf72-42af-9d1d-ba8483398219"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 22:01:52.080217 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.080163    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8982e7d-cf72-42af-9d1d-ba8483398219" (UID: "b8982e7d-cf72-42af-9d1d-ba8483398219"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:01:52.080217 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.080179    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8982e7d-cf72-42af-9d1d-ba8483398219" (UID: "b8982e7d-cf72-42af-9d1d-ba8483398219"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:01:52.179399 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.179381    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-token\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:01:52.179489 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.179400    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-podinfo\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:01:52.179489 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.179411    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-envoy\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:01:52.179489 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.179419    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8982e7d-cf72-42af-9d1d-ba8483398219-istio-data\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:01:52.179489 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.179426    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9bgv\" (UniqueName: \"kubernetes.io/projected/b8982e7d-cf72-42af-9d1d-ba8483398219-kube-api-access-c9bgv\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:01:52.229204 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.229178    2572 generic.go:356] "Generic (PLEG): container finished" podID="b8982e7d-cf72-42af-9d1d-ba8483398219" containerID="0959d754fbc55459b4913245ee2c7514df8ccd91b7fcde9416f5f9676e1f1a8a" exitCode=0
Jul 14 22:01:52.229298 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.229222    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"
Jul 14 22:01:52.229298 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.229264    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp" event={"ID":"b8982e7d-cf72-42af-9d1d-ba8483398219","Type":"ContainerDied","Data":"0959d754fbc55459b4913245ee2c7514df8ccd91b7fcde9416f5f9676e1f1a8a"}
Jul 14 22:01:52.229374 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.229328    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp" event={"ID":"b8982e7d-cf72-42af-9d1d-ba8483398219","Type":"ContainerDied","Data":"aa8600eba7fe85e402aa18ff4ad4c1418cc8842630ac741705dfba14700c80bc"}
Jul 14 22:01:52.229374 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.229360    2572 scope.go:117] "RemoveContainer" containerID="0959d754fbc55459b4913245ee2c7514df8ccd91b7fcde9416f5f9676e1f1a8a"
Jul 14 22:01:52.239258 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.239242    2572 scope.go:117] "RemoveContainer" containerID="0959d754fbc55459b4913245ee2c7514df8ccd91b7fcde9416f5f9676e1f1a8a"
Jul 14 22:01:52.239514 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:01:52.239498    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0959d754fbc55459b4913245ee2c7514df8ccd91b7fcde9416f5f9676e1f1a8a\": container with ID starting with 0959d754fbc55459b4913245ee2c7514df8ccd91b7fcde9416f5f9676e1f1a8a not found: ID does not exist" containerID="0959d754fbc55459b4913245ee2c7514df8ccd91b7fcde9416f5f9676e1f1a8a"
Jul 14 22:01:52.239573 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.239520    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0959d754fbc55459b4913245ee2c7514df8ccd91b7fcde9416f5f9676e1f1a8a"} err="failed to get container status \"0959d754fbc55459b4913245ee2c7514df8ccd91b7fcde9416f5f9676e1f1a8a\": rpc error: code = NotFound desc = could not find container \"0959d754fbc55459b4913245ee2c7514df8ccd91b7fcde9416f5f9676e1f1a8a\": container with ID starting with 0959d754fbc55459b4913245ee2c7514df8ccd91b7fcde9416f5f9676e1f1a8a not found: ID does not exist"
Jul 14 22:01:52.256638 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.256618    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"]
Jul 14 22:01:52.269816 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.269741    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f2e0149b-openshift-default-777487bcf7-wd2xp"]
Jul 14 22:01:52.273342 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.273322    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"]
Jul 14 22:01:52.273915 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.273893    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8982e7d-cf72-42af-9d1d-ba8483398219" containerName="istio-proxy"
Jul 14 22:01:52.274009 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.273917    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8982e7d-cf72-42af-9d1d-ba8483398219" containerName="istio-proxy"
Jul 14 22:01:52.274009 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.273946    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5559b37-311c-45b7-b370-fffd97482a9c" containerName="maas-api"
Jul 14 22:01:52.274009 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.273954    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5559b37-311c-45b7-b370-fffd97482a9c" containerName="maas-api"
Jul 14 22:01:52.274191 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.274047    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8982e7d-cf72-42af-9d1d-ba8483398219" containerName="istio-proxy"
Jul 14 22:01:52.274191 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.274057    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5559b37-311c-45b7-b370-fffd97482a9c" containerName="maas-api"
Jul 14 22:01:52.278948 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.278909    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.281610 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.281586    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-962ccb21-openshift-default-dockercfg-2wsn7\""
Jul 14 22:01:52.291937 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.291337    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"]
Jul 14 22:01:52.381436 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.381405    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-envoy\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.381566 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.381438    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-workload-certs\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.381566 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.381466    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-token\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.381688 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.381566    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-workload-socket\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.381688 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.381599    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-credential-socket\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.381688 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.381627    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96b2c219-07ca-4afc-b142-c006c4f10e0e-istiod-ca-cert\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.381848 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.381718    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-data\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.381848 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.381785    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-podinfo\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.381848 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.381815    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxhml\" (UniqueName: \"kubernetes.io/projected/96b2c219-07ca-4afc-b142-c006c4f10e0e-kube-api-access-rxhml\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.482494 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.482454    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-workload-socket\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.482494 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.482497    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-credential-socket\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.482662 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.482522    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96b2c219-07ca-4afc-b142-c006c4f10e0e-istiod-ca-cert\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.482662 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.482560    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-data\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.482662 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.482590    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-podinfo\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.482662 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.482610    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxhml\" (UniqueName: \"kubernetes.io/projected/96b2c219-07ca-4afc-b142-c006c4f10e0e-kube-api-access-rxhml\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.482865 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.482683    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-envoy\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.482865 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.482728    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-workload-certs\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.482865 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.482768    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-token\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.482865 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.482853    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-workload-socket\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.483065 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.482911    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-credential-socket\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.483065 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.483003    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-data\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.483213 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.483167    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-workload-certs\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.483348 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.483327    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96b2c219-07ca-4afc-b142-c006c4f10e0e-istiod-ca-cert\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.484963 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.484946    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-envoy\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.485175 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.485157    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-podinfo\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.491440 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.491387    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-token\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.491734 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.491718    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxhml\" (UniqueName: \"kubernetes.io/projected/96b2c219-07ca-4afc-b142-c006c4f10e0e-kube-api-access-rxhml\") pod \"e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") " pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.592444 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.592414    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:52.728190 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.728156    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"]
Jul 14 22:01:52.729285 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:01:52.729259    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b2c219_07ca_4afc_b142_c006c4f10e0e.slice/crio-1068f02c6672ce06af93d9c173f63c6a56f4f557b8b58e9638087c7357592f49 WatchSource:0}: Error finding container 1068f02c6672ce06af93d9c173f63c6a56f4f557b8b58e9638087c7357592f49: Status 404 returned error can't find the container with id 1068f02c6672ce06af93d9c173f63c6a56f4f557b8b58e9638087c7357592f49
Jul 14 22:01:52.731317 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.731285    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:01:52.731414 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.731344    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:01:52.731414 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:52.731375    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:01:53.236824 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.236792    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn" event={"ID":"96b2c219-07ca-4afc-b142-c006c4f10e0e","Type":"ContainerStarted","Data":"a88a5ac43e17d4b45b29a792f761ab862978e21229836a6a5b97d1a4960ccf05"}
Jul 14 22:01:53.237200 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.236845    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn" event={"ID":"96b2c219-07ca-4afc-b142-c006c4f10e0e","Type":"ContainerStarted","Data":"1068f02c6672ce06af93d9c173f63c6a56f4f557b8b58e9638087c7357592f49"}
Jul 14 22:01:53.260952 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.260904    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn" podStartSLOduration=1.260886065 podStartE2EDuration="1.260886065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:01:53.259327371 +0000 UTC m=+1451.744420036" watchObservedRunningTime="2026-07-14 22:01:53.260886065 +0000 UTC m=+1451.745978720"
Jul 14 22:01:53.583281 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.583246    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"]
Jul 14 22:01:53.587311 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.587288    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:01:53.589745 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.589721    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-962ccb21-serving-cert\""
Jul 14 22:01:53.592746 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.592723    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:53.599452 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.599368    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"]
Jul 14 22:01:53.599905 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.599880    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:53.693831 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.693779    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gphl2\" (UniqueName: \"kubernetes.io/projected/ecb72449-3464-4ddd-a08a-6d541d9a8a52-kube-api-access-gphl2\") pod \"maas-api-e2e-ait-962ccb21-669d8ff49f-m767m\" (UID: \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\") " pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:01:53.693992 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.693902    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb72449-3464-4ddd-a08a-6d541d9a8a52-maas-api-tls\") pod \"maas-api-e2e-ait-962ccb21-669d8ff49f-m767m\" (UID: \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\") " pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:01:53.694188 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.694090    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb72449-3464-4ddd-a08a-6d541d9a8a52-openshift-service-ca\") pod \"maas-api-e2e-ait-962ccb21-669d8ff49f-m767m\" (UID: \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\") " pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:01:53.795115 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.795070    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb72449-3464-4ddd-a08a-6d541d9a8a52-openshift-service-ca\") pod \"maas-api-e2e-ait-962ccb21-669d8ff49f-m767m\" (UID: \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\") " pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:01:53.795237 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.795133    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gphl2\" (UniqueName: \"kubernetes.io/projected/ecb72449-3464-4ddd-a08a-6d541d9a8a52-kube-api-access-gphl2\") pod \"maas-api-e2e-ait-962ccb21-669d8ff49f-m767m\" (UID: \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\") " pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:01:53.795237 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.795185    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb72449-3464-4ddd-a08a-6d541d9a8a52-maas-api-tls\") pod \"maas-api-e2e-ait-962ccb21-669d8ff49f-m767m\" (UID: \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\") " pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:01:53.795318 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:01:53.795278    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-962ccb21-serving-cert: secret "maas-api-e2e-ait-962ccb21-serving-cert" not found
Jul 14 22:01:53.795360 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:01:53.795337    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb72449-3464-4ddd-a08a-6d541d9a8a52-maas-api-tls podName:ecb72449-3464-4ddd-a08a-6d541d9a8a52 nodeName:}" failed. No retries permitted until 2026-07-14 22:01:54.29532249 +0000 UTC m=+1452.780415120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ecb72449-3464-4ddd-a08a-6d541d9a8a52-maas-api-tls") pod "maas-api-e2e-ait-962ccb21-669d8ff49f-m767m" (UID: "ecb72449-3464-4ddd-a08a-6d541d9a8a52") : secret "maas-api-e2e-ait-962ccb21-serving-cert" not found
Jul 14 22:01:53.795672 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.795654    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb72449-3464-4ddd-a08a-6d541d9a8a52-openshift-service-ca\") pod \"maas-api-e2e-ait-962ccb21-669d8ff49f-m767m\" (UID: \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\") " pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:01:53.804702 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.804677    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gphl2\" (UniqueName: \"kubernetes.io/projected/ecb72449-3464-4ddd-a08a-6d541d9a8a52-kube-api-access-gphl2\") pod \"maas-api-e2e-ait-962ccb21-669d8ff49f-m767m\" (UID: \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\") " pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:01:53.979824 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:53.979768    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8982e7d-cf72-42af-9d1d-ba8483398219" path="/var/lib/kubelet/pods/b8982e7d-cf72-42af-9d1d-ba8483398219/volumes"
Jul 14 22:01:54.242132 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:54.242056    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:54.242933 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:54.242914    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:01:54.300529 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:54.300498    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb72449-3464-4ddd-a08a-6d541d9a8a52-maas-api-tls\") pod \"maas-api-e2e-ait-962ccb21-669d8ff49f-m767m\" (UID: \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\") " pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:01:54.303372 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:54.303352    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb72449-3464-4ddd-a08a-6d541d9a8a52-maas-api-tls\") pod \"maas-api-e2e-ait-962ccb21-669d8ff49f-m767m\" (UID: \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\") " pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:01:54.500272 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:54.500198    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:01:54.643324 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:54.643303    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"]
Jul 14 22:01:54.646267 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:01:54.646237    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb72449_3464_4ddd_a08a_6d541d9a8a52.slice/crio-cc070915e77b4616e8ed7548bb6e5e17c472a4a6696694b4bba25d2a49192c0b WatchSource:0}: Error finding container cc070915e77b4616e8ed7548bb6e5e17c472a4a6696694b4bba25d2a49192c0b: Status 404 returned error can't find the container with id cc070915e77b4616e8ed7548bb6e5e17c472a4a6696694b4bba25d2a49192c0b
Jul 14 22:01:55.248072 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:55.248042    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m" event={"ID":"ecb72449-3464-4ddd-a08a-6d541d9a8a52","Type":"ContainerStarted","Data":"d9fbb0a16e09a90cbb92875662e8bde6218ffe87b6787a5b69f3b974f017d94f"}
Jul 14 22:01:55.248383 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:55.248099    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m" event={"ID":"ecb72449-3464-4ddd-a08a-6d541d9a8a52","Type":"ContainerStarted","Data":"cc070915e77b4616e8ed7548bb6e5e17c472a4a6696694b4bba25d2a49192c0b"}
Jul 14 22:01:55.248427 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:55.248397    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:01:55.268391 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:55.268351    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m" podStartSLOduration=1.772958668 podStartE2EDuration="2.268336808s" totalImagesPullingTime="495.37814ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:01:55.266759203 +0000 UTC m=+1453.751851869" watchObservedRunningTime="2026-07-14 22:01:55.268336808 +0000 UTC m=+1453.753429459"
Jul 14 22:01:59.055395 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:59.055371    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"]
Jul 14 22:01:59.055957 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:59.055928    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m" podUID="ecb72449-3464-4ddd-a08a-6d541d9a8a52" containerName="maas-api" containerID="cri-o://d9fbb0a16e09a90cbb92875662e8bde6218ffe87b6787a5b69f3b974f017d94f" gracePeriod=30
Jul 14 22:01:59.271529 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:59.271497    2572 generic.go:356] "Generic (PLEG): container finished" podID="ecb72449-3464-4ddd-a08a-6d541d9a8a52" containerID="d9fbb0a16e09a90cbb92875662e8bde6218ffe87b6787a5b69f3b974f017d94f" exitCode=0
Jul 14 22:01:59.271698 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:59.271610    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m" event={"ID":"ecb72449-3464-4ddd-a08a-6d541d9a8a52","Type":"ContainerDied","Data":"d9fbb0a16e09a90cbb92875662e8bde6218ffe87b6787a5b69f3b974f017d94f"}
Jul 14 22:01:59.351687 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:59.351661    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:01:59.352728 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:59.352705    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb72449-3464-4ddd-a08a-6d541d9a8a52-maas-api-tls\") pod \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\" (UID: \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\") "
Jul 14 22:01:59.352797 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:59.352783    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gphl2\" (UniqueName: \"kubernetes.io/projected/ecb72449-3464-4ddd-a08a-6d541d9a8a52-kube-api-access-gphl2\") pod \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\" (UID: \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\") "
Jul 14 22:01:59.352869 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:59.352856    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb72449-3464-4ddd-a08a-6d541d9a8a52-openshift-service-ca\") pod \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\" (UID: \"ecb72449-3464-4ddd-a08a-6d541d9a8a52\") "
Jul 14 22:01:59.353224 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:59.353195    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecb72449-3464-4ddd-a08a-6d541d9a8a52-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ecb72449-3464-4ddd-a08a-6d541d9a8a52" (UID: "ecb72449-3464-4ddd-a08a-6d541d9a8a52"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:01:59.354707 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:59.354683    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecb72449-3464-4ddd-a08a-6d541d9a8a52-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ecb72449-3464-4ddd-a08a-6d541d9a8a52" (UID: "ecb72449-3464-4ddd-a08a-6d541d9a8a52"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:01:59.354821 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:59.354792    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecb72449-3464-4ddd-a08a-6d541d9a8a52-kube-api-access-gphl2" (OuterVolumeSpecName: "kube-api-access-gphl2") pod "ecb72449-3464-4ddd-a08a-6d541d9a8a52" (UID: "ecb72449-3464-4ddd-a08a-6d541d9a8a52"). InnerVolumeSpecName "kube-api-access-gphl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:01:59.453694 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:59.453665    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb72449-3464-4ddd-a08a-6d541d9a8a52-maas-api-tls\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:01:59.453694 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:59.453689    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gphl2\" (UniqueName: \"kubernetes.io/projected/ecb72449-3464-4ddd-a08a-6d541d9a8a52-kube-api-access-gphl2\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:01:59.453694 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:01:59.453700    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb72449-3464-4ddd-a08a-6d541d9a8a52-openshift-service-ca\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:00.278060 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:00.278033    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"
Jul 14 22:02:00.278060 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:00.278046    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m" event={"ID":"ecb72449-3464-4ddd-a08a-6d541d9a8a52","Type":"ContainerDied","Data":"cc070915e77b4616e8ed7548bb6e5e17c472a4a6696694b4bba25d2a49192c0b"}
Jul 14 22:02:00.278541 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:00.278122    2572 scope.go:117] "RemoveContainer" containerID="d9fbb0a16e09a90cbb92875662e8bde6218ffe87b6787a5b69f3b974f017d94f"
Jul 14 22:02:00.305891 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:00.305860    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"]
Jul 14 22:02:00.311711 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:00.311688    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-962ccb21-669d8ff49f-m767m"]
Jul 14 22:02:01.981229 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:01.981191    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecb72449-3464-4ddd-a08a-6d541d9a8a52" path="/var/lib/kubelet/pods/ecb72449-3464-4ddd-a08a-6d541d9a8a52/volumes"
Jul 14 22:02:04.302774 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:04.302738    2572 generic.go:356] "Generic (PLEG): container finished" podID="96b2c219-07ca-4afc-b142-c006c4f10e0e" containerID="a88a5ac43e17d4b45b29a792f761ab862978e21229836a6a5b97d1a4960ccf05" exitCode=0
Jul 14 22:02:04.303093 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:04.302810    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn" event={"ID":"96b2c219-07ca-4afc-b142-c006c4f10e0e","Type":"ContainerDied","Data":"a88a5ac43e17d4b45b29a792f761ab862978e21229836a6a5b97d1a4960ccf05"}
Jul 14 22:02:04.303274 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:04.303256    2572 scope.go:117] "RemoveContainer" containerID="a88a5ac43e17d4b45b29a792f761ab862978e21229836a6a5b97d1a4960ccf05"
Jul 14 22:02:04.304267 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:04.304240    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:02:04.304330 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:04.304303    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:02:04.304368 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:04.304335    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:02:04.806022 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:04.805986    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"]
Jul 14 22:02:05.309814 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:05.309775    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn" event={"ID":"96b2c219-07ca-4afc-b142-c006c4f10e0e","Type":"ContainerStarted","Data":"e8c3cfc60b9e662253215b54d788c73558cdb23ccf12256fc30484672d821cac"}
Jul 14 22:02:05.310245 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:05.309858    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn" podUID="96b2c219-07ca-4afc-b142-c006c4f10e0e" containerName="istio-proxy" containerID="cri-o://e8c3cfc60b9e662253215b54d788c73558cdb23ccf12256fc30484672d821cac" gracePeriod=30
Jul 14 22:02:09.242012 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:09.241979    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:02:10.562394 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.562373    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:02:10.653450 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.653391    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-workload-certs\") pod \"96b2c219-07ca-4afc-b142-c006c4f10e0e\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") "
Jul 14 22:02:10.653561 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.653451    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96b2c219-07ca-4afc-b142-c006c4f10e0e-istiod-ca-cert\") pod \"96b2c219-07ca-4afc-b142-c006c4f10e0e\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") "
Jul 14 22:02:10.653561 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.653517    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-data\") pod \"96b2c219-07ca-4afc-b142-c006c4f10e0e\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") "
Jul 14 22:02:10.653561 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.653542    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxhml\" (UniqueName: \"kubernetes.io/projected/96b2c219-07ca-4afc-b142-c006c4f10e0e-kube-api-access-rxhml\") pod \"96b2c219-07ca-4afc-b142-c006c4f10e0e\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") "
Jul 14 22:02:10.653715 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.653578    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-envoy\") pod \"96b2c219-07ca-4afc-b142-c006c4f10e0e\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") "
Jul 14 22:02:10.653715 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.653647    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "96b2c219-07ca-4afc-b142-c006c4f10e0e" (UID: "96b2c219-07ca-4afc-b142-c006c4f10e0e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:02:10.653715 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.653657    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-token\") pod \"96b2c219-07ca-4afc-b142-c006c4f10e0e\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") "
Jul 14 22:02:10.653715 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.653684    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-podinfo\") pod \"96b2c219-07ca-4afc-b142-c006c4f10e0e\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") "
Jul 14 22:02:10.653922 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.653734    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-credential-socket\") pod \"96b2c219-07ca-4afc-b142-c006c4f10e0e\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") "
Jul 14 22:02:10.653922 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.653772    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-workload-socket\") pod \"96b2c219-07ca-4afc-b142-c006c4f10e0e\" (UID: \"96b2c219-07ca-4afc-b142-c006c4f10e0e\") "
Jul 14 22:02:10.654029 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.653938    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "96b2c219-07ca-4afc-b142-c006c4f10e0e" (UID: "96b2c219-07ca-4afc-b142-c006c4f10e0e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:02:10.654100 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.654075    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-credential-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:10.654187 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.654090    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "96b2c219-07ca-4afc-b142-c006c4f10e0e" (UID: "96b2c219-07ca-4afc-b142-c006c4f10e0e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:02:10.654187 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.654129    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-workload-certs\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:10.654286 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.654197    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96b2c219-07ca-4afc-b142-c006c4f10e0e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "96b2c219-07ca-4afc-b142-c006c4f10e0e" (UID: "96b2c219-07ca-4afc-b142-c006c4f10e0e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:02:10.654456 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.654434    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-data" (OuterVolumeSpecName: "istio-data") pod "96b2c219-07ca-4afc-b142-c006c4f10e0e" (UID: "96b2c219-07ca-4afc-b142-c006c4f10e0e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:02:10.655667 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.655648    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "96b2c219-07ca-4afc-b142-c006c4f10e0e" (UID: "96b2c219-07ca-4afc-b142-c006c4f10e0e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:02:10.655764 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.655744    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "96b2c219-07ca-4afc-b142-c006c4f10e0e" (UID: "96b2c219-07ca-4afc-b142-c006c4f10e0e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 22:02:10.656056 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.656035    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-token" (OuterVolumeSpecName: "istio-token") pod "96b2c219-07ca-4afc-b142-c006c4f10e0e" (UID: "96b2c219-07ca-4afc-b142-c006c4f10e0e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:02:10.656094 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.656062    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96b2c219-07ca-4afc-b142-c006c4f10e0e-kube-api-access-rxhml" (OuterVolumeSpecName: "kube-api-access-rxhml") pod "96b2c219-07ca-4afc-b142-c006c4f10e0e" (UID: "96b2c219-07ca-4afc-b142-c006c4f10e0e"). InnerVolumeSpecName "kube-api-access-rxhml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:02:10.755158 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.755134    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-data\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:10.755158 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.755156    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxhml\" (UniqueName: \"kubernetes.io/projected/96b2c219-07ca-4afc-b142-c006c4f10e0e-kube-api-access-rxhml\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:10.755287 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.755166    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-envoy\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:10.755287 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.755174    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-token\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:10.755287 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.755182    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96b2c219-07ca-4afc-b142-c006c4f10e0e-istio-podinfo\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:10.755287 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.755190    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96b2c219-07ca-4afc-b142-c006c4f10e0e-workload-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:10.755287 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:10.755197    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96b2c219-07ca-4afc-b142-c006c4f10e0e-istiod-ca-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:11.236637 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.236497    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"]
Jul 14 22:02:11.237178 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.237159    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96b2c219-07ca-4afc-b142-c006c4f10e0e" containerName="istio-proxy"
Jul 14 22:02:11.237178 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.237179    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="96b2c219-07ca-4afc-b142-c006c4f10e0e" containerName="istio-proxy"
Jul 14 22:02:11.237301 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.237207    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecb72449-3464-4ddd-a08a-6d541d9a8a52" containerName="maas-api"
Jul 14 22:02:11.237301 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.237216    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecb72449-3464-4ddd-a08a-6d541d9a8a52" containerName="maas-api"
Jul 14 22:02:11.237301 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.237282    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="96b2c219-07ca-4afc-b142-c006c4f10e0e" containerName="istio-proxy"
Jul 14 22:02:11.237301 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.237293    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="96b2c219-07ca-4afc-b142-c006c4f10e0e" containerName="istio-proxy"
Jul 14 22:02:11.237301 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.237299    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecb72449-3464-4ddd-a08a-6d541d9a8a52" containerName="maas-api"
Jul 14 22:02:11.239715 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.239697    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.243083 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.243063    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-020542e4-openshift-default-dockercfg-cdmsr\""
Jul 14 22:02:11.253758 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.253738    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"]
Jul 14 22:02:11.344658 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.344625    2572 generic.go:356] "Generic (PLEG): container finished" podID="96b2c219-07ca-4afc-b142-c006c4f10e0e" containerID="e8c3cfc60b9e662253215b54d788c73558cdb23ccf12256fc30484672d821cac" exitCode=0
Jul 14 22:02:11.344811 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.344679    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"
Jul 14 22:02:11.344811 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.344692    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn" event={"ID":"96b2c219-07ca-4afc-b142-c006c4f10e0e","Type":"ContainerDied","Data":"e8c3cfc60b9e662253215b54d788c73558cdb23ccf12256fc30484672d821cac"}
Jul 14 22:02:11.344811 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.344760    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn" event={"ID":"96b2c219-07ca-4afc-b142-c006c4f10e0e","Type":"ContainerDied","Data":"1068f02c6672ce06af93d9c173f63c6a56f4f557b8b58e9638087c7357592f49"}
Jul 14 22:02:11.344811 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.344792    2572 scope.go:117] "RemoveContainer" containerID="e8c3cfc60b9e662253215b54d788c73558cdb23ccf12256fc30484672d821cac"
Jul 14 22:02:11.356611 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.356590    2572 scope.go:117] "RemoveContainer" containerID="a88a5ac43e17d4b45b29a792f761ab862978e21229836a6a5b97d1a4960ccf05"
Jul 14 22:02:11.361159 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.361136    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-workload-certs\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.361263 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.361171    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-token\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.361263 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.361207    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istiod-ca-cert\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.361471 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.361269    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-workload-socket\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.361471 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.361294    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-credential-socket\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.361471 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.361352    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-data\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.361471 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.361386    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gplvw\" (UniqueName: \"kubernetes.io/projected/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-kube-api-access-gplvw\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.361471 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.361411    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-podinfo\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.361471 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.361438    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-envoy\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.364912 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.364896    2572 scope.go:117] "RemoveContainer" containerID="e8c3cfc60b9e662253215b54d788c73558cdb23ccf12256fc30484672d821cac"
Jul 14 22:02:11.365165 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:02:11.365145    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8c3cfc60b9e662253215b54d788c73558cdb23ccf12256fc30484672d821cac\": container with ID starting with e8c3cfc60b9e662253215b54d788c73558cdb23ccf12256fc30484672d821cac not found: ID does not exist" containerID="e8c3cfc60b9e662253215b54d788c73558cdb23ccf12256fc30484672d821cac"
Jul 14 22:02:11.365227 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.365173    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8c3cfc60b9e662253215b54d788c73558cdb23ccf12256fc30484672d821cac"} err="failed to get container status \"e8c3cfc60b9e662253215b54d788c73558cdb23ccf12256fc30484672d821cac\": rpc error: code = NotFound desc = could not find container \"e8c3cfc60b9e662253215b54d788c73558cdb23ccf12256fc30484672d821cac\": container with ID starting with e8c3cfc60b9e662253215b54d788c73558cdb23ccf12256fc30484672d821cac not found: ID does not exist"
Jul 14 22:02:11.365227 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.365189    2572 scope.go:117] "RemoveContainer" containerID="a88a5ac43e17d4b45b29a792f761ab862978e21229836a6a5b97d1a4960ccf05"
Jul 14 22:02:11.365425 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:02:11.365410    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a88a5ac43e17d4b45b29a792f761ab862978e21229836a6a5b97d1a4960ccf05\": container with ID starting with a88a5ac43e17d4b45b29a792f761ab862978e21229836a6a5b97d1a4960ccf05 not found: ID does not exist" containerID="a88a5ac43e17d4b45b29a792f761ab862978e21229836a6a5b97d1a4960ccf05"
Jul 14 22:02:11.365470 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.365430    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a88a5ac43e17d4b45b29a792f761ab862978e21229836a6a5b97d1a4960ccf05"} err="failed to get container status \"a88a5ac43e17d4b45b29a792f761ab862978e21229836a6a5b97d1a4960ccf05\": rpc error: code = NotFound desc = could not find container \"a88a5ac43e17d4b45b29a792f761ab862978e21229836a6a5b97d1a4960ccf05\": container with ID starting with a88a5ac43e17d4b45b29a792f761ab862978e21229836a6a5b97d1a4960ccf05 not found: ID does not exist"
Jul 14 22:02:11.369193 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.369166    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"]
Jul 14 22:02:11.377512 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.377481    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-962ccb21-openshift-default-6c54bb9d6c-6hvwn"]
Jul 14 22:02:11.462339 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.462313    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-data\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.462454 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.462355    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gplvw\" (UniqueName: \"kubernetes.io/projected/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-kube-api-access-gplvw\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.462454 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.462379    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-podinfo\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.462454 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.462409    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-envoy\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.462627 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.462464    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-workload-certs\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.462627 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.462483    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-token\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.462627 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.462520    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istiod-ca-cert\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.462627 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.462547    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-workload-socket\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.462627 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.462572    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-credential-socket\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.462846 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.462744    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-data\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.463022 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.462993    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-workload-certs\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.463092 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.463069    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-credential-socket\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.463183 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.463148    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-workload-socket\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.463238 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.463219    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istiod-ca-cert\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.464661 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.464644    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-envoy\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.464911 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.464893    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-podinfo\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.471193 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.471172    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-token\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.471300 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.471279    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gplvw\" (UniqueName: \"kubernetes.io/projected/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-kube-api-access-gplvw\") pod \"e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") " pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.551391 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.551371    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:11.690459 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.690432    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"]
Jul 14 22:02:11.691871 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:02:11.691849    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c9e7bd_cdee_4c73_a6fc_974af6aa2ca0.slice/crio-001597bf3e902ce0457393431f2504bd302899955b87b363f3e0a7cfcfff3f9f WatchSource:0}: Error finding container 001597bf3e902ce0457393431f2504bd302899955b87b363f3e0a7cfcfff3f9f: Status 404 returned error can't find the container with id 001597bf3e902ce0457393431f2504bd302899955b87b363f3e0a7cfcfff3f9f
Jul 14 22:02:11.693928 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.693895    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:02:11.694017 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.693958    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:02:11.694017 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.693985    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:02:11.978963 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:11.978887    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96b2c219-07ca-4afc-b142-c006c4f10e0e" path="/var/lib/kubelet/pods/96b2c219-07ca-4afc-b142-c006c4f10e0e/volumes"
Jul 14 22:02:12.352723 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.352690    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc" event={"ID":"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0","Type":"ContainerStarted","Data":"911486dd76405798ed26938a611863135ea69daf0dd549d9ec414f1685f312a7"}
Jul 14 22:02:12.352880 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.352751    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc" event={"ID":"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0","Type":"ContainerStarted","Data":"001597bf3e902ce0457393431f2504bd302899955b87b363f3e0a7cfcfff3f9f"}
Jul 14 22:02:12.375678 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.375629    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc" podStartSLOduration=1.375616864 podStartE2EDuration="1.375616864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:02:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:02:12.373903092 +0000 UTC m=+1470.858995746" watchObservedRunningTime="2026-07-14 22:02:12.375616864 +0000 UTC m=+1470.860709516"
Jul 14 22:02:12.528800 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.528764    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"]
Jul 14 22:02:12.529376 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.529352    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96b2c219-07ca-4afc-b142-c006c4f10e0e" containerName="istio-proxy"
Jul 14 22:02:12.529376 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.529374    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="96b2c219-07ca-4afc-b142-c006c4f10e0e" containerName="istio-proxy"
Jul 14 22:02:12.533197 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.533174    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"
Jul 14 22:02:12.535606 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.535584    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-020542e4-serving-cert\""
Jul 14 22:02:12.546466 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.546444    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"]
Jul 14 22:02:12.552525 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.552505    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:12.553774 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.553750    2572 patch_prober.go:28] interesting pod/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 14 22:02:12.553927 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.553801    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc" podUID="e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 14 22:02:12.573076 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.573051    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdbwk\" (UniqueName: \"kubernetes.io/projected/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-kube-api-access-gdbwk\") pod \"maas-api-e2e-derive-020542e4-56d448847b-rhfvp\" (UID: \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\") " pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"
Jul 14 22:02:12.573212 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.573192    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-maas-api-tls\") pod \"maas-api-e2e-derive-020542e4-56d448847b-rhfvp\" (UID: \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\") " pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"
Jul 14 22:02:12.573276 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.573260    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-openshift-service-ca\") pod \"maas-api-e2e-derive-020542e4-56d448847b-rhfvp\" (UID: \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\") " pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"
Jul 14 22:02:12.674447 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.674365    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-maas-api-tls\") pod \"maas-api-e2e-derive-020542e4-56d448847b-rhfvp\" (UID: \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\") " pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"
Jul 14 22:02:12.674447 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.674413    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-openshift-service-ca\") pod \"maas-api-e2e-derive-020542e4-56d448847b-rhfvp\" (UID: \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\") " pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"
Jul 14 22:02:12.674628 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.674479    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdbwk\" (UniqueName: \"kubernetes.io/projected/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-kube-api-access-gdbwk\") pod \"maas-api-e2e-derive-020542e4-56d448847b-rhfvp\" (UID: \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\") " pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"
Jul 14 22:02:12.675139 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.675099    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-openshift-service-ca\") pod \"maas-api-e2e-derive-020542e4-56d448847b-rhfvp\" (UID: \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\") " pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"
Jul 14 22:02:12.676751 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.676729    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-maas-api-tls\") pod \"maas-api-e2e-derive-020542e4-56d448847b-rhfvp\" (UID: \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\") " pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"
Jul 14 22:02:12.687516 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.687494    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdbwk\" (UniqueName: \"kubernetes.io/projected/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-kube-api-access-gdbwk\") pod \"maas-api-e2e-derive-020542e4-56d448847b-rhfvp\" (UID: \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\") " pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"
Jul 14 22:02:12.844756 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:12.844726    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"
Jul 14 22:02:13.001174 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:13.001149    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"]
Jul 14 22:02:13.003531 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:02:13.003508    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947ba2b5_d117_4ef5_84e9_51e5bd29a24c.slice/crio-b911d4d9f07e46bff5d533d22296dab3ab80b189e64f69bb56f9b383a0fcb98e WatchSource:0}: Error finding container b911d4d9f07e46bff5d533d22296dab3ab80b189e64f69bb56f9b383a0fcb98e: Status 404 returned error can't find the container with id b911d4d9f07e46bff5d533d22296dab3ab80b189e64f69bb56f9b383a0fcb98e
Jul 14 22:02:13.359332 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:13.359297    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp" event={"ID":"947ba2b5-d117-4ef5-84e9-51e5bd29a24c","Type":"ContainerStarted","Data":"b911d4d9f07e46bff5d533d22296dab3ab80b189e64f69bb56f9b383a0fcb98e"}
Jul 14 22:02:13.556137 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:13.556098    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:14.365926 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:14.365890    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp" event={"ID":"947ba2b5-d117-4ef5-84e9-51e5bd29a24c","Type":"ContainerStarted","Data":"be84f1989d3473c0c0fa93cf7211fea3ec3d832659370a7186857d5feedd9723"}
Jul 14 22:02:14.366314 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:14.365958    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"
Jul 14 22:02:14.366314 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:14.366131    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:14.367190 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:14.367173    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:14.390623 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:14.390579    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp" podStartSLOduration=1.9470593090000001 podStartE2EDuration="2.390564141s" totalImagesPullingTime="443.504832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:02:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:02:14.387852415 +0000 UTC m=+1472.872945066" watchObservedRunningTime="2026-07-14 22:02:14.390564141 +0000 UTC m=+1472.875656793"
Jul 14 22:02:17.053562 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:17.053531    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"]
Jul 14 22:02:17.302938 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:17.302908    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"]
Jul 14 22:02:17.303379 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:17.303345    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp" podUID="947ba2b5-d117-4ef5-84e9-51e5bd29a24c" containerName="maas-api" containerID="cri-o://be84f1989d3473c0c0fa93cf7211fea3ec3d832659370a7186857d5feedd9723" gracePeriod=30
Jul 14 22:02:17.381814 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:17.381752    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc" podUID="e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" containerName="istio-proxy" containerID="cri-o://911486dd76405798ed26938a611863135ea69daf0dd549d9ec414f1685f312a7" gracePeriod=30
Jul 14 22:02:17.594545 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:17.594520    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"
Jul 14 22:02:17.743480 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:17.743448    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-maas-api-tls\") pod \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\" (UID: \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\") "
Jul 14 22:02:17.743823 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:17.743802    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-openshift-service-ca\") pod \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\" (UID: \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\") "
Jul 14 22:02:17.744001 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:17.743986    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdbwk\" (UniqueName: \"kubernetes.io/projected/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-kube-api-access-gdbwk\") pod \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\" (UID: \"947ba2b5-d117-4ef5-84e9-51e5bd29a24c\") "
Jul 14 22:02:17.744798 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:17.744467    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "947ba2b5-d117-4ef5-84e9-51e5bd29a24c" (UID: "947ba2b5-d117-4ef5-84e9-51e5bd29a24c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:02:17.744798 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:17.744765    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-openshift-service-ca\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:17.747038 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:17.746899    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "947ba2b5-d117-4ef5-84e9-51e5bd29a24c" (UID: "947ba2b5-d117-4ef5-84e9-51e5bd29a24c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:02:17.748008 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:17.747982    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-kube-api-access-gdbwk" (OuterVolumeSpecName: "kube-api-access-gdbwk") pod "947ba2b5-d117-4ef5-84e9-51e5bd29a24c" (UID: "947ba2b5-d117-4ef5-84e9-51e5bd29a24c"). InnerVolumeSpecName "kube-api-access-gdbwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:02:17.845787 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:17.845705    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdbwk\" (UniqueName: \"kubernetes.io/projected/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-kube-api-access-gdbwk\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:17.845787 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:17.845743    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/947ba2b5-d117-4ef5-84e9-51e5bd29a24c-maas-api-tls\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:18.387882 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:18.387842    2572 generic.go:356] "Generic (PLEG): container finished" podID="947ba2b5-d117-4ef5-84e9-51e5bd29a24c" containerID="be84f1989d3473c0c0fa93cf7211fea3ec3d832659370a7186857d5feedd9723" exitCode=0
Jul 14 22:02:18.388381 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:18.387886    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"
Jul 14 22:02:18.388381 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:18.387926    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp" event={"ID":"947ba2b5-d117-4ef5-84e9-51e5bd29a24c","Type":"ContainerDied","Data":"be84f1989d3473c0c0fa93cf7211fea3ec3d832659370a7186857d5feedd9723"}
Jul 14 22:02:18.388381 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:18.387978    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp" event={"ID":"947ba2b5-d117-4ef5-84e9-51e5bd29a24c","Type":"ContainerDied","Data":"b911d4d9f07e46bff5d533d22296dab3ab80b189e64f69bb56f9b383a0fcb98e"}
Jul 14 22:02:18.388381 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:18.388001    2572 scope.go:117] "RemoveContainer" containerID="be84f1989d3473c0c0fa93cf7211fea3ec3d832659370a7186857d5feedd9723"
Jul 14 22:02:18.396956 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:18.396938    2572 scope.go:117] "RemoveContainer" containerID="be84f1989d3473c0c0fa93cf7211fea3ec3d832659370a7186857d5feedd9723"
Jul 14 22:02:18.397213 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:02:18.397195    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be84f1989d3473c0c0fa93cf7211fea3ec3d832659370a7186857d5feedd9723\": container with ID starting with be84f1989d3473c0c0fa93cf7211fea3ec3d832659370a7186857d5feedd9723 not found: ID does not exist" containerID="be84f1989d3473c0c0fa93cf7211fea3ec3d832659370a7186857d5feedd9723"
Jul 14 22:02:18.397293 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:18.397227    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be84f1989d3473c0c0fa93cf7211fea3ec3d832659370a7186857d5feedd9723"} err="failed to get container status \"be84f1989d3473c0c0fa93cf7211fea3ec3d832659370a7186857d5feedd9723\": rpc error: code = NotFound desc = could not find container \"be84f1989d3473c0c0fa93cf7211fea3ec3d832659370a7186857d5feedd9723\": container with ID starting with be84f1989d3473c0c0fa93cf7211fea3ec3d832659370a7186857d5feedd9723 not found: ID does not exist"
Jul 14 22:02:18.410389 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:18.410362    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"]
Jul 14 22:02:18.414333 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:18.414315    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-020542e4-56d448847b-rhfvp"]
Jul 14 22:02:19.979490 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:19.979449    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="947ba2b5-d117-4ef5-84e9-51e5bd29a24c" path="/var/lib/kubelet/pods/947ba2b5-d117-4ef5-84e9-51e5bd29a24c/volumes"
Jul 14 22:02:23.342579 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.342555    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:23.419174 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.419074    2572 generic.go:356] "Generic (PLEG): container finished" podID="e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" containerID="911486dd76405798ed26938a611863135ea69daf0dd549d9ec414f1685f312a7" exitCode=0
Jul 14 22:02:23.419174 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.419143    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"
Jul 14 22:02:23.419174 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.419147    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc" event={"ID":"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0","Type":"ContainerDied","Data":"911486dd76405798ed26938a611863135ea69daf0dd549d9ec414f1685f312a7"}
Jul 14 22:02:23.419420 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.419197    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc" event={"ID":"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0","Type":"ContainerDied","Data":"001597bf3e902ce0457393431f2504bd302899955b87b363f3e0a7cfcfff3f9f"}
Jul 14 22:02:23.419420 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.419220    2572 scope.go:117] "RemoveContainer" containerID="911486dd76405798ed26938a611863135ea69daf0dd549d9ec414f1685f312a7"
Jul 14 22:02:23.427650 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.427635    2572 scope.go:117] "RemoveContainer" containerID="911486dd76405798ed26938a611863135ea69daf0dd549d9ec414f1685f312a7"
Jul 14 22:02:23.427898 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:02:23.427880    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"911486dd76405798ed26938a611863135ea69daf0dd549d9ec414f1685f312a7\": container with ID starting with 911486dd76405798ed26938a611863135ea69daf0dd549d9ec414f1685f312a7 not found: ID does not exist" containerID="911486dd76405798ed26938a611863135ea69daf0dd549d9ec414f1685f312a7"
Jul 14 22:02:23.427947 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.427907    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"911486dd76405798ed26938a611863135ea69daf0dd549d9ec414f1685f312a7"} err="failed to get container status \"911486dd76405798ed26938a611863135ea69daf0dd549d9ec414f1685f312a7\": rpc error: code = NotFound desc = could not find container \"911486dd76405798ed26938a611863135ea69daf0dd549d9ec414f1685f312a7\": container with ID starting with 911486dd76405798ed26938a611863135ea69daf0dd549d9ec414f1685f312a7 not found: ID does not exist"
Jul 14 22:02:23.498278 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.498253    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-workload-socket\") pod \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") "
Jul 14 22:02:23.498387 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.498285    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-workload-certs\") pod \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") "
Jul 14 22:02:23.498387 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.498305    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gplvw\" (UniqueName: \"kubernetes.io/projected/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-kube-api-access-gplvw\") pod \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") "
Jul 14 22:02:23.498387 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.498338    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-podinfo\") pod \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") "
Jul 14 22:02:23.498526 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.498397    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-data\") pod \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") "
Jul 14 22:02:23.498526 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.498436    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-credential-socket\") pod \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") "
Jul 14 22:02:23.498526 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.498473    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istiod-ca-cert\") pod \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") "
Jul 14 22:02:23.498678 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.498527    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-token\") pod \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") "
Jul 14 22:02:23.498678 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.498558    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" (UID: "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:02:23.498678 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.498576    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-envoy\") pod \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\" (UID: \"e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0\") "
Jul 14 22:02:23.498678 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.498596    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" (UID: "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:02:23.498888 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.498702    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" (UID: "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:02:23.499017 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.498993    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-workload-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:23.499017 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.499018    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-workload-certs\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:23.499275 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.499033    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-credential-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:23.499275 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.499244    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" (UID: "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:02:23.499390 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.499329    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" (UID: "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:02:23.500641 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.500613    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-kube-api-access-gplvw" (OuterVolumeSpecName: "kube-api-access-gplvw") pod "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" (UID: "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0"). InnerVolumeSpecName "kube-api-access-gplvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:02:23.500794 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.500772    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" (UID: "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:02:23.501010 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.500989    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" (UID: "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:02:23.501095 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.501002    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" (UID: "e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 22:02:23.599410 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.599387    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gplvw\" (UniqueName: \"kubernetes.io/projected/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-kube-api-access-gplvw\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:23.599410 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.599409    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-podinfo\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:23.599529 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.599419    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-data\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:23.599529 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.599426    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istiod-ca-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:23.599529 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.599433    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-token\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:23.599529 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.599440    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0-istio-envoy\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:02:23.745301 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.745279    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"]
Jul 14 22:02:23.748890 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.748870    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-020542e4-openshift-default-65fbd5847f-7fhnc"]
Jul 14 22:02:23.980530 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:23.980465    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" path="/var/lib/kubelet/pods/e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0/volumes"
Jul 14 22:02:41.993498 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:41.993471    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 22:02:41.996291 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:02:41.996268    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 22:04:02.551242 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.551211    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"]
Jul 14 22:04:02.551702 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.551627    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" containerName="istio-proxy"
Jul 14 22:04:02.551702 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.551638    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" containerName="istio-proxy"
Jul 14 22:04:02.551702 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.551653    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947ba2b5-d117-4ef5-84e9-51e5bd29a24c" containerName="maas-api"
Jul 14 22:04:02.551702 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.551658    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="947ba2b5-d117-4ef5-84e9-51e5bd29a24c" containerName="maas-api"
Jul 14 22:04:02.551853 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.551732    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7c9e7bd-cdee-4c73-a6fc-974af6aa2ca0" containerName="istio-proxy"
Jul 14 22:04:02.551853 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.551742    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="947ba2b5-d117-4ef5-84e9-51e5bd29a24c" containerName="maas-api"
Jul 14 22:04:02.554983 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.554967    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.557940 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.557923    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9203b7ab-openshift-default-dockercfg-spl96\""
Jul 14 22:04:02.578737 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.578711    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"]
Jul 14 22:04:02.664430 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.664401    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-token\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.664574 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.664440    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-data\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.664574 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.664478    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-workload-certs\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.664574 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.664529    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-credential-socket\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.664574 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.664547    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-podinfo\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.664727 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.664587    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-workload-socket\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.664727 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.664662    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wxhw\" (UniqueName: \"kubernetes.io/projected/b55ad7f8-e8f3-42b5-b32c-109fe251168f-kube-api-access-2wxhw\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.664727 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.664688    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istiod-ca-cert\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.664727 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.664710    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-envoy\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.765926 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.765894    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-workload-certs\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.766064 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.765944    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-credential-socket\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.766064 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.765973    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-podinfo\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.766064 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.765998    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-workload-socket\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.766255 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.766062    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wxhw\" (UniqueName: \"kubernetes.io/projected/b55ad7f8-e8f3-42b5-b32c-109fe251168f-kube-api-access-2wxhw\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.766255 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.766112    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istiod-ca-cert\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.766255 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.766143    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-envoy\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.766255 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.766181    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-token\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.766255 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.766216    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-data\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.766515 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.766317    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-credential-socket\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.766515 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.766360    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-workload-certs\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.766515 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.766437    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-workload-socket\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.766740 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.766717    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-data\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.766822 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.766808    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istiod-ca-cert\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.768193 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.768172    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-envoy\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.768507 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.768488    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-podinfo\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.777692 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.777666    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wxhw\" (UniqueName: \"kubernetes.io/projected/b55ad7f8-e8f3-42b5-b32c-109fe251168f-kube-api-access-2wxhw\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.781649 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.781624    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-token\") pod \"e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") " pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:02.865100 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:02.865034    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:03.012097 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:03.012067    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"]
Jul 14 22:04:03.018177 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:03.018141    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:04:03.018269 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:03.018207    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:04:03.018269 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:03.018235    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:04:03.962729 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:03.962693    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq" event={"ID":"b55ad7f8-e8f3-42b5-b32c-109fe251168f","Type":"ContainerStarted","Data":"58f52451b26696a7472f8597f0b1ecfc17001a68eb81b4102a7aa962ef299114"}
Jul 14 22:04:03.963127 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:03.962750    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq" event={"ID":"b55ad7f8-e8f3-42b5-b32c-109fe251168f","Type":"ContainerStarted","Data":"887982682e0e384c6b4a9ce34e63d6130d30bc23bfeca32bc8124e8a1eb73c86"}
Jul 14 22:04:03.991354 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:03.991307    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq" podStartSLOduration=1.9912932620000001 podStartE2EDuration="1.991293262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:04:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:04:03.989960453 +0000 UTC m=+1582.475053108" watchObservedRunningTime="2026-07-14 22:04:03.991293262 +0000 UTC m=+1582.476385913"
Jul 14 22:04:04.866207 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:04.866166    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:04.871219 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:04.871191    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:04.968441 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:04.968410    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:04.969454 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:04.969435    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:06.273306 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:06.273263    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"]
Jul 14 22:04:06.277452 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:06.277427    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:06.279877 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:06.279856    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-9203b7ab-serving-cert\""
Jul 14 22:04:06.307258 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:06.307227    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"]
Jul 14 22:04:06.404127 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:06.404067    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c04e112a-4514-484b-948f-ad760c1880e3-maas-api-tls\") pod \"maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9\" (UID: \"c04e112a-4514-484b-948f-ad760c1880e3\") " pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:06.404278 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:06.404152    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c04e112a-4514-484b-948f-ad760c1880e3-openshift-service-ca\") pod \"maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9\" (UID: \"c04e112a-4514-484b-948f-ad760c1880e3\") " pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:06.404278 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:06.404195    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc7rl\" (UniqueName: \"kubernetes.io/projected/c04e112a-4514-484b-948f-ad760c1880e3-kube-api-access-lc7rl\") pod \"maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9\" (UID: \"c04e112a-4514-484b-948f-ad760c1880e3\") " pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:06.505320 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:06.505288    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc7rl\" (UniqueName: \"kubernetes.io/projected/c04e112a-4514-484b-948f-ad760c1880e3-kube-api-access-lc7rl\") pod \"maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9\" (UID: \"c04e112a-4514-484b-948f-ad760c1880e3\") " pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:06.505483 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:06.505464    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c04e112a-4514-484b-948f-ad760c1880e3-maas-api-tls\") pod \"maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9\" (UID: \"c04e112a-4514-484b-948f-ad760c1880e3\") " pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:06.505573 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:06.505499    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c04e112a-4514-484b-948f-ad760c1880e3-openshift-service-ca\") pod \"maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9\" (UID: \"c04e112a-4514-484b-948f-ad760c1880e3\") " pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:06.505630 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:04:06.505593    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-9203b7ab-serving-cert: secret "maas-api-e2e-mt-9203b7ab-serving-cert" not found
Jul 14 22:04:06.505681 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:04:06.505665    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c04e112a-4514-484b-948f-ad760c1880e3-maas-api-tls podName:c04e112a-4514-484b-948f-ad760c1880e3 nodeName:}" failed. No retries permitted until 2026-07-14 22:04:07.005647727 +0000 UTC m=+1585.490740358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c04e112a-4514-484b-948f-ad760c1880e3-maas-api-tls") pod "maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9" (UID: "c04e112a-4514-484b-948f-ad760c1880e3") : secret "maas-api-e2e-mt-9203b7ab-serving-cert" not found
Jul 14 22:04:06.506166 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:06.506144    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c04e112a-4514-484b-948f-ad760c1880e3-openshift-service-ca\") pod \"maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9\" (UID: \"c04e112a-4514-484b-948f-ad760c1880e3\") " pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:06.516348 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:06.516318    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc7rl\" (UniqueName: \"kubernetes.io/projected/c04e112a-4514-484b-948f-ad760c1880e3-kube-api-access-lc7rl\") pod \"maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9\" (UID: \"c04e112a-4514-484b-948f-ad760c1880e3\") " pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:07.010829 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:07.010793    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c04e112a-4514-484b-948f-ad760c1880e3-maas-api-tls\") pod \"maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9\" (UID: \"c04e112a-4514-484b-948f-ad760c1880e3\") " pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:07.013246 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:07.013216    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c04e112a-4514-484b-948f-ad760c1880e3-maas-api-tls\") pod \"maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9\" (UID: \"c04e112a-4514-484b-948f-ad760c1880e3\") " pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:07.189546 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:07.189502    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:07.331841 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:07.331814    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"]
Jul 14 22:04:07.333444 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:04:07.333421    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc04e112a_4514_484b_948f_ad760c1880e3.slice/crio-f6edca2c7dbda4a72013084bb77633a6761704bd4b0d365e14aaac8908d74b04 WatchSource:0}: Error finding container f6edca2c7dbda4a72013084bb77633a6761704bd4b0d365e14aaac8908d74b04: Status 404 returned error can't find the container with id f6edca2c7dbda4a72013084bb77633a6761704bd4b0d365e14aaac8908d74b04
Jul 14 22:04:07.984859 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:07.984826    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9" event={"ID":"c04e112a-4514-484b-948f-ad760c1880e3","Type":"ContainerStarted","Data":"cd2d903620df9a5213cfff0215004d13c113eb3d2ec30d6627e603f0aac4df3a"}
Jul 14 22:04:07.985046 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:07.984877    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9" event={"ID":"c04e112a-4514-484b-948f-ad760c1880e3","Type":"ContainerStarted","Data":"f6edca2c7dbda4a72013084bb77633a6761704bd4b0d365e14aaac8908d74b04"}
Jul 14 22:04:07.985046 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:07.984952    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:08.005341 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:08.005280    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9" podStartSLOduration=1.5812835189999999 podStartE2EDuration="2.005262186s" totalImagesPullingTime="423.978667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:04:08.004732119 +0000 UTC m=+1586.489824784" watchObservedRunningTime="2026-07-14 22:04:08.005262186 +0000 UTC m=+1586.490354840"
Jul 14 22:04:13.995901 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:13.995868    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:18.606352 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:18.606312    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"]
Jul 14 22:04:18.609354 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:18.606558    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9" podUID="c04e112a-4514-484b-948f-ad760c1880e3" containerName="maas-api" containerID="cri-o://cd2d903620df9a5213cfff0215004d13c113eb3d2ec30d6627e603f0aac4df3a" gracePeriod=30
Jul 14 22:04:18.871254 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:18.871180    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:18.938090 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:18.938057    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc7rl\" (UniqueName: \"kubernetes.io/projected/c04e112a-4514-484b-948f-ad760c1880e3-kube-api-access-lc7rl\") pod \"c04e112a-4514-484b-948f-ad760c1880e3\" (UID: \"c04e112a-4514-484b-948f-ad760c1880e3\") "
Jul 14 22:04:18.938290 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:18.938163    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c04e112a-4514-484b-948f-ad760c1880e3-maas-api-tls\") pod \"c04e112a-4514-484b-948f-ad760c1880e3\" (UID: \"c04e112a-4514-484b-948f-ad760c1880e3\") "
Jul 14 22:04:18.938290 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:18.938227    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c04e112a-4514-484b-948f-ad760c1880e3-openshift-service-ca\") pod \"c04e112a-4514-484b-948f-ad760c1880e3\" (UID: \"c04e112a-4514-484b-948f-ad760c1880e3\") "
Jul 14 22:04:18.938603 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:18.938579    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c04e112a-4514-484b-948f-ad760c1880e3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c04e112a-4514-484b-948f-ad760c1880e3" (UID: "c04e112a-4514-484b-948f-ad760c1880e3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:04:18.940268 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:18.940242    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c04e112a-4514-484b-948f-ad760c1880e3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c04e112a-4514-484b-948f-ad760c1880e3" (UID: "c04e112a-4514-484b-948f-ad760c1880e3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:04:18.940357 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:18.940272    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c04e112a-4514-484b-948f-ad760c1880e3-kube-api-access-lc7rl" (OuterVolumeSpecName: "kube-api-access-lc7rl") pod "c04e112a-4514-484b-948f-ad760c1880e3" (UID: "c04e112a-4514-484b-948f-ad760c1880e3"). InnerVolumeSpecName "kube-api-access-lc7rl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:04:19.040366 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.040328    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c04e112a-4514-484b-948f-ad760c1880e3-openshift-service-ca\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:04:19.040366 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.040364    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc7rl\" (UniqueName: \"kubernetes.io/projected/c04e112a-4514-484b-948f-ad760c1880e3-kube-api-access-lc7rl\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:04:19.040608 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.040379    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c04e112a-4514-484b-948f-ad760c1880e3-maas-api-tls\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:04:19.047999 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.047971    2572 generic.go:356] "Generic (PLEG): container finished" podID="b55ad7f8-e8f3-42b5-b32c-109fe251168f" containerID="58f52451b26696a7472f8597f0b1ecfc17001a68eb81b4102a7aa962ef299114" exitCode=0
Jul 14 22:04:19.048155 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.048041    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq" event={"ID":"b55ad7f8-e8f3-42b5-b32c-109fe251168f","Type":"ContainerDied","Data":"58f52451b26696a7472f8597f0b1ecfc17001a68eb81b4102a7aa962ef299114"}
Jul 14 22:04:19.048443 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.048426    2572 scope.go:117] "RemoveContainer" containerID="58f52451b26696a7472f8597f0b1ecfc17001a68eb81b4102a7aa962ef299114"
Jul 14 22:04:19.049504 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.049469    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:04:19.049504 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.049481    2572 generic.go:356] "Generic (PLEG): container finished" podID="c04e112a-4514-484b-948f-ad760c1880e3" containerID="cd2d903620df9a5213cfff0215004d13c113eb3d2ec30d6627e603f0aac4df3a" exitCode=0
Jul 14 22:04:19.049620 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.049497    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9" event={"ID":"c04e112a-4514-484b-948f-ad760c1880e3","Type":"ContainerDied","Data":"cd2d903620df9a5213cfff0215004d13c113eb3d2ec30d6627e603f0aac4df3a"}
Jul 14 22:04:19.049811 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.049780    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9" event={"ID":"c04e112a-4514-484b-948f-ad760c1880e3","Type":"ContainerDied","Data":"f6edca2c7dbda4a72013084bb77633a6761704bd4b0d365e14aaac8908d74b04"}
Jul 14 22:04:19.050061 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.049926    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"
Jul 14 22:04:19.050206 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.050092    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:04:19.050269 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.050237    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:04:19.051510 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.049927    2572 scope.go:117] "RemoveContainer" containerID="cd2d903620df9a5213cfff0215004d13c113eb3d2ec30d6627e603f0aac4df3a"
Jul 14 22:04:19.068228 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.068209    2572 scope.go:117] "RemoveContainer" containerID="cd2d903620df9a5213cfff0215004d13c113eb3d2ec30d6627e603f0aac4df3a"
Jul 14 22:04:19.068537 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:04:19.068517    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd2d903620df9a5213cfff0215004d13c113eb3d2ec30d6627e603f0aac4df3a\": container with ID starting with cd2d903620df9a5213cfff0215004d13c113eb3d2ec30d6627e603f0aac4df3a not found: ID does not exist" containerID="cd2d903620df9a5213cfff0215004d13c113eb3d2ec30d6627e603f0aac4df3a"
Jul 14 22:04:19.068591 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.068547    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd2d903620df9a5213cfff0215004d13c113eb3d2ec30d6627e603f0aac4df3a"} err="failed to get container status \"cd2d903620df9a5213cfff0215004d13c113eb3d2ec30d6627e603f0aac4df3a\": rpc error: code = NotFound desc = could not find container \"cd2d903620df9a5213cfff0215004d13c113eb3d2ec30d6627e603f0aac4df3a\": container with ID starting with cd2d903620df9a5213cfff0215004d13c113eb3d2ec30d6627e603f0aac4df3a not found: ID does not exist"
Jul 14 22:04:19.099822 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.099789    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"]
Jul 14 22:04:19.105924 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.105897    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-9203b7ab-5bdbd8b446-z8zk9"]
Jul 14 22:04:19.968700 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.968651    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:19.979751 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:19.979722    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c04e112a-4514-484b-948f-ad760c1880e3" path="/var/lib/kubelet/pods/c04e112a-4514-484b-948f-ad760c1880e3/volumes"
Jul 14 22:04:20.056275 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:20.056236    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq" event={"ID":"b55ad7f8-e8f3-42b5-b32c-109fe251168f","Type":"ContainerStarted","Data":"b8bdfeb140820af9abee55309d5c5db688db3fba996d53373ade7c13fae20c97"}
Jul 14 22:04:20.865933 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:20.865894    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:20.867036 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:20.867010    2572 patch_prober.go:28] interesting pod/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 14 22:04:20.867176 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:20.867068    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq" podUID="b55ad7f8-e8f3-42b5-b32c-109fe251168f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 14 22:04:21.865719 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:21.865678    2572 patch_prober.go:28] interesting pod/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 14 22:04:21.866226 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:21.865751    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq" podUID="b55ad7f8-e8f3-42b5-b32c-109fe251168f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 14 22:04:22.866200 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:22.866168    2572 patch_prober.go:28] interesting pod/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 14 22:04:22.866578 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:22.866221    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq" podUID="b55ad7f8-e8f3-42b5-b32c-109fe251168f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 14 22:04:23.866345 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:23.866307    2572 patch_prober.go:28] interesting pod/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 14 22:04:23.866742 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:23.866361    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq" podUID="b55ad7f8-e8f3-42b5-b32c-109fe251168f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 14 22:04:24.869272 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:24.869237    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:24.869710 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:24.869628    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:24.870314 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:24.870298    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:25.486443 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:25.486408    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"]
Jul 14 22:04:26.089221 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:26.089181    2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq" secret="" err="secret \"e2e-mt-9203b7ab-openshift-default-dockercfg-spl96\" not found"
Jul 14 22:04:27.093816 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:27.093772    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq" podUID="b55ad7f8-e8f3-42b5-b32c-109fe251168f" containerName="istio-proxy" containerID="cri-o://b8bdfeb140820af9abee55309d5c5db688db3fba996d53373ade7c13fae20c97" gracePeriod=30
Jul 14 22:04:32.361540 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.361476    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:32.473582 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.473549    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-credential-socket\") pod \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") "
Jul 14 22:04:32.473768 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.473600    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-workload-certs\") pod \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") "
Jul 14 22:04:32.473768 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.473639    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-envoy\") pod \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") "
Jul 14 22:04:32.473768 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.473664    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-token\") pod \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") "
Jul 14 22:04:32.473768 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.473707    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-podinfo\") pod \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") "
Jul 14 22:04:32.473768 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.473732    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istiod-ca-cert\") pod \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") "
Jul 14 22:04:32.474039 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.473774    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-workload-socket\") pod \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") "
Jul 14 22:04:32.474039 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.473798    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-data\") pod \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") "
Jul 14 22:04:32.474039 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.473845    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wxhw\" (UniqueName: \"kubernetes.io/projected/b55ad7f8-e8f3-42b5-b32c-109fe251168f-kube-api-access-2wxhw\") pod \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\" (UID: \"b55ad7f8-e8f3-42b5-b32c-109fe251168f\") "
Jul 14 22:04:32.474039 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.473883    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b55ad7f8-e8f3-42b5-b32c-109fe251168f" (UID: "b55ad7f8-e8f3-42b5-b32c-109fe251168f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:04:32.474039 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.473961    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b55ad7f8-e8f3-42b5-b32c-109fe251168f" (UID: "b55ad7f8-e8f3-42b5-b32c-109fe251168f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:04:32.474356 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.474246    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-credential-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:04:32.474356 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.474266    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-workload-certs\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:04:32.474356 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.474245    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b55ad7f8-e8f3-42b5-b32c-109fe251168f" (UID: "b55ad7f8-e8f3-42b5-b32c-109fe251168f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:04:32.474356 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.474335    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b55ad7f8-e8f3-42b5-b32c-109fe251168f" (UID: "b55ad7f8-e8f3-42b5-b32c-109fe251168f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:04:32.474710 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.474679    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-data" (OuterVolumeSpecName: "istio-data") pod "b55ad7f8-e8f3-42b5-b32c-109fe251168f" (UID: "b55ad7f8-e8f3-42b5-b32c-109fe251168f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:04:32.476087 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.476064    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-token" (OuterVolumeSpecName: "istio-token") pod "b55ad7f8-e8f3-42b5-b32c-109fe251168f" (UID: "b55ad7f8-e8f3-42b5-b32c-109fe251168f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:04:32.476256 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.476142    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b55ad7f8-e8f3-42b5-b32c-109fe251168f-kube-api-access-2wxhw" (OuterVolumeSpecName: "kube-api-access-2wxhw") pod "b55ad7f8-e8f3-42b5-b32c-109fe251168f" (UID: "b55ad7f8-e8f3-42b5-b32c-109fe251168f"). InnerVolumeSpecName "kube-api-access-2wxhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:04:32.476441 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.476418    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b55ad7f8-e8f3-42b5-b32c-109fe251168f" (UID: "b55ad7f8-e8f3-42b5-b32c-109fe251168f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:04:32.476545 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.476436    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b55ad7f8-e8f3-42b5-b32c-109fe251168f" (UID: "b55ad7f8-e8f3-42b5-b32c-109fe251168f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 22:04:32.575802 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.575768    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wxhw\" (UniqueName: \"kubernetes.io/projected/b55ad7f8-e8f3-42b5-b32c-109fe251168f-kube-api-access-2wxhw\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:04:32.575802 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.575800    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-envoy\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:04:32.575802 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.575810    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-token\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:04:32.576039 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.575818    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-podinfo\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:04:32.576039 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.575826    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istiod-ca-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:04:32.576039 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.575834    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-workload-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:04:32.576039 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:32.575842    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b55ad7f8-e8f3-42b5-b32c-109fe251168f-istio-data\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:04:33.126966 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:33.126931    2572 generic.go:356] "Generic (PLEG): container finished" podID="b55ad7f8-e8f3-42b5-b32c-109fe251168f" containerID="b8bdfeb140820af9abee55309d5c5db688db3fba996d53373ade7c13fae20c97" exitCode=0
Jul 14 22:04:33.127169 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:33.126987    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"
Jul 14 22:04:33.127169 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:33.126996    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq" event={"ID":"b55ad7f8-e8f3-42b5-b32c-109fe251168f","Type":"ContainerDied","Data":"b8bdfeb140820af9abee55309d5c5db688db3fba996d53373ade7c13fae20c97"}
Jul 14 22:04:33.127169 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:33.127039    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq" event={"ID":"b55ad7f8-e8f3-42b5-b32c-109fe251168f","Type":"ContainerDied","Data":"887982682e0e384c6b4a9ce34e63d6130d30bc23bfeca32bc8124e8a1eb73c86"}
Jul 14 22:04:33.127169 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:33.127060    2572 scope.go:117] "RemoveContainer" containerID="b8bdfeb140820af9abee55309d5c5db688db3fba996d53373ade7c13fae20c97"
Jul 14 22:04:33.136799 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:33.136782    2572 scope.go:117] "RemoveContainer" containerID="58f52451b26696a7472f8597f0b1ecfc17001a68eb81b4102a7aa962ef299114"
Jul 14 22:04:33.147019 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:33.146997    2572 scope.go:117] "RemoveContainer" containerID="b8bdfeb140820af9abee55309d5c5db688db3fba996d53373ade7c13fae20c97"
Jul 14 22:04:33.147492 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:04:33.147465    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8bdfeb140820af9abee55309d5c5db688db3fba996d53373ade7c13fae20c97\": container with ID starting with b8bdfeb140820af9abee55309d5c5db688db3fba996d53373ade7c13fae20c97 not found: ID does not exist" containerID="b8bdfeb140820af9abee55309d5c5db688db3fba996d53373ade7c13fae20c97"
Jul 14 22:04:33.147615 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:33.147500    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8bdfeb140820af9abee55309d5c5db688db3fba996d53373ade7c13fae20c97"} err="failed to get container status \"b8bdfeb140820af9abee55309d5c5db688db3fba996d53373ade7c13fae20c97\": rpc error: code = NotFound desc = could not find container \"b8bdfeb140820af9abee55309d5c5db688db3fba996d53373ade7c13fae20c97\": container with ID starting with b8bdfeb140820af9abee55309d5c5db688db3fba996d53373ade7c13fae20c97 not found: ID does not exist"
Jul 14 22:04:33.147615 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:33.147524    2572 scope.go:117] "RemoveContainer" containerID="58f52451b26696a7472f8597f0b1ecfc17001a68eb81b4102a7aa962ef299114"
Jul 14 22:04:33.147824 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:04:33.147806    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58f52451b26696a7472f8597f0b1ecfc17001a68eb81b4102a7aa962ef299114\": container with ID starting with 58f52451b26696a7472f8597f0b1ecfc17001a68eb81b4102a7aa962ef299114 not found: ID does not exist" containerID="58f52451b26696a7472f8597f0b1ecfc17001a68eb81b4102a7aa962ef299114"
Jul 14 22:04:33.147879 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:33.147830    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58f52451b26696a7472f8597f0b1ecfc17001a68eb81b4102a7aa962ef299114"} err="failed to get container status \"58f52451b26696a7472f8597f0b1ecfc17001a68eb81b4102a7aa962ef299114\": rpc error: code = NotFound desc = could not find container \"58f52451b26696a7472f8597f0b1ecfc17001a68eb81b4102a7aa962ef299114\": container with ID starting with 58f52451b26696a7472f8597f0b1ecfc17001a68eb81b4102a7aa962ef299114 not found: ID does not exist"
Jul 14 22:04:33.151761 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:33.151740    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"]
Jul 14 22:04:33.156802 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:33.156780    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9203b7ab-openshift-default-b5cdcc487-748nq"]
Jul 14 22:04:33.979652 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:33.979615    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b55ad7f8-e8f3-42b5-b32c-109fe251168f" path="/var/lib/kubelet/pods/b55ad7f8-e8f3-42b5-b32c-109fe251168f/volumes"
Jul 14 22:04:47.146042 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.146008    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"]
Jul 14 22:04:47.146457 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.146444    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b55ad7f8-e8f3-42b5-b32c-109fe251168f" containerName="istio-proxy"
Jul 14 22:04:47.146511 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.146459    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b55ad7f8-e8f3-42b5-b32c-109fe251168f" containerName="istio-proxy"
Jul 14 22:04:47.146511 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.146477    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c04e112a-4514-484b-948f-ad760c1880e3" containerName="maas-api"
Jul 14 22:04:47.146511 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.146484    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c04e112a-4514-484b-948f-ad760c1880e3" containerName="maas-api"
Jul 14 22:04:47.146511 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.146500    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b55ad7f8-e8f3-42b5-b32c-109fe251168f" containerName="istio-proxy"
Jul 14 22:04:47.146511 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.146506    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b55ad7f8-e8f3-42b5-b32c-109fe251168f" containerName="istio-proxy"
Jul 14 22:04:47.146682 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.146581    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b55ad7f8-e8f3-42b5-b32c-109fe251168f" containerName="istio-proxy"
Jul 14 22:04:47.146682 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.146595    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c04e112a-4514-484b-948f-ad760c1880e3" containerName="maas-api"
Jul 14 22:04:47.149749 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.149727    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.152964 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.152944    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f2113704-openshift-default-dockercfg-8bxk8\""
Jul 14 22:04:47.171467 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.171443    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"]
Jul 14 22:04:47.304126 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.304071    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd819f5-a4ac-4949-92ec-dc1960940690-istiod-ca-cert\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.304285 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.304138    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-workload-certs\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.304285 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.304176    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-token\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.304285 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.304199    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcvdp\" (UniqueName: \"kubernetes.io/projected/7fd819f5-a4ac-4949-92ec-dc1960940690-kube-api-access-mcvdp\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.304285 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.304234    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-credential-socket\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.304285 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.304255    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-envoy\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.304285 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.304270    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-podinfo\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.304497 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.304327    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-workload-socket\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.304497 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.304352    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-data\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.405311 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.405242    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-workload-certs\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.405311 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.405283    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-token\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.405492 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.405307    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcvdp\" (UniqueName: \"kubernetes.io/projected/7fd819f5-a4ac-4949-92ec-dc1960940690-kube-api-access-mcvdp\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.405492 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.405346    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-credential-socket\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.405492 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.405374    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-envoy\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.405492 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.405400    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-podinfo\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.405492 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.405437    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-workload-socket\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.405492 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.405469    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-data\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.405796 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.405566    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd819f5-a4ac-4949-92ec-dc1960940690-istiod-ca-cert\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.405796 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.405655    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-workload-certs\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.405796 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.405761    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-credential-socket\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.405982 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.405951    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-workload-socket\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.406258 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.406236    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd819f5-a4ac-4949-92ec-dc1960940690-istiod-ca-cert\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.406471 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.406453    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-data\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.408133 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.408098    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-envoy\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.408375 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.408354    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-podinfo\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.424753 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.424723    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-token\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.425458 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.425440    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcvdp\" (UniqueName: \"kubernetes.io/projected/7fd819f5-a4ac-4949-92ec-dc1960940690-kube-api-access-mcvdp\") pod \"e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") " pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.459887 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.459869    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:47.605147 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.605080    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"]
Jul 14 22:04:47.606090 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:04:47.606065    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd819f5_a4ac_4949_92ec_dc1960940690.slice/crio-bc72f53757f32b2543d8dc53d247af6800011c02ab83a4d65c39a346d5d9f337 WatchSource:0}: Error finding container bc72f53757f32b2543d8dc53d247af6800011c02ab83a4d65c39a346d5d9f337: Status 404 returned error can't find the container with id bc72f53757f32b2543d8dc53d247af6800011c02ab83a4d65c39a346d5d9f337
Jul 14 22:04:47.608675 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.608637    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:04:47.608766 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.608707    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:04:47.608766 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:47.608740    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:04:48.208399 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:48.208361    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr" event={"ID":"7fd819f5-a4ac-4949-92ec-dc1960940690","Type":"ContainerStarted","Data":"6a994fb85d68f9eb37b28f5598c2d2271f42d11d27995da4a21fecc5a5bd07cb"}
Jul 14 22:04:48.208755 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:48.208420    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr" event={"ID":"7fd819f5-a4ac-4949-92ec-dc1960940690","Type":"ContainerStarted","Data":"bc72f53757f32b2543d8dc53d247af6800011c02ab83a4d65c39a346d5d9f337"}
Jul 14 22:04:48.232517 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:48.232471    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr" podStartSLOduration=1.232446715 podStartE2EDuration="1.232446715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:04:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:04:48.231170208 +0000 UTC m=+1626.716262860" watchObservedRunningTime="2026-07-14 22:04:48.232446715 +0000 UTC m=+1626.717539366"
Jul 14 22:04:48.460992 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:48.460930    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:48.462411 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:48.462386    2572 patch_prober.go:28] interesting pod/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 14 22:04:48.462550 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:48.462437    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr" podUID="7fd819f5-a4ac-4949-92ec-dc1960940690" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 14 22:04:49.464313 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:49.464285    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:50.219192 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.219169    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:50.219932 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.219914    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:04:50.499355 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.499283    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"]
Jul 14 22:04:50.499801 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.499788    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b55ad7f8-e8f3-42b5-b32c-109fe251168f" containerName="istio-proxy"
Jul 14 22:04:50.502970 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.502952    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:04:50.505661 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.505638    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-f2113704-serving-cert\""
Jul 14 22:04:50.513158 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.513133    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"]
Jul 14 22:04:50.533576 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.533554    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9334e39f-9b44-4ef7-b820-8ca06d554d73-maas-api-tls\") pod \"maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn\" (UID: \"9334e39f-9b44-4ef7-b820-8ca06d554d73\") " pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:04:50.533705 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.533610    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9334e39f-9b44-4ef7-b820-8ca06d554d73-openshift-service-ca\") pod \"maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn\" (UID: \"9334e39f-9b44-4ef7-b820-8ca06d554d73\") " pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:04:50.533705 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.533658    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnbdq\" (UniqueName: \"kubernetes.io/projected/9334e39f-9b44-4ef7-b820-8ca06d554d73-kube-api-access-tnbdq\") pod \"maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn\" (UID: \"9334e39f-9b44-4ef7-b820-8ca06d554d73\") " pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:04:50.634312 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.634286    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9334e39f-9b44-4ef7-b820-8ca06d554d73-maas-api-tls\") pod \"maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn\" (UID: \"9334e39f-9b44-4ef7-b820-8ca06d554d73\") " pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:04:50.634418 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.634339    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9334e39f-9b44-4ef7-b820-8ca06d554d73-openshift-service-ca\") pod \"maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn\" (UID: \"9334e39f-9b44-4ef7-b820-8ca06d554d73\") " pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:04:50.634418 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.634378    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnbdq\" (UniqueName: \"kubernetes.io/projected/9334e39f-9b44-4ef7-b820-8ca06d554d73-kube-api-access-tnbdq\") pod \"maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn\" (UID: \"9334e39f-9b44-4ef7-b820-8ca06d554d73\") " pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:04:50.634538 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:04:50.634453    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-f2113704-serving-cert: secret "maas-api-e2e-mt-f2113704-serving-cert" not found
Jul 14 22:04:50.634594 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:04:50.634541    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9334e39f-9b44-4ef7-b820-8ca06d554d73-maas-api-tls podName:9334e39f-9b44-4ef7-b820-8ca06d554d73 nodeName:}" failed. No retries permitted until 2026-07-14 22:04:51.13451851 +0000 UTC m=+1629.619611155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9334e39f-9b44-4ef7-b820-8ca06d554d73-maas-api-tls") pod "maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn" (UID: "9334e39f-9b44-4ef7-b820-8ca06d554d73") : secret "maas-api-e2e-mt-f2113704-serving-cert" not found
Jul 14 22:04:50.634961 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.634942    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9334e39f-9b44-4ef7-b820-8ca06d554d73-openshift-service-ca\") pod \"maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn\" (UID: \"9334e39f-9b44-4ef7-b820-8ca06d554d73\") " pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:04:50.646361 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:50.646341    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnbdq\" (UniqueName: \"kubernetes.io/projected/9334e39f-9b44-4ef7-b820-8ca06d554d73-kube-api-access-tnbdq\") pod \"maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn\" (UID: \"9334e39f-9b44-4ef7-b820-8ca06d554d73\") " pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:04:51.139017 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:51.138988    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9334e39f-9b44-4ef7-b820-8ca06d554d73-maas-api-tls\") pod \"maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn\" (UID: \"9334e39f-9b44-4ef7-b820-8ca06d554d73\") " pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:04:51.141464 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:51.141439    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9334e39f-9b44-4ef7-b820-8ca06d554d73-maas-api-tls\") pod \"maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn\" (UID: \"9334e39f-9b44-4ef7-b820-8ca06d554d73\") " pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:04:51.415256 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:51.415180    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:04:51.558307 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:51.558277    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"]
Jul 14 22:04:51.559967 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:04:51.559943    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9334e39f_9b44_4ef7_b820_8ca06d554d73.slice/crio-a4ee32bde458bf8e210a9b684c9efc4f9ddae936dc9d4c0ebf82eb3f409fccbe WatchSource:0}: Error finding container a4ee32bde458bf8e210a9b684c9efc4f9ddae936dc9d4c0ebf82eb3f409fccbe: Status 404 returned error can't find the container with id a4ee32bde458bf8e210a9b684c9efc4f9ddae936dc9d4c0ebf82eb3f409fccbe
Jul 14 22:04:52.230473 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:52.230389    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn" event={"ID":"9334e39f-9b44-4ef7-b820-8ca06d554d73","Type":"ContainerStarted","Data":"a4a7e622aba85c977b32ae0dee93a00fffc3ca8b9adbf59b57ddd71feebc22b6"}
Jul 14 22:04:52.230473 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:52.230446    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn" event={"ID":"9334e39f-9b44-4ef7-b820-8ca06d554d73","Type":"ContainerStarted","Data":"a4ee32bde458bf8e210a9b684c9efc4f9ddae936dc9d4c0ebf82eb3f409fccbe"}
Jul 14 22:04:52.230663 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:52.230575    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:04:52.253262 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:52.253223    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn" podStartSLOduration=1.900820146 podStartE2EDuration="2.253208184s" totalImagesPullingTime="352.388038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:04:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:04:52.251708823 +0000 UTC m=+1630.736801503" watchObservedRunningTime="2026-07-14 22:04:52.253208184 +0000 UTC m=+1630.738300836"
Jul 14 22:04:58.247764 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:04:58.247731    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:05:02.292830 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:02.292802    2572 generic.go:356] "Generic (PLEG): container finished" podID="7fd819f5-a4ac-4949-92ec-dc1960940690" containerID="6a994fb85d68f9eb37b28f5598c2d2271f42d11d27995da4a21fecc5a5bd07cb" exitCode=0
Jul 14 22:05:02.293178 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:02.292868    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr" event={"ID":"7fd819f5-a4ac-4949-92ec-dc1960940690","Type":"ContainerDied","Data":"6a994fb85d68f9eb37b28f5598c2d2271f42d11d27995da4a21fecc5a5bd07cb"}
Jul 14 22:05:02.293281 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:02.293268    2572 scope.go:117] "RemoveContainer" containerID="6a994fb85d68f9eb37b28f5598c2d2271f42d11d27995da4a21fecc5a5bd07cb"
Jul 14 22:05:02.294251 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:02.294227    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:05:02.294306 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:02.294288    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:05:02.294407 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:02.294321    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:05:03.300069 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:03.300032    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr" event={"ID":"7fd819f5-a4ac-4949-92ec-dc1960940690","Type":"ContainerStarted","Data":"f352fd030484d2da66a0b5b97049720ce172b45f31c3bdfc8b19996b5116aa0d"}
Jul 14 22:05:03.460991 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:03.460957    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:05:03.462200 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:03.462174    2572 patch_prober.go:28] interesting pod/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 14 22:05:03.462320 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:03.462234    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr" podUID="7fd819f5-a4ac-4949-92ec-dc1960940690" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 14 22:05:04.460560 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:04.460528    2572 patch_prober.go:28] interesting pod/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 14 22:05:04.460989 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:04.460574    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr" podUID="7fd819f5-a4ac-4949-92ec-dc1960940690" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 14 22:05:05.220070 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:05.220035    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:05:05.460598 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:05.460569    2572 patch_prober.go:28] interesting pod/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 14 22:05:05.460959 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:05.460618    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr" podUID="7fd819f5-a4ac-4949-92ec-dc1960940690" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 14 22:05:06.460592 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:06.460561    2572 patch_prober.go:28] interesting pod/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 14 22:05:06.460764 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:06.460609    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr" podUID="7fd819f5-a4ac-4949-92ec-dc1960940690" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 14 22:05:07.464087 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:07.464056    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:05:07.465073 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:07.465058    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:05:33.693853 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:33.693819    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"]
Jul 14 22:05:33.694329 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:33.694031    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn" podUID="9334e39f-9b44-4ef7-b820-8ca06d554d73" containerName="maas-api" containerID="cri-o://a4a7e622aba85c977b32ae0dee93a00fffc3ca8b9adbf59b57ddd71feebc22b6" gracePeriod=30
Jul 14 22:05:33.946442 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:33.946385    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:05:34.110149 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.110100    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9334e39f-9b44-4ef7-b820-8ca06d554d73-openshift-service-ca\") pod \"9334e39f-9b44-4ef7-b820-8ca06d554d73\" (UID: \"9334e39f-9b44-4ef7-b820-8ca06d554d73\") "
Jul 14 22:05:34.110287 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.110177    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9334e39f-9b44-4ef7-b820-8ca06d554d73-maas-api-tls\") pod \"9334e39f-9b44-4ef7-b820-8ca06d554d73\" (UID: \"9334e39f-9b44-4ef7-b820-8ca06d554d73\") "
Jul 14 22:05:34.110287 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.110249    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnbdq\" (UniqueName: \"kubernetes.io/projected/9334e39f-9b44-4ef7-b820-8ca06d554d73-kube-api-access-tnbdq\") pod \"9334e39f-9b44-4ef7-b820-8ca06d554d73\" (UID: \"9334e39f-9b44-4ef7-b820-8ca06d554d73\") "
Jul 14 22:05:34.110399 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.110374    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9334e39f-9b44-4ef7-b820-8ca06d554d73-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9334e39f-9b44-4ef7-b820-8ca06d554d73" (UID: "9334e39f-9b44-4ef7-b820-8ca06d554d73"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:05:34.110497 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.110481    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9334e39f-9b44-4ef7-b820-8ca06d554d73-openshift-service-ca\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:05:34.112134 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.112090    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9334e39f-9b44-4ef7-b820-8ca06d554d73-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9334e39f-9b44-4ef7-b820-8ca06d554d73" (UID: "9334e39f-9b44-4ef7-b820-8ca06d554d73"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:05:34.112232 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.112199    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9334e39f-9b44-4ef7-b820-8ca06d554d73-kube-api-access-tnbdq" (OuterVolumeSpecName: "kube-api-access-tnbdq") pod "9334e39f-9b44-4ef7-b820-8ca06d554d73" (UID: "9334e39f-9b44-4ef7-b820-8ca06d554d73"). InnerVolumeSpecName "kube-api-access-tnbdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:05:34.211757 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.211697    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnbdq\" (UniqueName: \"kubernetes.io/projected/9334e39f-9b44-4ef7-b820-8ca06d554d73-kube-api-access-tnbdq\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:05:34.211757 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.211728    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9334e39f-9b44-4ef7-b820-8ca06d554d73-maas-api-tls\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:05:34.465138 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.465066    2572 generic.go:356] "Generic (PLEG): container finished" podID="9334e39f-9b44-4ef7-b820-8ca06d554d73" containerID="a4a7e622aba85c977b32ae0dee93a00fffc3ca8b9adbf59b57ddd71feebc22b6" exitCode=0
Jul 14 22:05:34.465138 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.465123    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"
Jul 14 22:05:34.465297 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.465140    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn" event={"ID":"9334e39f-9b44-4ef7-b820-8ca06d554d73","Type":"ContainerDied","Data":"a4a7e622aba85c977b32ae0dee93a00fffc3ca8b9adbf59b57ddd71feebc22b6"}
Jul 14 22:05:34.465297 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.465208    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn" event={"ID":"9334e39f-9b44-4ef7-b820-8ca06d554d73","Type":"ContainerDied","Data":"a4ee32bde458bf8e210a9b684c9efc4f9ddae936dc9d4c0ebf82eb3f409fccbe"}
Jul 14 22:05:34.465297 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.465238    2572 scope.go:117] "RemoveContainer" containerID="a4a7e622aba85c977b32ae0dee93a00fffc3ca8b9adbf59b57ddd71feebc22b6"
Jul 14 22:05:34.474830 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.474813    2572 scope.go:117] "RemoveContainer" containerID="a4a7e622aba85c977b32ae0dee93a00fffc3ca8b9adbf59b57ddd71feebc22b6"
Jul 14 22:05:34.475067 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:05:34.475046    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4a7e622aba85c977b32ae0dee93a00fffc3ca8b9adbf59b57ddd71feebc22b6\": container with ID starting with a4a7e622aba85c977b32ae0dee93a00fffc3ca8b9adbf59b57ddd71feebc22b6 not found: ID does not exist" containerID="a4a7e622aba85c977b32ae0dee93a00fffc3ca8b9adbf59b57ddd71feebc22b6"
Jul 14 22:05:34.475167 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.475077    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a7e622aba85c977b32ae0dee93a00fffc3ca8b9adbf59b57ddd71feebc22b6"} err="failed to get container status \"a4a7e622aba85c977b32ae0dee93a00fffc3ca8b9adbf59b57ddd71feebc22b6\": rpc error: code = NotFound desc = could not find container \"a4a7e622aba85c977b32ae0dee93a00fffc3ca8b9adbf59b57ddd71feebc22b6\": container with ID starting with a4a7e622aba85c977b32ae0dee93a00fffc3ca8b9adbf59b57ddd71feebc22b6 not found: ID does not exist"
Jul 14 22:05:34.488930 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.488886    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"]
Jul 14 22:05:34.490985 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:34.490960    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-f2113704-64d7d7d6f6-w4vpn"]
Jul 14 22:05:35.979785 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:05:35.979751    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9334e39f-9b44-4ef7-b820-8ca06d554d73" path="/var/lib/kubelet/pods/9334e39f-9b44-4ef7-b820-8ca06d554d73/volumes"
Jul 14 22:06:28.472404 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:28.472376    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"]
Jul 14 22:06:28.472980 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:28.472605    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr" podUID="7fd819f5-a4ac-4949-92ec-dc1960940690" containerName="istio-proxy" containerID="cri-o://f352fd030484d2da66a0b5b97049720ce172b45f31c3bdfc8b19996b5116aa0d" gracePeriod=30
Jul 14 22:06:33.725836 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.725812    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:06:33.770238 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.770209    2572 generic.go:356] "Generic (PLEG): container finished" podID="7fd819f5-a4ac-4949-92ec-dc1960940690" containerID="f352fd030484d2da66a0b5b97049720ce172b45f31c3bdfc8b19996b5116aa0d" exitCode=0
Jul 14 22:06:33.770373 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.770259    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr" event={"ID":"7fd819f5-a4ac-4949-92ec-dc1960940690","Type":"ContainerDied","Data":"f352fd030484d2da66a0b5b97049720ce172b45f31c3bdfc8b19996b5116aa0d"}
Jul 14 22:06:33.770373 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.770274    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"
Jul 14 22:06:33.770373 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.770313    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr" event={"ID":"7fd819f5-a4ac-4949-92ec-dc1960940690","Type":"ContainerDied","Data":"bc72f53757f32b2543d8dc53d247af6800011c02ab83a4d65c39a346d5d9f337"}
Jul 14 22:06:33.770373 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.770337    2572 scope.go:117] "RemoveContainer" containerID="f352fd030484d2da66a0b5b97049720ce172b45f31c3bdfc8b19996b5116aa0d"
Jul 14 22:06:33.778815 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.778799    2572 scope.go:117] "RemoveContainer" containerID="6a994fb85d68f9eb37b28f5598c2d2271f42d11d27995da4a21fecc5a5bd07cb"
Jul 14 22:06:33.786586 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.786570    2572 scope.go:117] "RemoveContainer" containerID="f352fd030484d2da66a0b5b97049720ce172b45f31c3bdfc8b19996b5116aa0d"
Jul 14 22:06:33.786783 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:06:33.786762    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f352fd030484d2da66a0b5b97049720ce172b45f31c3bdfc8b19996b5116aa0d\": container with ID starting with f352fd030484d2da66a0b5b97049720ce172b45f31c3bdfc8b19996b5116aa0d not found: ID does not exist" containerID="f352fd030484d2da66a0b5b97049720ce172b45f31c3bdfc8b19996b5116aa0d"
Jul 14 22:06:33.786852 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.786796    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f352fd030484d2da66a0b5b97049720ce172b45f31c3bdfc8b19996b5116aa0d"} err="failed to get container status \"f352fd030484d2da66a0b5b97049720ce172b45f31c3bdfc8b19996b5116aa0d\": rpc error: code = NotFound desc = could not find container \"f352fd030484d2da66a0b5b97049720ce172b45f31c3bdfc8b19996b5116aa0d\": container with ID starting with f352fd030484d2da66a0b5b97049720ce172b45f31c3bdfc8b19996b5116aa0d not found: ID does not exist"
Jul 14 22:06:33.786852 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.786819    2572 scope.go:117] "RemoveContainer" containerID="6a994fb85d68f9eb37b28f5598c2d2271f42d11d27995da4a21fecc5a5bd07cb"
Jul 14 22:06:33.787030 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:06:33.787011    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a994fb85d68f9eb37b28f5598c2d2271f42d11d27995da4a21fecc5a5bd07cb\": container with ID starting with 6a994fb85d68f9eb37b28f5598c2d2271f42d11d27995da4a21fecc5a5bd07cb not found: ID does not exist" containerID="6a994fb85d68f9eb37b28f5598c2d2271f42d11d27995da4a21fecc5a5bd07cb"
Jul 14 22:06:33.787075 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.787036    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a994fb85d68f9eb37b28f5598c2d2271f42d11d27995da4a21fecc5a5bd07cb"} err="failed to get container status \"6a994fb85d68f9eb37b28f5598c2d2271f42d11d27995da4a21fecc5a5bd07cb\": rpc error: code = NotFound desc = could not find container \"6a994fb85d68f9eb37b28f5598c2d2271f42d11d27995da4a21fecc5a5bd07cb\": container with ID starting with 6a994fb85d68f9eb37b28f5598c2d2271f42d11d27995da4a21fecc5a5bd07cb not found: ID does not exist"
Jul 14 22:06:33.899799 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.899774    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd819f5-a4ac-4949-92ec-dc1960940690-istiod-ca-cert\") pod \"7fd819f5-a4ac-4949-92ec-dc1960940690\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") "
Jul 14 22:06:33.899897 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.899807    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-workload-socket\") pod \"7fd819f5-a4ac-4949-92ec-dc1960940690\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") "
Jul 14 22:06:33.899897 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.899832    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-token\") pod \"7fd819f5-a4ac-4949-92ec-dc1960940690\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") "
Jul 14 22:06:33.899897 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.899846    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-envoy\") pod \"7fd819f5-a4ac-4949-92ec-dc1960940690\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") "
Jul 14 22:06:33.899897 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.899869    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-workload-certs\") pod \"7fd819f5-a4ac-4949-92ec-dc1960940690\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") "
Jul 14 22:06:33.900099 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.899943    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcvdp\" (UniqueName: \"kubernetes.io/projected/7fd819f5-a4ac-4949-92ec-dc1960940690-kube-api-access-mcvdp\") pod \"7fd819f5-a4ac-4949-92ec-dc1960940690\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") "
Jul 14 22:06:33.900099 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.900002    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-podinfo\") pod \"7fd819f5-a4ac-4949-92ec-dc1960940690\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") "
Jul 14 22:06:33.900099 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.900040    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-data\") pod \"7fd819f5-a4ac-4949-92ec-dc1960940690\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") "
Jul 14 22:06:33.900099 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.900078    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-credential-socket\") pod \"7fd819f5-a4ac-4949-92ec-dc1960940690\" (UID: \"7fd819f5-a4ac-4949-92ec-dc1960940690\") "
Jul 14 22:06:33.900348 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.900091    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7fd819f5-a4ac-4949-92ec-dc1960940690" (UID: "7fd819f5-a4ac-4949-92ec-dc1960940690"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:06:33.900348 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.900162    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fd819f5-a4ac-4949-92ec-dc1960940690-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7fd819f5-a4ac-4949-92ec-dc1960940690" (UID: "7fd819f5-a4ac-4949-92ec-dc1960940690"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:06:33.900348 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.900258    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7fd819f5-a4ac-4949-92ec-dc1960940690" (UID: "7fd819f5-a4ac-4949-92ec-dc1960940690"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:06:33.900523 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.900445    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7fd819f5-a4ac-4949-92ec-dc1960940690" (UID: "7fd819f5-a4ac-4949-92ec-dc1960940690"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:06:33.900523 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.900461    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd819f5-a4ac-4949-92ec-dc1960940690-istiod-ca-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:06:33.900523 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.900489    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-workload-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:06:33.900523 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.900521    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-workload-certs\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:06:33.901065 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.901037    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-data" (OuterVolumeSpecName: "istio-data") pod "7fd819f5-a4ac-4949-92ec-dc1960940690" (UID: "7fd819f5-a4ac-4949-92ec-dc1960940690"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:06:33.901944 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.901920    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7fd819f5-a4ac-4949-92ec-dc1960940690" (UID: "7fd819f5-a4ac-4949-92ec-dc1960940690"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:06:33.902079 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.902059    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-token" (OuterVolumeSpecName: "istio-token") pod "7fd819f5-a4ac-4949-92ec-dc1960940690" (UID: "7fd819f5-a4ac-4949-92ec-dc1960940690"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:06:33.902225 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.902204    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fd819f5-a4ac-4949-92ec-dc1960940690-kube-api-access-mcvdp" (OuterVolumeSpecName: "kube-api-access-mcvdp") pod "7fd819f5-a4ac-4949-92ec-dc1960940690" (UID: "7fd819f5-a4ac-4949-92ec-dc1960940690"). InnerVolumeSpecName "kube-api-access-mcvdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:06:33.902424 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:33.902394    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7fd819f5-a4ac-4949-92ec-dc1960940690" (UID: "7fd819f5-a4ac-4949-92ec-dc1960940690"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 22:06:34.001241 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:34.001217    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcvdp\" (UniqueName: \"kubernetes.io/projected/7fd819f5-a4ac-4949-92ec-dc1960940690-kube-api-access-mcvdp\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:06:34.001241 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:34.001238    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-podinfo\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:06:34.001420 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:34.001248    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-data\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:06:34.001420 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:34.001256    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-credential-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:06:34.001420 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:34.001263    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-token\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:06:34.001420 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:34.001272    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd819f5-a4ac-4949-92ec-dc1960940690-istio-envoy\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:06:34.088943 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:34.088860    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"]
Jul 14 22:06:34.093510 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:34.093483    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f2113704-openshift-default-676c85c75f-8qpkr"]
Jul 14 22:06:35.978777 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:06:35.978748    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fd819f5-a4ac-4949-92ec-dc1960940690" path="/var/lib/kubelet/pods/7fd819f5-a4ac-4949-92ec-dc1960940690/volumes"
Jul 14 22:07:25.427472 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.427432    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"]
Jul 14 22:07:25.428167 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.428150    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fd819f5-a4ac-4949-92ec-dc1960940690" containerName="istio-proxy"
Jul 14 22:07:25.428235 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.428168    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fd819f5-a4ac-4949-92ec-dc1960940690" containerName="istio-proxy"
Jul 14 22:07:25.428235 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.428177    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9334e39f-9b44-4ef7-b820-8ca06d554d73" containerName="maas-api"
Jul 14 22:07:25.428235 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.428183    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9334e39f-9b44-4ef7-b820-8ca06d554d73" containerName="maas-api"
Jul 14 22:07:25.428235 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.428188    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fd819f5-a4ac-4949-92ec-dc1960940690" containerName="istio-proxy"
Jul 14 22:07:25.428235 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.428195    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fd819f5-a4ac-4949-92ec-dc1960940690" containerName="istio-proxy"
Jul 14 22:07:25.428397 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.428267    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9334e39f-9b44-4ef7-b820-8ca06d554d73" containerName="maas-api"
Jul 14 22:07:25.428397 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.428274    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fd819f5-a4ac-4949-92ec-dc1960940690" containerName="istio-proxy"
Jul 14 22:07:25.431399 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.431383    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.433899 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.433877    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-f62700-openshift-default-dockercfg-s8f69\""
Jul 14 22:07:25.442444 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.442422    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"]
Jul 14 22:07:25.552704 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.552675    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-token\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.552877 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.552723    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-workload-certs\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.552877 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.552752    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8568971f-9f31-48e5-97ff-9fcab168cb51-istiod-ca-cert\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.552877 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.552784    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-workload-socket\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.552877 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.552808    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-data\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.552877 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.552826    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gpm4\" (UniqueName: \"kubernetes.io/projected/8568971f-9f31-48e5-97ff-9fcab168cb51-kube-api-access-7gpm4\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.553047 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.552883    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-credential-socket\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.553047 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.552920    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-envoy\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.553047 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.552951    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-podinfo\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.654195 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.654167    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-token\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.654354 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.654211    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-workload-certs\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.654354 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.654227    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8568971f-9f31-48e5-97ff-9fcab168cb51-istiod-ca-cert\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.654464 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.654341    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-workload-socket\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.654464 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.654385    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-data\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.654464 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.654406    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gpm4\" (UniqueName: \"kubernetes.io/projected/8568971f-9f31-48e5-97ff-9fcab168cb51-kube-api-access-7gpm4\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.654464 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.654451    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-credential-socket\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.654742 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.654503    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-envoy\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.654742 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.654526    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-podinfo\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.654742 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.654642    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-workload-certs\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.654742 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.654711    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-workload-socket\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.654955 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.654751    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-data\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.654955 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.654808    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-credential-socket\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.654955 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.654904    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8568971f-9f31-48e5-97ff-9fcab168cb51-istiod-ca-cert\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.657477 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.657458    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-envoy\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.657596 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.657492    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-podinfo\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.663355 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.663330    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-token\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.663544 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.663528    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gpm4\" (UniqueName: \"kubernetes.io/projected/8568971f-9f31-48e5-97ff-9fcab168cb51-kube-api-access-7gpm4\") pod \"e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") " pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.742927 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.742878    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:25.882027 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.882003    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"]
Jul 14 22:07:25.888668 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.888624    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:07:25.888766 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.888719    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:07:25.888817 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:25.888794    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:07:26.047198 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:26.047147    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2" event={"ID":"8568971f-9f31-48e5-97ff-9fcab168cb51","Type":"ContainerStarted","Data":"88b20b20759483635ec4c8be9ade4d27e519a76f7c636b88d487b18cf5455ce6"}
Jul 14 22:07:26.047378 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:26.047230    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2" event={"ID":"8568971f-9f31-48e5-97ff-9fcab168cb51","Type":"ContainerStarted","Data":"70a0ecf4d92276a707a77b26c85840e1849d5d7b1552352ff5eec38fd68824c1"}
Jul 14 22:07:26.070627 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:26.070576    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2" podStartSLOduration=1.070558248 podStartE2EDuration="1.070558248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:07:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:07:26.06935083 +0000 UTC m=+1784.554443484" watchObservedRunningTime="2026-07-14 22:07:26.070558248 +0000 UTC m=+1784.555650901"
Jul 14 22:07:26.743708 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:26.743672    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:26.748322 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:26.748297    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:27.052992 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:27.052960    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:27.054003 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:27.053984    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:28.149549 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.149513    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"]
Jul 14 22:07:28.153824 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.150760    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fd819f5-a4ac-4949-92ec-dc1960940690" containerName="istio-proxy"
Jul 14 22:07:28.157187 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.156042    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:07:28.159994 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.159971    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-f62700-serving-cert\""
Jul 14 22:07:28.165967 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.165946    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"]
Jul 14 22:07:28.280420 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.280385    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5kll\" (UniqueName: \"kubernetes.io/projected/782fa045-7bac-4fb6-b907-bec5b0f39714-kube-api-access-w5kll\") pod \"maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5\" (UID: \"782fa045-7bac-4fb6-b907-bec5b0f39714\") " pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:07:28.280596 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.280506    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/782fa045-7bac-4fb6-b907-bec5b0f39714-maas-api-tls\") pod \"maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5\" (UID: \"782fa045-7bac-4fb6-b907-bec5b0f39714\") " pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:07:28.280640 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.280608    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/782fa045-7bac-4fb6-b907-bec5b0f39714-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5\" (UID: \"782fa045-7bac-4fb6-b907-bec5b0f39714\") " pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:07:28.382065 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.382033    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/782fa045-7bac-4fb6-b907-bec5b0f39714-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5\" (UID: \"782fa045-7bac-4fb6-b907-bec5b0f39714\") " pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:07:28.382278 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.382083    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5kll\" (UniqueName: \"kubernetes.io/projected/782fa045-7bac-4fb6-b907-bec5b0f39714-kube-api-access-w5kll\") pod \"maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5\" (UID: \"782fa045-7bac-4fb6-b907-bec5b0f39714\") " pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:07:28.382278 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.382151    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/782fa045-7bac-4fb6-b907-bec5b0f39714-maas-api-tls\") pod \"maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5\" (UID: \"782fa045-7bac-4fb6-b907-bec5b0f39714\") " pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:07:28.382721 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.382691    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/782fa045-7bac-4fb6-b907-bec5b0f39714-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5\" (UID: \"782fa045-7bac-4fb6-b907-bec5b0f39714\") " pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:07:28.384533 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.384514    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/782fa045-7bac-4fb6-b907-bec5b0f39714-maas-api-tls\") pod \"maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5\" (UID: \"782fa045-7bac-4fb6-b907-bec5b0f39714\") " pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:07:28.392440 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.392419    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5kll\" (UniqueName: \"kubernetes.io/projected/782fa045-7bac-4fb6-b907-bec5b0f39714-kube-api-access-w5kll\") pod \"maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5\" (UID: \"782fa045-7bac-4fb6-b907-bec5b0f39714\") " pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:07:28.469672 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.469585    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:07:28.609593 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.609573    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"]
Jul 14 22:07:28.611571 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:07:28.611531    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782fa045_7bac_4fb6_b907_bec5b0f39714.slice/crio-6d1c66bebde0858f7174993db65d3537b74aa9690174446ef1c0ab91cba45c64 WatchSource:0}: Error finding container 6d1c66bebde0858f7174993db65d3537b74aa9690174446ef1c0ab91cba45c64: Status 404 returned error can't find the container with id 6d1c66bebde0858f7174993db65d3537b74aa9690174446ef1c0ab91cba45c64
Jul 14 22:07:28.613030 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:28.613011    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 22:07:29.063985 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:29.063948    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5" event={"ID":"782fa045-7bac-4fb6-b907-bec5b0f39714","Type":"ContainerStarted","Data":"6d1c66bebde0858f7174993db65d3537b74aa9690174446ef1c0ab91cba45c64"}
Jul 14 22:07:31.076197 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:31.076162    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5" event={"ID":"782fa045-7bac-4fb6-b907-bec5b0f39714","Type":"ContainerStarted","Data":"9c5f5980961eb58faac17e602816243a41c950bebee4d6536238ce2151339463"}
Jul 14 22:07:31.076808 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:31.076296    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:07:31.096679 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:31.096629    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5" podStartSLOduration=1.486411034 podStartE2EDuration="3.096613582s" totalImagesPullingTime="1.610202548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:07:31.095047661 +0000 UTC m=+1789.580140315" watchObservedRunningTime="2026-07-14 22:07:31.096613582 +0000 UTC m=+1789.581706234"
Jul 14 22:07:37.088136 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:37.088035    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:07:39.384940 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.384850    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"]
Jul 14 22:07:39.389098 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.389075    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:07:39.391877 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.391855    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-5c6d83-serving-cert\""
Jul 14 22:07:39.400792 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.400767    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"]
Jul 14 22:07:39.485729 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.485688    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ff34d3-9319-41ca-a634-efdb48461819-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7\" (UID: \"97ff34d3-9319-41ca-a634-efdb48461819\") " pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:07:39.485906 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.485757    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97ff34d3-9319-41ca-a634-efdb48461819-maas-api-tls\") pod \"maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7\" (UID: \"97ff34d3-9319-41ca-a634-efdb48461819\") " pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:07:39.485906 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.485798    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mkrj\" (UniqueName: \"kubernetes.io/projected/97ff34d3-9319-41ca-a634-efdb48461819-kube-api-access-8mkrj\") pod \"maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7\" (UID: \"97ff34d3-9319-41ca-a634-efdb48461819\") " pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:07:39.586725 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.586691    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ff34d3-9319-41ca-a634-efdb48461819-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7\" (UID: \"97ff34d3-9319-41ca-a634-efdb48461819\") " pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:07:39.586891 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.586748    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97ff34d3-9319-41ca-a634-efdb48461819-maas-api-tls\") pod \"maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7\" (UID: \"97ff34d3-9319-41ca-a634-efdb48461819\") " pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:07:39.586891 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.586776    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mkrj\" (UniqueName: \"kubernetes.io/projected/97ff34d3-9319-41ca-a634-efdb48461819-kube-api-access-8mkrj\") pod \"maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7\" (UID: \"97ff34d3-9319-41ca-a634-efdb48461819\") " pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:07:39.587401 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.587378    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ff34d3-9319-41ca-a634-efdb48461819-openshift-service-ca\") pod \"maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7\" (UID: \"97ff34d3-9319-41ca-a634-efdb48461819\") " pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:07:39.589240 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.589215    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97ff34d3-9319-41ca-a634-efdb48461819-maas-api-tls\") pod \"maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7\" (UID: \"97ff34d3-9319-41ca-a634-efdb48461819\") " pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:07:39.596249 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.596223    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mkrj\" (UniqueName: \"kubernetes.io/projected/97ff34d3-9319-41ca-a634-efdb48461819-kube-api-access-8mkrj\") pod \"maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7\" (UID: \"97ff34d3-9319-41ca-a634-efdb48461819\") " pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:07:39.703756 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.703668    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:07:39.890637 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:39.890597    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"]
Jul 14 22:07:39.892895 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:07:39.892865    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ff34d3_9319_41ca_a634_efdb48461819.slice/crio-dfeba3fdfe315379b79f5459a4aea5eb43a1b44a066d06a030638ccc1c3b71c2 WatchSource:0}: Error finding container dfeba3fdfe315379b79f5459a4aea5eb43a1b44a066d06a030638ccc1c3b71c2: Status 404 returned error can't find the container with id dfeba3fdfe315379b79f5459a4aea5eb43a1b44a066d06a030638ccc1c3b71c2
Jul 14 22:07:40.128588 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:40.128551    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7" event={"ID":"97ff34d3-9319-41ca-a634-efdb48461819","Type":"ContainerStarted","Data":"dfeba3fdfe315379b79f5459a4aea5eb43a1b44a066d06a030638ccc1c3b71c2"}
Jul 14 22:07:41.135557 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:41.135517    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7" event={"ID":"97ff34d3-9319-41ca-a634-efdb48461819","Type":"ContainerStarted","Data":"e1b8f83e4e46d2bd4844bc72d4960beb25d598afa6d6ad1f1d7faf5e3538c92a"}
Jul 14 22:07:41.135908 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:41.135583    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:07:41.164148 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:41.164084    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7" podStartSLOduration=1.753219847 podStartE2EDuration="2.164069747s" totalImagesPullingTime="410.8499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:07:41.161889243 +0000 UTC m=+1799.646981905" watchObservedRunningTime="2026-07-14 22:07:41.164069747 +0000 UTC m=+1799.649162441"
Jul 14 22:07:42.029569 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:42.029543    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 22:07:42.036456 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:42.036408    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 22:07:42.054367 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:42.054341    2572 patch_prober.go:28] interesting pod/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 14 22:07:42.054455 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:42.054398    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2" podUID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 14 22:07:42.141930 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:42.141902    2572 generic.go:356] "Generic (PLEG): container finished" podID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerID="88b20b20759483635ec4c8be9ade4d27e519a76f7c636b88d487b18cf5455ce6" exitCode=0
Jul 14 22:07:42.142261 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:42.141973    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2" event={"ID":"8568971f-9f31-48e5-97ff-9fcab168cb51","Type":"ContainerDied","Data":"88b20b20759483635ec4c8be9ade4d27e519a76f7c636b88d487b18cf5455ce6"}
Jul 14 22:07:42.142473 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:42.142459    2572 scope.go:117] "RemoveContainer" containerID="88b20b20759483635ec4c8be9ade4d27e519a76f7c636b88d487b18cf5455ce6"
Jul 14 22:07:42.143543 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:42.143500    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:07:42.143616 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:42.143600    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:07:42.143663 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:42.143649    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:07:43.150377 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:43.150342    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2" event={"ID":"8568971f-9f31-48e5-97ff-9fcab168cb51","Type":"ContainerStarted","Data":"770c4ff8e1e7069e1b2bbc1dca16f788fec263fb4b77f7896ec5601603bc7189"}
Jul 14 22:07:43.744047 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:43.744008    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:43.744270 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:43.744152    2572 patch_prober.go:28] interesting pod/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 14 22:07:43.744270 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:43.744196    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2" podUID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 14 22:07:44.743806 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:44.743772    2572 patch_prober.go:28] interesting pod/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 14 22:07:44.744390 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:44.744358    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2" podUID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 14 22:07:45.743264 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:45.743227    2572 patch_prober.go:28] interesting pod/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 14 22:07:45.743582 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:45.743551    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2" podUID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 14 22:07:46.743452 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:46.743408    2572 patch_prober.go:28] interesting pod/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 14 22:07:46.743919 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:46.743473    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2" podUID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 14 22:07:47.147832 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:47.147804    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:07:47.747383 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:47.747348    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:47.747793 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:47.747622    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:07:47.748347 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:07:47.748331    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:09:15.276305 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.276267    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"]
Jul 14 22:09:15.276769 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.276556    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5" podUID="782fa045-7bac-4fb6-b907-bec5b0f39714" containerName="maas-api" containerID="cri-o://9c5f5980961eb58faac17e602816243a41c950bebee4d6536238ce2151339463" gracePeriod=30
Jul 14 22:09:15.532750 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.532694    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:09:15.638346 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.638318    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/782fa045-7bac-4fb6-b907-bec5b0f39714-maas-api-tls\") pod \"782fa045-7bac-4fb6-b907-bec5b0f39714\" (UID: \"782fa045-7bac-4fb6-b907-bec5b0f39714\") "
Jul 14 22:09:15.638346 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.638331    2572 generic.go:356] "Generic (PLEG): container finished" podID="782fa045-7bac-4fb6-b907-bec5b0f39714" containerID="9c5f5980961eb58faac17e602816243a41c950bebee4d6536238ce2151339463" exitCode=0
Jul 14 22:09:15.638595 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.638370    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/782fa045-7bac-4fb6-b907-bec5b0f39714-openshift-service-ca\") pod \"782fa045-7bac-4fb6-b907-bec5b0f39714\" (UID: \"782fa045-7bac-4fb6-b907-bec5b0f39714\") "
Jul 14 22:09:15.638595 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.638375    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5" event={"ID":"782fa045-7bac-4fb6-b907-bec5b0f39714","Type":"ContainerDied","Data":"9c5f5980961eb58faac17e602816243a41c950bebee4d6536238ce2151339463"}
Jul 14 22:09:15.638595 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.638414    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5" event={"ID":"782fa045-7bac-4fb6-b907-bec5b0f39714","Type":"ContainerDied","Data":"6d1c66bebde0858f7174993db65d3537b74aa9690174446ef1c0ab91cba45c64"}
Jul 14 22:09:15.638595 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.638435    2572 scope.go:117] "RemoveContainer" containerID="9c5f5980961eb58faac17e602816243a41c950bebee4d6536238ce2151339463"
Jul 14 22:09:15.638595 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.638441    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5kll\" (UniqueName: \"kubernetes.io/projected/782fa045-7bac-4fb6-b907-bec5b0f39714-kube-api-access-w5kll\") pod \"782fa045-7bac-4fb6-b907-bec5b0f39714\" (UID: \"782fa045-7bac-4fb6-b907-bec5b0f39714\") "
Jul 14 22:09:15.638595 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.638457    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"
Jul 14 22:09:15.638851 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.638777    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/782fa045-7bac-4fb6-b907-bec5b0f39714-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "782fa045-7bac-4fb6-b907-bec5b0f39714" (UID: "782fa045-7bac-4fb6-b907-bec5b0f39714"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:09:15.640517 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.640494    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/782fa045-7bac-4fb6-b907-bec5b0f39714-kube-api-access-w5kll" (OuterVolumeSpecName: "kube-api-access-w5kll") pod "782fa045-7bac-4fb6-b907-bec5b0f39714" (UID: "782fa045-7bac-4fb6-b907-bec5b0f39714"). InnerVolumeSpecName "kube-api-access-w5kll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:09:15.640657 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.640633    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/782fa045-7bac-4fb6-b907-bec5b0f39714-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "782fa045-7bac-4fb6-b907-bec5b0f39714" (UID: "782fa045-7bac-4fb6-b907-bec5b0f39714"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:09:15.659599 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.659579    2572 scope.go:117] "RemoveContainer" containerID="9c5f5980961eb58faac17e602816243a41c950bebee4d6536238ce2151339463"
Jul 14 22:09:15.659862 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:09:15.659842    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c5f5980961eb58faac17e602816243a41c950bebee4d6536238ce2151339463\": container with ID starting with 9c5f5980961eb58faac17e602816243a41c950bebee4d6536238ce2151339463 not found: ID does not exist" containerID="9c5f5980961eb58faac17e602816243a41c950bebee4d6536238ce2151339463"
Jul 14 22:09:15.659912 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.659869    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c5f5980961eb58faac17e602816243a41c950bebee4d6536238ce2151339463"} err="failed to get container status \"9c5f5980961eb58faac17e602816243a41c950bebee4d6536238ce2151339463\": rpc error: code = NotFound desc = could not find container \"9c5f5980961eb58faac17e602816243a41c950bebee4d6536238ce2151339463\": container with ID starting with 9c5f5980961eb58faac17e602816243a41c950bebee4d6536238ce2151339463 not found: ID does not exist"
Jul 14 22:09:15.739398 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.739372    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5kll\" (UniqueName: \"kubernetes.io/projected/782fa045-7bac-4fb6-b907-bec5b0f39714-kube-api-access-w5kll\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:09:15.739398 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.739397    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/782fa045-7bac-4fb6-b907-bec5b0f39714-maas-api-tls\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:09:15.739574 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.739407    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/782fa045-7bac-4fb6-b907-bec5b0f39714-openshift-service-ca\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:09:15.962452 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.962424    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"]
Jul 14 22:09:15.969974 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.969954    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f62700-5b848cbd97-xxpk5"]
Jul 14 22:09:15.979690 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:15.979669    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="782fa045-7bac-4fb6-b907-bec5b0f39714" path="/var/lib/kubelet/pods/782fa045-7bac-4fb6-b907-bec5b0f39714/volumes"
Jul 14 22:09:58.443336 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:58.443304    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"]
Jul 14 22:09:58.443773 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:58.443525    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2" podUID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerName="istio-proxy" containerID="cri-o://770c4ff8e1e7069e1b2bbc1dca16f788fec263fb4b77f7896ec5601603bc7189" gracePeriod=30
Jul 14 22:09:59.646686 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:59.646641    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"]
Jul 14 22:09:59.647165 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:59.646889    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7" podUID="97ff34d3-9319-41ca-a634-efdb48461819" containerName="maas-api" containerID="cri-o://e1b8f83e4e46d2bd4844bc72d4960beb25d598afa6d6ad1f1d7faf5e3538c92a" gracePeriod=30
Jul 14 22:09:59.877613 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:59.877584    2572 generic.go:356] "Generic (PLEG): container finished" podID="97ff34d3-9319-41ca-a634-efdb48461819" containerID="e1b8f83e4e46d2bd4844bc72d4960beb25d598afa6d6ad1f1d7faf5e3538c92a" exitCode=0
Jul 14 22:09:59.877750 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:59.877663    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7" event={"ID":"97ff34d3-9319-41ca-a634-efdb48461819","Type":"ContainerDied","Data":"e1b8f83e4e46d2bd4844bc72d4960beb25d598afa6d6ad1f1d7faf5e3538c92a"}
Jul 14 22:09:59.877750 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:59.877726    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7" event={"ID":"97ff34d3-9319-41ca-a634-efdb48461819","Type":"ContainerDied","Data":"dfeba3fdfe315379b79f5459a4aea5eb43a1b44a066d06a030638ccc1c3b71c2"}
Jul 14 22:09:59.877831 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:59.877753    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfeba3fdfe315379b79f5459a4aea5eb43a1b44a066d06a030638ccc1c3b71c2"
Jul 14 22:09:59.887825 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:59.887806    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:09:59.929530 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:59.929471    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97ff34d3-9319-41ca-a634-efdb48461819-maas-api-tls\") pod \"97ff34d3-9319-41ca-a634-efdb48461819\" (UID: \"97ff34d3-9319-41ca-a634-efdb48461819\") "
Jul 14 22:09:59.929530 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:59.929526    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mkrj\" (UniqueName: \"kubernetes.io/projected/97ff34d3-9319-41ca-a634-efdb48461819-kube-api-access-8mkrj\") pod \"97ff34d3-9319-41ca-a634-efdb48461819\" (UID: \"97ff34d3-9319-41ca-a634-efdb48461819\") "
Jul 14 22:09:59.929676 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:59.929578    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ff34d3-9319-41ca-a634-efdb48461819-openshift-service-ca\") pod \"97ff34d3-9319-41ca-a634-efdb48461819\" (UID: \"97ff34d3-9319-41ca-a634-efdb48461819\") "
Jul 14 22:09:59.929988 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:59.929964    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97ff34d3-9319-41ca-a634-efdb48461819-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "97ff34d3-9319-41ca-a634-efdb48461819" (UID: "97ff34d3-9319-41ca-a634-efdb48461819"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:09:59.931920 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:59.931897    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97ff34d3-9319-41ca-a634-efdb48461819-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "97ff34d3-9319-41ca-a634-efdb48461819" (UID: "97ff34d3-9319-41ca-a634-efdb48461819"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:09:59.931920 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:09:59.931901    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97ff34d3-9319-41ca-a634-efdb48461819-kube-api-access-8mkrj" (OuterVolumeSpecName: "kube-api-access-8mkrj") pod "97ff34d3-9319-41ca-a634-efdb48461819" (UID: "97ff34d3-9319-41ca-a634-efdb48461819"). InnerVolumeSpecName "kube-api-access-8mkrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:10:00.030531 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:00.030512    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97ff34d3-9319-41ca-a634-efdb48461819-maas-api-tls\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:00.030531 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:00.030532    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mkrj\" (UniqueName: \"kubernetes.io/projected/97ff34d3-9319-41ca-a634-efdb48461819-kube-api-access-8mkrj\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:00.030658 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:00.030541    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ff34d3-9319-41ca-a634-efdb48461819-openshift-service-ca\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:00.883635 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:00.883602    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"
Jul 14 22:10:00.903478 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:00.903447    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"]
Jul 14 22:10:00.905500 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:00.905477    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-5c6d83-f57ff97fb-rs4r7"]
Jul 14 22:10:01.979991 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:01.979959    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97ff34d3-9319-41ca-a634-efdb48461819" path="/var/lib/kubelet/pods/97ff34d3-9319-41ca-a634-efdb48461819/volumes"
Jul 14 22:10:02.750046 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:02.750009    2572 patch_prober.go:28] interesting pod/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 22:10:02.750215 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:02.750075    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2" podUID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 22:10:03.691244 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.691217    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:10:03.760221 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760197    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-envoy\") pod \"8568971f-9f31-48e5-97ff-9fcab168cb51\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") "
Jul 14 22:10:03.760341 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760224    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-workload-certs\") pod \"8568971f-9f31-48e5-97ff-9fcab168cb51\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") "
Jul 14 22:10:03.760341 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760275    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8568971f-9f31-48e5-97ff-9fcab168cb51-istiod-ca-cert\") pod \"8568971f-9f31-48e5-97ff-9fcab168cb51\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") "
Jul 14 22:10:03.760341 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760291    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-workload-socket\") pod \"8568971f-9f31-48e5-97ff-9fcab168cb51\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") "
Jul 14 22:10:03.760341 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760307    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-podinfo\") pod \"8568971f-9f31-48e5-97ff-9fcab168cb51\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") "
Jul 14 22:10:03.760341 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760329    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-data\") pod \"8568971f-9f31-48e5-97ff-9fcab168cb51\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") "
Jul 14 22:10:03.760618 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760356    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-credential-socket\") pod \"8568971f-9f31-48e5-97ff-9fcab168cb51\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") "
Jul 14 22:10:03.760618 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760427    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-token\") pod \"8568971f-9f31-48e5-97ff-9fcab168cb51\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") "
Jul 14 22:10:03.760618 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760484    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gpm4\" (UniqueName: \"kubernetes.io/projected/8568971f-9f31-48e5-97ff-9fcab168cb51-kube-api-access-7gpm4\") pod \"8568971f-9f31-48e5-97ff-9fcab168cb51\" (UID: \"8568971f-9f31-48e5-97ff-9fcab168cb51\") "
Jul 14 22:10:03.760774 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760633    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8568971f-9f31-48e5-97ff-9fcab168cb51" (UID: "8568971f-9f31-48e5-97ff-9fcab168cb51"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:10:03.760774 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760645    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8568971f-9f31-48e5-97ff-9fcab168cb51" (UID: "8568971f-9f31-48e5-97ff-9fcab168cb51"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:10:03.760774 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760711    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8568971f-9f31-48e5-97ff-9fcab168cb51-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8568971f-9f31-48e5-97ff-9fcab168cb51" (UID: "8568971f-9f31-48e5-97ff-9fcab168cb51"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:10:03.760975 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760796    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8568971f-9f31-48e5-97ff-9fcab168cb51" (UID: "8568971f-9f31-48e5-97ff-9fcab168cb51"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:10:03.760975 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760943    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-workload-certs\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:03.760975 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760967    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8568971f-9f31-48e5-97ff-9fcab168cb51-istiod-ca-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:03.761141 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760979    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-workload-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:03.761141 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.760992    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-credential-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:03.761520 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.761481    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-data" (OuterVolumeSpecName: "istio-data") pod "8568971f-9f31-48e5-97ff-9fcab168cb51" (UID: "8568971f-9f31-48e5-97ff-9fcab168cb51"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:10:03.762667 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.762633    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-token" (OuterVolumeSpecName: "istio-token") pod "8568971f-9f31-48e5-97ff-9fcab168cb51" (UID: "8568971f-9f31-48e5-97ff-9fcab168cb51"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:10:03.762770 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.762676    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8568971f-9f31-48e5-97ff-9fcab168cb51-kube-api-access-7gpm4" (OuterVolumeSpecName: "kube-api-access-7gpm4") pod "8568971f-9f31-48e5-97ff-9fcab168cb51" (UID: "8568971f-9f31-48e5-97ff-9fcab168cb51"). InnerVolumeSpecName "kube-api-access-7gpm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:10:03.762824 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.762768    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8568971f-9f31-48e5-97ff-9fcab168cb51" (UID: "8568971f-9f31-48e5-97ff-9fcab168cb51"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:10:03.762824 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.762776    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8568971f-9f31-48e5-97ff-9fcab168cb51" (UID: "8568971f-9f31-48e5-97ff-9fcab168cb51"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 22:10:03.862407 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.862377    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-podinfo\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:03.862407 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.862405    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-data\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:03.862532 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.862414    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-token\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:03.862532 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.862423    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gpm4\" (UniqueName: \"kubernetes.io/projected/8568971f-9f31-48e5-97ff-9fcab168cb51-kube-api-access-7gpm4\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:03.862532 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.862433    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8568971f-9f31-48e5-97ff-9fcab168cb51-istio-envoy\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:03.900731 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.900706    2572 generic.go:356] "Generic (PLEG): container finished" podID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerID="770c4ff8e1e7069e1b2bbc1dca16f788fec263fb4b77f7896ec5601603bc7189" exitCode=0
Jul 14 22:10:03.900822 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.900744    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2" event={"ID":"8568971f-9f31-48e5-97ff-9fcab168cb51","Type":"ContainerDied","Data":"770c4ff8e1e7069e1b2bbc1dca16f788fec263fb4b77f7896ec5601603bc7189"}
Jul 14 22:10:03.900822 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.900757    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"
Jul 14 22:10:03.900822 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.900788    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2" event={"ID":"8568971f-9f31-48e5-97ff-9fcab168cb51","Type":"ContainerDied","Data":"70a0ecf4d92276a707a77b26c85840e1849d5d7b1552352ff5eec38fd68824c1"}
Jul 14 22:10:03.900822 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.900811    2572 scope.go:117] "RemoveContainer" containerID="770c4ff8e1e7069e1b2bbc1dca16f788fec263fb4b77f7896ec5601603bc7189"
Jul 14 22:10:03.910039 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.910021    2572 scope.go:117] "RemoveContainer" containerID="88b20b20759483635ec4c8be9ade4d27e519a76f7c636b88d487b18cf5455ce6"
Jul 14 22:10:03.918600 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.918581    2572 scope.go:117] "RemoveContainer" containerID="770c4ff8e1e7069e1b2bbc1dca16f788fec263fb4b77f7896ec5601603bc7189"
Jul 14 22:10:03.918855 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:10:03.918837    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"770c4ff8e1e7069e1b2bbc1dca16f788fec263fb4b77f7896ec5601603bc7189\": container with ID starting with 770c4ff8e1e7069e1b2bbc1dca16f788fec263fb4b77f7896ec5601603bc7189 not found: ID does not exist" containerID="770c4ff8e1e7069e1b2bbc1dca16f788fec263fb4b77f7896ec5601603bc7189"
Jul 14 22:10:03.918900 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.918863    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"770c4ff8e1e7069e1b2bbc1dca16f788fec263fb4b77f7896ec5601603bc7189"} err="failed to get container status \"770c4ff8e1e7069e1b2bbc1dca16f788fec263fb4b77f7896ec5601603bc7189\": rpc error: code = NotFound desc = could not find container \"770c4ff8e1e7069e1b2bbc1dca16f788fec263fb4b77f7896ec5601603bc7189\": container with ID starting with 770c4ff8e1e7069e1b2bbc1dca16f788fec263fb4b77f7896ec5601603bc7189 not found: ID does not exist"
Jul 14 22:10:03.918900 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.918880    2572 scope.go:117] "RemoveContainer" containerID="88b20b20759483635ec4c8be9ade4d27e519a76f7c636b88d487b18cf5455ce6"
Jul 14 22:10:03.919168 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:10:03.919145    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88b20b20759483635ec4c8be9ade4d27e519a76f7c636b88d487b18cf5455ce6\": container with ID starting with 88b20b20759483635ec4c8be9ade4d27e519a76f7c636b88d487b18cf5455ce6 not found: ID does not exist" containerID="88b20b20759483635ec4c8be9ade4d27e519a76f7c636b88d487b18cf5455ce6"
Jul 14 22:10:03.919229 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.919178    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88b20b20759483635ec4c8be9ade4d27e519a76f7c636b88d487b18cf5455ce6"} err="failed to get container status \"88b20b20759483635ec4c8be9ade4d27e519a76f7c636b88d487b18cf5455ce6\": rpc error: code = NotFound desc = could not find container \"88b20b20759483635ec4c8be9ade4d27e519a76f7c636b88d487b18cf5455ce6\": container with ID starting with 88b20b20759483635ec4c8be9ade4d27e519a76f7c636b88d487b18cf5455ce6 not found: ID does not exist"
Jul 14 22:10:03.928325 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.928305    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"]
Jul 14 22:10:03.935304 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.935282    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-f62700-openshift-default-85b48c6dc5-xsdd2"]
Jul 14 22:10:03.979909 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:03.979885    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8568971f-9f31-48e5-97ff-9fcab168cb51" path="/var/lib/kubelet/pods/8568971f-9f31-48e5-97ff-9fcab168cb51/volumes"
Jul 14 22:10:07.048514 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.048479    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"]
Jul 14 22:10:07.050208 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.049900    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerName="istio-proxy"
Jul 14 22:10:07.050429 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.050399    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerName="istio-proxy"
Jul 14 22:10:07.050528 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.050474    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ff34d3-9319-41ca-a634-efdb48461819" containerName="maas-api"
Jul 14 22:10:07.050528 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.050487    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ff34d3-9319-41ca-a634-efdb48461819" containerName="maas-api"
Jul 14 22:10:07.050528 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.050514    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerName="istio-proxy"
Jul 14 22:10:07.050528 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.050523    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerName="istio-proxy"
Jul 14 22:10:07.050735 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.050579    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="782fa045-7bac-4fb6-b907-bec5b0f39714" containerName="maas-api"
Jul 14 22:10:07.050735 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.050589    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="782fa045-7bac-4fb6-b907-bec5b0f39714" containerName="maas-api"
Jul 14 22:10:07.050838 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.050799    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="97ff34d3-9319-41ca-a634-efdb48461819" containerName="maas-api"
Jul 14 22:10:07.050838 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.050823    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerName="istio-proxy"
Jul 14 22:10:07.050935 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.050843    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8568971f-9f31-48e5-97ff-9fcab168cb51" containerName="istio-proxy"
Jul 14 22:10:07.050935 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.050863    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="782fa045-7bac-4fb6-b907-bec5b0f39714" containerName="maas-api"
Jul 14 22:10:07.055877 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.055853    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.058498 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.058479    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-851481-openshift-default-dockercfg-gfz4n\""
Jul 14 22:10:07.062533 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.062512    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"]
Jul 14 22:10:07.092680 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.092655    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-credential-socket\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.092783 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.092686    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-data\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.092783 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.092708    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-podinfo\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.092857 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.092794    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-envoy\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.092857 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.092841    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-workload-certs\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.092925 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.092864    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-token\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.092925 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.092899    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-workload-socket\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.092989 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.092949    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8psp2\" (UniqueName: \"kubernetes.io/projected/ede74fef-9b7a-4944-9e7a-e1786a10f68c-kube-api-access-8psp2\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.092989 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.092978    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istiod-ca-cert\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.193590 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.193564    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-envoy\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.193705 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.193605    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-workload-certs\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.193705 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.193626    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-token\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.193705 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.193645    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-workload-socket\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.193705 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.193686    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8psp2\" (UniqueName: \"kubernetes.io/projected/ede74fef-9b7a-4944-9e7a-e1786a10f68c-kube-api-access-8psp2\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.193933 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.193715    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istiod-ca-cert\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.193933 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.193749    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-credential-socket\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.193933 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.193777    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-data\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.193933 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.193811    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-podinfo\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.194201 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.194057    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-workload-certs\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.194201 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.194184    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-credential-socket\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.194283 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.194210    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-workload-socket\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.194431 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.194408    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-data\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.194475 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.194411    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istiod-ca-cert\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.195885 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.195860    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-envoy\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.196225 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.196208    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-podinfo\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.204017 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.203989    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8psp2\" (UniqueName: \"kubernetes.io/projected/ede74fef-9b7a-4944-9e7a-e1786a10f68c-kube-api-access-8psp2\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.204445 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.204413    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-token\") pod \"e2e-api-a-851481-openshift-default-6874cf456f-sm8qp\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") " pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.368026 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.367958    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:07.508707 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.508678    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"]
Jul 14 22:10:07.512904 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:10:07.512869    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede74fef_9b7a_4944_9e7a_e1786a10f68c.slice/crio-1d939393433ac48eb0135ac8f0b07d912e94e55791edfaadeef999aaf1648beb WatchSource:0}: Error finding container 1d939393433ac48eb0135ac8f0b07d912e94e55791edfaadeef999aaf1648beb: Status 404 returned error can't find the container with id 1d939393433ac48eb0135ac8f0b07d912e94e55791edfaadeef999aaf1648beb
Jul 14 22:10:07.515860 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.515820    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:10:07.515943 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.515906    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:10:07.515982 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.515944    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:10:07.925094 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.925054    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp" event={"ID":"ede74fef-9b7a-4944-9e7a-e1786a10f68c","Type":"ContainerStarted","Data":"6aa0ecd5762fba4a4c8cf80ce8be28561f07c511c7e44442b2921148957795e0"}
Jul 14 22:10:07.925259 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.925135    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp" event={"ID":"ede74fef-9b7a-4944-9e7a-e1786a10f68c","Type":"ContainerStarted","Data":"1d939393433ac48eb0135ac8f0b07d912e94e55791edfaadeef999aaf1648beb"}
Jul 14 22:10:07.950229 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:07.950181    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp" podStartSLOduration=0.950167152 podStartE2EDuration="950.167152ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:10:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:10:07.948717733 +0000 UTC m=+1946.433810386" watchObservedRunningTime="2026-07-14 22:10:07.950167152 +0000 UTC m=+1946.435259804"
Jul 14 22:10:08.369086 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:08.369054    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:08.373805 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:08.373783    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:08.930555 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:08.930527    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:08.931373 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:08.931354    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:10.092567 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.092531    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"]
Jul 14 22:10:10.097027 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.097004    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:10.099580 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.099557    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-851481-serving-cert\""
Jul 14 22:10:10.105320 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.105297    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"]
Jul 14 22:10:10.222130 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.222072    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxdq9\" (UniqueName: \"kubernetes.io/projected/02623337-b913-44aa-b0e5-5de046da973e-kube-api-access-jxdq9\") pod \"maas-api-e2e-api-a-851481-595cf78d44-89nsj\" (UID: \"02623337-b913-44aa-b0e5-5de046da973e\") " pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:10.222311 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.222151    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02623337-b913-44aa-b0e5-5de046da973e-openshift-service-ca\") pod \"maas-api-e2e-api-a-851481-595cf78d44-89nsj\" (UID: \"02623337-b913-44aa-b0e5-5de046da973e\") " pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:10.222311 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.222196    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02623337-b913-44aa-b0e5-5de046da973e-maas-api-tls\") pod \"maas-api-e2e-api-a-851481-595cf78d44-89nsj\" (UID: \"02623337-b913-44aa-b0e5-5de046da973e\") " pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:10.323042 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.323011    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxdq9\" (UniqueName: \"kubernetes.io/projected/02623337-b913-44aa-b0e5-5de046da973e-kube-api-access-jxdq9\") pod \"maas-api-e2e-api-a-851481-595cf78d44-89nsj\" (UID: \"02623337-b913-44aa-b0e5-5de046da973e\") " pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:10.323187 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.323050    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02623337-b913-44aa-b0e5-5de046da973e-openshift-service-ca\") pod \"maas-api-e2e-api-a-851481-595cf78d44-89nsj\" (UID: \"02623337-b913-44aa-b0e5-5de046da973e\") " pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:10.323187 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.323078    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02623337-b913-44aa-b0e5-5de046da973e-maas-api-tls\") pod \"maas-api-e2e-api-a-851481-595cf78d44-89nsj\" (UID: \"02623337-b913-44aa-b0e5-5de046da973e\") " pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:10.323693 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.323675    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02623337-b913-44aa-b0e5-5de046da973e-openshift-service-ca\") pod \"maas-api-e2e-api-a-851481-595cf78d44-89nsj\" (UID: \"02623337-b913-44aa-b0e5-5de046da973e\") " pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:10.325450 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.325427    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02623337-b913-44aa-b0e5-5de046da973e-maas-api-tls\") pod \"maas-api-e2e-api-a-851481-595cf78d44-89nsj\" (UID: \"02623337-b913-44aa-b0e5-5de046da973e\") " pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:10.331490 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.331467    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxdq9\" (UniqueName: \"kubernetes.io/projected/02623337-b913-44aa-b0e5-5de046da973e-kube-api-access-jxdq9\") pod \"maas-api-e2e-api-a-851481-595cf78d44-89nsj\" (UID: \"02623337-b913-44aa-b0e5-5de046da973e\") " pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:10.410153 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.410088    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:10.554151 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.554120    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"]
Jul 14 22:10:10.555430 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:10:10.555405    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02623337_b913_44aa_b0e5_5de046da973e.slice/crio-de17757f704fe21afc6fd375009b3d60c12003dd7bcc1074e1e071fbb4d630f4 WatchSource:0}: Error finding container de17757f704fe21afc6fd375009b3d60c12003dd7bcc1074e1e071fbb4d630f4: Status 404 returned error can't find the container with id de17757f704fe21afc6fd375009b3d60c12003dd7bcc1074e1e071fbb4d630f4
Jul 14 22:10:10.944935 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:10.944901    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj" event={"ID":"02623337-b913-44aa-b0e5-5de046da973e","Type":"ContainerStarted","Data":"de17757f704fe21afc6fd375009b3d60c12003dd7bcc1074e1e071fbb4d630f4"}
Jul 14 22:10:11.952157 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:11.952122    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj" event={"ID":"02623337-b913-44aa-b0e5-5de046da973e","Type":"ContainerStarted","Data":"a437916c4c37a9c412b45c2667a0238e0248fd99dca5ffa52cb0925cbec885c1"}
Jul 14 22:10:11.952564 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:11.952181    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:11.970672 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:11.970616    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj" podStartSLOduration=1.415956636 podStartE2EDuration="1.970600872s" totalImagesPullingTime="554.644236ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:10:11.969894448 +0000 UTC m=+1950.454987110" watchObservedRunningTime="2026-07-14 22:10:11.970600872 +0000 UTC m=+1950.455693524"
Jul 14 22:10:17.935476 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:17.935439    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"]
Jul 14 22:10:17.942443 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:17.942420    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:17.945464 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:17.945444    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-912f37-serving-cert\""
Jul 14 22:10:17.955005 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:17.954972    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"]
Jul 14 22:10:17.965780 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:17.965757    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:17.994199 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:17.994174    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvpnr\" (UniqueName: \"kubernetes.io/projected/e0138870-4210-48b7-a0f0-152a2d012133-kube-api-access-bvpnr\") pod \"maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67\" (UID: \"e0138870-4210-48b7-a0f0-152a2d012133\") " pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:17.994310 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:17.994294    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0138870-4210-48b7-a0f0-152a2d012133-maas-api-tls\") pod \"maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67\" (UID: \"e0138870-4210-48b7-a0f0-152a2d012133\") " pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:17.994382 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:17.994367    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0138870-4210-48b7-a0f0-152a2d012133-openshift-service-ca\") pod \"maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67\" (UID: \"e0138870-4210-48b7-a0f0-152a2d012133\") " pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:18.095922 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:18.095885    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0138870-4210-48b7-a0f0-152a2d012133-maas-api-tls\") pod \"maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67\" (UID: \"e0138870-4210-48b7-a0f0-152a2d012133\") " pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:18.096130 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:10:18.096089    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-912f37-serving-cert: secret "maas-api-e2e-api-b-912f37-serving-cert" not found
Jul 14 22:10:18.096189 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:10:18.096170    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0138870-4210-48b7-a0f0-152a2d012133-maas-api-tls podName:e0138870-4210-48b7-a0f0-152a2d012133 nodeName:}" failed. No retries permitted until 2026-07-14 22:10:18.596154842 +0000 UTC m=+1957.081247472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e0138870-4210-48b7-a0f0-152a2d012133-maas-api-tls") pod "maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67" (UID: "e0138870-4210-48b7-a0f0-152a2d012133") : secret "maas-api-e2e-api-b-912f37-serving-cert" not found
Jul 14 22:10:18.096246 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:18.096207    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0138870-4210-48b7-a0f0-152a2d012133-openshift-service-ca\") pod \"maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67\" (UID: \"e0138870-4210-48b7-a0f0-152a2d012133\") " pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:18.096460 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:18.096432    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvpnr\" (UniqueName: \"kubernetes.io/projected/e0138870-4210-48b7-a0f0-152a2d012133-kube-api-access-bvpnr\") pod \"maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67\" (UID: \"e0138870-4210-48b7-a0f0-152a2d012133\") " pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:18.096978 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:18.096958    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0138870-4210-48b7-a0f0-152a2d012133-openshift-service-ca\") pod \"maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67\" (UID: \"e0138870-4210-48b7-a0f0-152a2d012133\") " pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:18.107432 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:18.107405    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvpnr\" (UniqueName: \"kubernetes.io/projected/e0138870-4210-48b7-a0f0-152a2d012133-kube-api-access-bvpnr\") pod \"maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67\" (UID: \"e0138870-4210-48b7-a0f0-152a2d012133\") " pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:18.602281 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:18.602243    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0138870-4210-48b7-a0f0-152a2d012133-maas-api-tls\") pod \"maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67\" (UID: \"e0138870-4210-48b7-a0f0-152a2d012133\") " pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:18.604622 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:18.604602    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0138870-4210-48b7-a0f0-152a2d012133-maas-api-tls\") pod \"maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67\" (UID: \"e0138870-4210-48b7-a0f0-152a2d012133\") " pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:18.862892 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:18.862813    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:19.042129 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:19.038154    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"]
Jul 14 22:10:19.050480 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:10:19.050442    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0138870_4210_48b7_a0f0_152a2d012133.slice/crio-b7973bd577d911b52f035139035e0cfd95dbc5c321cfdbfd18fe890ef5c56acd WatchSource:0}: Error finding container b7973bd577d911b52f035139035e0cfd95dbc5c321cfdbfd18fe890ef5c56acd: Status 404 returned error can't find the container with id b7973bd577d911b52f035139035e0cfd95dbc5c321cfdbfd18fe890ef5c56acd
Jul 14 22:10:19.998383 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:19.998345    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67" event={"ID":"e0138870-4210-48b7-a0f0-152a2d012133","Type":"ContainerStarted","Data":"82c0467036f4cd327390da3ee71ad73230b12643e650679146fb827810b47535"}
Jul 14 22:10:19.998648 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:19.998393    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67" event={"ID":"e0138870-4210-48b7-a0f0-152a2d012133","Type":"ContainerStarted","Data":"b7973bd577d911b52f035139035e0cfd95dbc5c321cfdbfd18fe890ef5c56acd"}
Jul 14 22:10:19.998648 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:19.998447    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:20.017499 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:20.017455    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67" podStartSLOduration=2.667559001 podStartE2EDuration="3.017441085s" totalImagesPullingTime="349.882084ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:10:20.016296772 +0000 UTC m=+1958.501389458" watchObservedRunningTime="2026-07-14 22:10:20.017441085 +0000 UTC m=+1958.502533737"
Jul 14 22:10:23.931984 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:23.931948    2572 patch_prober.go:28] interesting pod/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 14 22:10:23.932420 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:23.932029    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp" podUID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 14 22:10:24.022585 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:24.022559    2572 generic.go:356] "Generic (PLEG): container finished" podID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" containerID="6aa0ecd5762fba4a4c8cf80ce8be28561f07c511c7e44442b2921148957795e0" exitCode=0
Jul 14 22:10:24.022719 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:24.022618    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp" event={"ID":"ede74fef-9b7a-4944-9e7a-e1786a10f68c","Type":"ContainerDied","Data":"6aa0ecd5762fba4a4c8cf80ce8be28561f07c511c7e44442b2921148957795e0"}
Jul 14 22:10:24.022957 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:24.022944    2572 scope.go:117] "RemoveContainer" containerID="6aa0ecd5762fba4a4c8cf80ce8be28561f07c511c7e44442b2921148957795e0"
Jul 14 22:10:24.023955 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:24.023922    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:10:24.024024 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:24.024008    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:10:24.024074 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:24.024050    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:10:25.033952 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:25.033913    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp" event={"ID":"ede74fef-9b7a-4944-9e7a-e1786a10f68c","Type":"ContainerStarted","Data":"7b8f3381cfa13f3ab632abac8aed2398d3c9178c078c44c0d09f88b64d37e3d9"}
Jul 14 22:10:25.368254 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:25.368163    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:25.368408 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:25.368339    2572 patch_prober.go:28] interesting pod/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 14 22:10:25.368408 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:25.368390    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp" podUID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 14 22:10:26.008721 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:26.008688    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:26.368439 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:26.368358    2572 patch_prober.go:28] interesting pod/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 14 22:10:26.368439 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:26.368410    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp" podUID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 14 22:10:27.368932 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:27.368898    2572 patch_prober.go:28] interesting pod/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 14 22:10:27.369317 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:27.368955    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp" podUID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 14 22:10:28.368353 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:28.368314    2572 patch_prober.go:28] interesting pod/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 14 22:10:28.368524 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:28.368378    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp" podUID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 14 22:10:29.372002 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:29.371965    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:29.372493 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:29.372396    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:29.372969 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:29.372948    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:31.515947 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:31.515917    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"]
Jul 14 22:10:31.516421 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:31.516181    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj" podUID="02623337-b913-44aa-b0e5-5de046da973e" containerName="maas-api" containerID="cri-o://a437916c4c37a9c412b45c2667a0238e0248fd99dca5ffa52cb0925cbec885c1" gracePeriod=30
Jul 14 22:10:31.779783 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:31.779728    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:31.933439 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:31.933411    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02623337-b913-44aa-b0e5-5de046da973e-openshift-service-ca\") pod \"02623337-b913-44aa-b0e5-5de046da973e\" (UID: \"02623337-b913-44aa-b0e5-5de046da973e\") "
Jul 14 22:10:31.933600 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:31.933483    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02623337-b913-44aa-b0e5-5de046da973e-maas-api-tls\") pod \"02623337-b913-44aa-b0e5-5de046da973e\" (UID: \"02623337-b913-44aa-b0e5-5de046da973e\") "
Jul 14 22:10:31.933600 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:31.933508    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxdq9\" (UniqueName: \"kubernetes.io/projected/02623337-b913-44aa-b0e5-5de046da973e-kube-api-access-jxdq9\") pod \"02623337-b913-44aa-b0e5-5de046da973e\" (UID: \"02623337-b913-44aa-b0e5-5de046da973e\") "
Jul 14 22:10:31.933769 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:31.933746    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02623337-b913-44aa-b0e5-5de046da973e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "02623337-b913-44aa-b0e5-5de046da973e" (UID: "02623337-b913-44aa-b0e5-5de046da973e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:10:31.935528 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:31.935504    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02623337-b913-44aa-b0e5-5de046da973e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "02623337-b913-44aa-b0e5-5de046da973e" (UID: "02623337-b913-44aa-b0e5-5de046da973e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:10:31.935604 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:31.935524    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02623337-b913-44aa-b0e5-5de046da973e-kube-api-access-jxdq9" (OuterVolumeSpecName: "kube-api-access-jxdq9") pod "02623337-b913-44aa-b0e5-5de046da973e" (UID: "02623337-b913-44aa-b0e5-5de046da973e"). InnerVolumeSpecName "kube-api-access-jxdq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:10:32.034736 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:32.034680    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02623337-b913-44aa-b0e5-5de046da973e-maas-api-tls\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:32.034736 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:32.034704    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxdq9\" (UniqueName: \"kubernetes.io/projected/02623337-b913-44aa-b0e5-5de046da973e-kube-api-access-jxdq9\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:32.034736 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:32.034714    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02623337-b913-44aa-b0e5-5de046da973e-openshift-service-ca\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:32.083444 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:32.083422    2572 generic.go:356] "Generic (PLEG): container finished" podID="02623337-b913-44aa-b0e5-5de046da973e" containerID="a437916c4c37a9c412b45c2667a0238e0248fd99dca5ffa52cb0925cbec885c1" exitCode=0
Jul 14 22:10:32.083534 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:32.083464    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"
Jul 14 22:10:32.083534 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:32.083468    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj" event={"ID":"02623337-b913-44aa-b0e5-5de046da973e","Type":"ContainerDied","Data":"a437916c4c37a9c412b45c2667a0238e0248fd99dca5ffa52cb0925cbec885c1"}
Jul 14 22:10:32.083534 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:32.083506    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj" event={"ID":"02623337-b913-44aa-b0e5-5de046da973e","Type":"ContainerDied","Data":"de17757f704fe21afc6fd375009b3d60c12003dd7bcc1074e1e071fbb4d630f4"}
Jul 14 22:10:32.083534 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:32.083532    2572 scope.go:117] "RemoveContainer" containerID="a437916c4c37a9c412b45c2667a0238e0248fd99dca5ffa52cb0925cbec885c1"
Jul 14 22:10:32.092385 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:32.092369    2572 scope.go:117] "RemoveContainer" containerID="a437916c4c37a9c412b45c2667a0238e0248fd99dca5ffa52cb0925cbec885c1"
Jul 14 22:10:32.092617 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:10:32.092599    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a437916c4c37a9c412b45c2667a0238e0248fd99dca5ffa52cb0925cbec885c1\": container with ID starting with a437916c4c37a9c412b45c2667a0238e0248fd99dca5ffa52cb0925cbec885c1 not found: ID does not exist" containerID="a437916c4c37a9c412b45c2667a0238e0248fd99dca5ffa52cb0925cbec885c1"
Jul 14 22:10:32.092676 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:32.092624    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a437916c4c37a9c412b45c2667a0238e0248fd99dca5ffa52cb0925cbec885c1"} err="failed to get container status \"a437916c4c37a9c412b45c2667a0238e0248fd99dca5ffa52cb0925cbec885c1\": rpc error: code = NotFound desc = could not find container \"a437916c4c37a9c412b45c2667a0238e0248fd99dca5ffa52cb0925cbec885c1\": container with ID starting with a437916c4c37a9c412b45c2667a0238e0248fd99dca5ffa52cb0925cbec885c1 not found: ID does not exist"
Jul 14 22:10:32.102754 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:32.102729    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"]
Jul 14 22:10:32.107532 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:32.107513    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-851481-595cf78d44-89nsj"]
Jul 14 22:10:33.979358 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:33.979283    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02623337-b913-44aa-b0e5-5de046da973e" path="/var/lib/kubelet/pods/02623337-b913-44aa-b0e5-5de046da973e/volumes"
Jul 14 22:10:37.885264 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:37.885225    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"]
Jul 14 22:10:37.885695 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:37.885417    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp" podUID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" containerName="istio-proxy" containerID="cri-o://7b8f3381cfa13f3ab632abac8aed2398d3c9178c078c44c0d09f88b64d37e3d9" gracePeriod=30
Jul 14 22:10:39.226712 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:39.226667    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"]
Jul 14 22:10:39.227205 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:39.227013    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67" podUID="e0138870-4210-48b7-a0f0-152a2d012133" containerName="maas-api" containerID="cri-o://82c0467036f4cd327390da3ee71ad73230b12643e650679146fb827810b47535" gracePeriod=30
Jul 14 22:10:39.482319 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:39.482264    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:39.602723 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:39.602697    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0138870-4210-48b7-a0f0-152a2d012133-maas-api-tls\") pod \"e0138870-4210-48b7-a0f0-152a2d012133\" (UID: \"e0138870-4210-48b7-a0f0-152a2d012133\") "
Jul 14 22:10:39.602869 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:39.602762    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0138870-4210-48b7-a0f0-152a2d012133-openshift-service-ca\") pod \"e0138870-4210-48b7-a0f0-152a2d012133\" (UID: \"e0138870-4210-48b7-a0f0-152a2d012133\") "
Jul 14 22:10:39.602869 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:39.602819    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvpnr\" (UniqueName: \"kubernetes.io/projected/e0138870-4210-48b7-a0f0-152a2d012133-kube-api-access-bvpnr\") pod \"e0138870-4210-48b7-a0f0-152a2d012133\" (UID: \"e0138870-4210-48b7-a0f0-152a2d012133\") "
Jul 14 22:10:39.603163 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:39.603137    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0138870-4210-48b7-a0f0-152a2d012133-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e0138870-4210-48b7-a0f0-152a2d012133" (UID: "e0138870-4210-48b7-a0f0-152a2d012133"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:10:39.604712 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:39.604689    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0138870-4210-48b7-a0f0-152a2d012133-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e0138870-4210-48b7-a0f0-152a2d012133" (UID: "e0138870-4210-48b7-a0f0-152a2d012133"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:10:39.604763 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:39.604725    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0138870-4210-48b7-a0f0-152a2d012133-kube-api-access-bvpnr" (OuterVolumeSpecName: "kube-api-access-bvpnr") pod "e0138870-4210-48b7-a0f0-152a2d012133" (UID: "e0138870-4210-48b7-a0f0-152a2d012133"). InnerVolumeSpecName "kube-api-access-bvpnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:10:39.704426 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:39.704401    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvpnr\" (UniqueName: \"kubernetes.io/projected/e0138870-4210-48b7-a0f0-152a2d012133-kube-api-access-bvpnr\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:39.704426 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:39.704423    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0138870-4210-48b7-a0f0-152a2d012133-maas-api-tls\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:39.704563 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:39.704432    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0138870-4210-48b7-a0f0-152a2d012133-openshift-service-ca\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:40.129435 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:40.129404    2572 generic.go:356] "Generic (PLEG): container finished" podID="e0138870-4210-48b7-a0f0-152a2d012133" containerID="82c0467036f4cd327390da3ee71ad73230b12643e650679146fb827810b47535" exitCode=0
Jul 14 22:10:40.129574 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:40.129470    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"
Jul 14 22:10:40.129574 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:40.129484    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67" event={"ID":"e0138870-4210-48b7-a0f0-152a2d012133","Type":"ContainerDied","Data":"82c0467036f4cd327390da3ee71ad73230b12643e650679146fb827810b47535"}
Jul 14 22:10:40.129574 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:40.129539    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67" event={"ID":"e0138870-4210-48b7-a0f0-152a2d012133","Type":"ContainerDied","Data":"b7973bd577d911b52f035139035e0cfd95dbc5c321cfdbfd18fe890ef5c56acd"}
Jul 14 22:10:40.129574 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:40.129568    2572 scope.go:117] "RemoveContainer" containerID="82c0467036f4cd327390da3ee71ad73230b12643e650679146fb827810b47535"
Jul 14 22:10:40.138890 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:40.138867    2572 scope.go:117] "RemoveContainer" containerID="82c0467036f4cd327390da3ee71ad73230b12643e650679146fb827810b47535"
Jul 14 22:10:40.139283 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:10:40.139256    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82c0467036f4cd327390da3ee71ad73230b12643e650679146fb827810b47535\": container with ID starting with 82c0467036f4cd327390da3ee71ad73230b12643e650679146fb827810b47535 not found: ID does not exist" containerID="82c0467036f4cd327390da3ee71ad73230b12643e650679146fb827810b47535"
Jul 14 22:10:40.139388 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:40.139293    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82c0467036f4cd327390da3ee71ad73230b12643e650679146fb827810b47535"} err="failed to get container status \"82c0467036f4cd327390da3ee71ad73230b12643e650679146fb827810b47535\": rpc error: code = NotFound desc = could not find container \"82c0467036f4cd327390da3ee71ad73230b12643e650679146fb827810b47535\": container with ID starting with 82c0467036f4cd327390da3ee71ad73230b12643e650679146fb827810b47535 not found: ID does not exist"
Jul 14 22:10:40.148558 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:40.148535    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"]
Jul 14 22:10:40.150536 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:40.150515    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-912f37-55ccfbcffd-n2b67"]
Jul 14 22:10:41.980543 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:41.980503    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0138870-4210-48b7-a0f0-152a2d012133" path="/var/lib/kubelet/pods/e0138870-4210-48b7-a0f0-152a2d012133/volumes"
Jul 14 22:10:43.147792 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.147735    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:43.148083 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.147838    2572 generic.go:356] "Generic (PLEG): container finished" podID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" containerID="7b8f3381cfa13f3ab632abac8aed2398d3c9178c078c44c0d09f88b64d37e3d9" exitCode=0
Jul 14 22:10:43.148083 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.147873    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp" event={"ID":"ede74fef-9b7a-4944-9e7a-e1786a10f68c","Type":"ContainerDied","Data":"7b8f3381cfa13f3ab632abac8aed2398d3c9178c078c44c0d09f88b64d37e3d9"}
Jul 14 22:10:43.148083 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.147925    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp" event={"ID":"ede74fef-9b7a-4944-9e7a-e1786a10f68c","Type":"ContainerDied","Data":"1d939393433ac48eb0135ac8f0b07d912e94e55791edfaadeef999aaf1648beb"}
Jul 14 22:10:43.148083 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.147954    2572 scope.go:117] "RemoveContainer" containerID="7b8f3381cfa13f3ab632abac8aed2398d3c9178c078c44c0d09f88b64d37e3d9"
Jul 14 22:10:43.156303 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.156286    2572 scope.go:117] "RemoveContainer" containerID="6aa0ecd5762fba4a4c8cf80ce8be28561f07c511c7e44442b2921148957795e0"
Jul 14 22:10:43.164048 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.164030    2572 scope.go:117] "RemoveContainer" containerID="7b8f3381cfa13f3ab632abac8aed2398d3c9178c078c44c0d09f88b64d37e3d9"
Jul 14 22:10:43.164339 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:10:43.164320    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b8f3381cfa13f3ab632abac8aed2398d3c9178c078c44c0d09f88b64d37e3d9\": container with ID starting with 7b8f3381cfa13f3ab632abac8aed2398d3c9178c078c44c0d09f88b64d37e3d9 not found: ID does not exist" containerID="7b8f3381cfa13f3ab632abac8aed2398d3c9178c078c44c0d09f88b64d37e3d9"
Jul 14 22:10:43.164408 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.164346    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b8f3381cfa13f3ab632abac8aed2398d3c9178c078c44c0d09f88b64d37e3d9"} err="failed to get container status \"7b8f3381cfa13f3ab632abac8aed2398d3c9178c078c44c0d09f88b64d37e3d9\": rpc error: code = NotFound desc = could not find container \"7b8f3381cfa13f3ab632abac8aed2398d3c9178c078c44c0d09f88b64d37e3d9\": container with ID starting with 7b8f3381cfa13f3ab632abac8aed2398d3c9178c078c44c0d09f88b64d37e3d9 not found: ID does not exist"
Jul 14 22:10:43.164408 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.164364    2572 scope.go:117] "RemoveContainer" containerID="6aa0ecd5762fba4a4c8cf80ce8be28561f07c511c7e44442b2921148957795e0"
Jul 14 22:10:43.164599 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:10:43.164583    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aa0ecd5762fba4a4c8cf80ce8be28561f07c511c7e44442b2921148957795e0\": container with ID starting with 6aa0ecd5762fba4a4c8cf80ce8be28561f07c511c7e44442b2921148957795e0 not found: ID does not exist" containerID="6aa0ecd5762fba4a4c8cf80ce8be28561f07c511c7e44442b2921148957795e0"
Jul 14 22:10:43.164645 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.164607    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aa0ecd5762fba4a4c8cf80ce8be28561f07c511c7e44442b2921148957795e0"} err="failed to get container status \"6aa0ecd5762fba4a4c8cf80ce8be28561f07c511c7e44442b2921148957795e0\": rpc error: code = NotFound desc = could not find container \"6aa0ecd5762fba4a4c8cf80ce8be28561f07c511c7e44442b2921148957795e0\": container with ID starting with 6aa0ecd5762fba4a4c8cf80ce8be28561f07c511c7e44442b2921148957795e0 not found: ID does not exist"
Jul 14 22:10:43.336527 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.336498    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-workload-socket\") pod \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") "
Jul 14 22:10:43.336638 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.336543    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-workload-certs\") pod \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") "
Jul 14 22:10:43.336638 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.336567    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-podinfo\") pod \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") "
Jul 14 22:10:43.336638 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.336598    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istiod-ca-cert\") pod \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") "
Jul 14 22:10:43.336806 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.336644    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8psp2\" (UniqueName: \"kubernetes.io/projected/ede74fef-9b7a-4944-9e7a-e1786a10f68c-kube-api-access-8psp2\") pod \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") "
Jul 14 22:10:43.336806 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.336680    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-data\") pod \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") "
Jul 14 22:10:43.336806 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.336690    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ede74fef-9b7a-4944-9e7a-e1786a10f68c" (UID: "ede74fef-9b7a-4944-9e7a-e1786a10f68c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:10:43.336806 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.336703    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-envoy\") pod \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") "
Jul 14 22:10:43.336806 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.336761    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-credential-socket\") pod \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") "
Jul 14 22:10:43.337051 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.336825    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-token\") pod \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\" (UID: \"ede74fef-9b7a-4944-9e7a-e1786a10f68c\") "
Jul 14 22:10:43.337051 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.336892    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ede74fef-9b7a-4944-9e7a-e1786a10f68c" (UID: "ede74fef-9b7a-4944-9e7a-e1786a10f68c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:10:43.337234 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.337087    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ede74fef-9b7a-4944-9e7a-e1786a10f68c" (UID: "ede74fef-9b7a-4944-9e7a-e1786a10f68c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:10:43.337234 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.337155    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-workload-certs\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:43.337334 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.337253    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-workload-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:43.337507 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.337470    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ede74fef-9b7a-4944-9e7a-e1786a10f68c" (UID: "ede74fef-9b7a-4944-9e7a-e1786a10f68c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:10:43.337716 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.337695    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-data" (OuterVolumeSpecName: "istio-data") pod "ede74fef-9b7a-4944-9e7a-e1786a10f68c" (UID: "ede74fef-9b7a-4944-9e7a-e1786a10f68c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:10:43.338742 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.338720    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ede74fef-9b7a-4944-9e7a-e1786a10f68c" (UID: "ede74fef-9b7a-4944-9e7a-e1786a10f68c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 22:10:43.338835 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.338789    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ede74fef-9b7a-4944-9e7a-e1786a10f68c" (UID: "ede74fef-9b7a-4944-9e7a-e1786a10f68c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:10:43.339195 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.339179    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-token" (OuterVolumeSpecName: "istio-token") pod "ede74fef-9b7a-4944-9e7a-e1786a10f68c" (UID: "ede74fef-9b7a-4944-9e7a-e1786a10f68c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:10:43.339316 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.339293    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede74fef-9b7a-4944-9e7a-e1786a10f68c-kube-api-access-8psp2" (OuterVolumeSpecName: "kube-api-access-8psp2") pod "ede74fef-9b7a-4944-9e7a-e1786a10f68c" (UID: "ede74fef-9b7a-4944-9e7a-e1786a10f68c"). InnerVolumeSpecName "kube-api-access-8psp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:10:43.438341 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.438296    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-podinfo\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:43.438341 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.438313    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istiod-ca-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:43.438341 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.438322    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8psp2\" (UniqueName: \"kubernetes.io/projected/ede74fef-9b7a-4944-9e7a-e1786a10f68c-kube-api-access-8psp2\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:43.438341 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.438330    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-data\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:43.438341 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.438338    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-envoy\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:43.438542 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.438346    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede74fef-9b7a-4944-9e7a-e1786a10f68c-credential-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:43.438542 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:43.438353    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ede74fef-9b7a-4944-9e7a-e1786a10f68c-istio-token\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:10:44.153727 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:44.153705    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"
Jul 14 22:10:44.174031 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:44.174006    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"]
Jul 14 22:10:44.178722 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:44.178699    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-851481-openshift-default-6874cf456f-sm8qp"]
Jul 14 22:10:45.979490 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:45.979457    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" path="/var/lib/kubelet/pods/ede74fef-9b7a-4944-9e7a-e1786a10f68c/volumes"
Jul 14 22:10:46.510204 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.510176    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"]
Jul 14 22:10:46.510612 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.510601    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02623337-b913-44aa-b0e5-5de046da973e" containerName="maas-api"
Jul 14 22:10:46.510655 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.510614    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="02623337-b913-44aa-b0e5-5de046da973e" containerName="maas-api"
Jul 14 22:10:46.510655 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.510627    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" containerName="istio-proxy"
Jul 14 22:10:46.510655 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.510632    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" containerName="istio-proxy"
Jul 14 22:10:46.510655 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.510644    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" containerName="istio-proxy"
Jul 14 22:10:46.510655 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.510650    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" containerName="istio-proxy"
Jul 14 22:10:46.510803 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.510662    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0138870-4210-48b7-a0f0-152a2d012133" containerName="maas-api"
Jul 14 22:10:46.510803 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.510667    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0138870-4210-48b7-a0f0-152a2d012133" containerName="maas-api"
Jul 14 22:10:46.510803 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.510736    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" containerName="istio-proxy"
Jul 14 22:10:46.510803 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.510743    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="02623337-b913-44aa-b0e5-5de046da973e" containerName="maas-api"
Jul 14 22:10:46.510803 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.510749    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0138870-4210-48b7-a0f0-152a2d012133" containerName="maas-api"
Jul 14 22:10:46.513340 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.513325    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.516353 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.516328    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-e8c0aa-openshift-default-dockercfg-967c7\""
Jul 14 22:10:46.525621 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.525600    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"]
Jul 14 22:10:46.562019 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.561990    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-workload-certs\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.562150 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.562061    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hh29\" (UniqueName: \"kubernetes.io/projected/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-kube-api-access-6hh29\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.562150 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.562094    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-workload-socket\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.562287 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.562172    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-token\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.562287 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.562204    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-envoy\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.562287 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.562230    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-podinfo\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.562287 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.562262    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-data\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.562420 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.562352    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-credential-socket\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.562420 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.562380    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istiod-ca-cert\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.663683 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.663652    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-credential-socket\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.663683 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.663684    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istiod-ca-cert\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.663906 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.663718    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-workload-certs\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.663906 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.663755    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hh29\" (UniqueName: \"kubernetes.io/projected/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-kube-api-access-6hh29\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.663906 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.663773    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-workload-socket\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.663906 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.663789    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-token\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.663906 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.663807    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-envoy\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.663906 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.663824    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-podinfo\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.663906 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.663896    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-data\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.664419 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.664391    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-credential-socket\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.664567 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.664452    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-workload-certs\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.664567 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.664470    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istiod-ca-cert\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.664567 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.664500    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-workload-socket\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.664691 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.664596    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-data\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.666321 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.666295    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-podinfo\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.666398 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.666302    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-envoy\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.673798 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.673768    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hh29\" (UniqueName: \"kubernetes.io/projected/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-kube-api-access-6hh29\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.673977 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.673959    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-token\") pod \"e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") " pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.824058 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.823983    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:46.956419 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.956393    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"]
Jul 14 22:10:46.958355 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:10:46.958326    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d84347_0b6f_4cfc_9a7a_64dda615ba2c.slice/crio-1d8dc3416a8b6f1d080f2064fa2b406ab6009590327b4d1404cf4a313c6399a8 WatchSource:0}: Error finding container 1d8dc3416a8b6f1d080f2064fa2b406ab6009590327b4d1404cf4a313c6399a8: Status 404 returned error can't find the container with id 1d8dc3416a8b6f1d080f2064fa2b406ab6009590327b4d1404cf4a313c6399a8
Jul 14 22:10:46.960723 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.960688    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:10:46.960802 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.960755    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:10:46.960802 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:46.960783    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:10:47.173559 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:47.173471    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn" event={"ID":"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c","Type":"ContainerStarted","Data":"58f0102a9031c0b1181495f7a05612cda6be955d169ba9aa938ce0ef39bbdb91"}
Jul 14 22:10:47.173559 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:47.173525    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn" event={"ID":"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c","Type":"ContainerStarted","Data":"1d8dc3416a8b6f1d080f2064fa2b406ab6009590327b4d1404cf4a313c6399a8"}
Jul 14 22:10:47.200059 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:47.200009    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn" podStartSLOduration=1.199992416 podStartE2EDuration="1.199992416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:10:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:10:47.198704201 +0000 UTC m=+1985.683796875" watchObservedRunningTime="2026-07-14 22:10:47.199992416 +0000 UTC m=+1985.685085144"
Jul 14 22:10:47.824651 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:47.824607    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:48.829682 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:48.829651    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:49.195395 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.195318    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:49.196245 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.196225    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:10:49.278486 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.278459    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"]
Jul 14 22:10:49.278986 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.278971    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ede74fef-9b7a-4944-9e7a-e1786a10f68c" containerName="istio-proxy"
Jul 14 22:10:49.281021 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.281006    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:10:49.283376 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.283355    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-e8c0aa-serving-cert\""
Jul 14 22:10:49.292920 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.292899    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"]
Jul 14 22:10:49.393053 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.393022    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-maas-api-tls\") pod \"maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm\" (UID: \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\") " pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:10:49.393245 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.393139    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6ndz\" (UniqueName: \"kubernetes.io/projected/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-kube-api-access-x6ndz\") pod \"maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm\" (UID: \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\") " pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:10:49.393332 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.393313    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm\" (UID: \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\") " pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:10:49.494257 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.494194    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm\" (UID: \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\") " pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:10:49.494257 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.494230    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-maas-api-tls\") pod \"maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm\" (UID: \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\") " pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:10:49.494433 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.494262    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6ndz\" (UniqueName: \"kubernetes.io/projected/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-kube-api-access-x6ndz\") pod \"maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm\" (UID: \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\") " pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:10:49.494433 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:10:49.494392    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-e8c0aa-serving-cert: secret "maas-api-e2e-shared-a-e8c0aa-serving-cert" not found
Jul 14 22:10:49.494521 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:10:49.494465    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-maas-api-tls podName:f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a nodeName:}" failed. No retries permitted until 2026-07-14 22:10:49.994443949 +0000 UTC m=+1988.479536596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-maas-api-tls") pod "maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm" (UID: "f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a") : secret "maas-api-e2e-shared-a-e8c0aa-serving-cert" not found
Jul 14 22:10:49.494790 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.494773    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm\" (UID: \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\") " pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:10:49.514139 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.514096    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6ndz\" (UniqueName: \"kubernetes.io/projected/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-kube-api-access-x6ndz\") pod \"maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm\" (UID: \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\") " pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:10:49.999583 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:49.999550    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-maas-api-tls\") pod \"maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm\" (UID: \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\") " pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:10:50.001824 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:50.001805    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-maas-api-tls\") pod \"maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm\" (UID: \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\") " pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:10:50.193315 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:50.193283    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:10:50.328148 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:50.328122    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"]
Jul 14 22:10:50.330352 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:10:50.330316    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf195b9b2_14a6_4a6c_af2d_a1d5bc938a1a.slice/crio-f67e5bc3bcf1fa1b5376ab1ed43e17d2eb960305c397bf21b96e5558647a302e WatchSource:0}: Error finding container f67e5bc3bcf1fa1b5376ab1ed43e17d2eb960305c397bf21b96e5558647a302e: Status 404 returned error can't find the container with id f67e5bc3bcf1fa1b5376ab1ed43e17d2eb960305c397bf21b96e5558647a302e
Jul 14 22:10:51.206887 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:51.206852    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm" event={"ID":"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a","Type":"ContainerStarted","Data":"2f0c4d7dfcf8926c7b8048c00b5fd3b73bc8fefb40b62082edf03960550def20"}
Jul 14 22:10:51.207497 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:51.206901    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm" event={"ID":"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a","Type":"ContainerStarted","Data":"f67e5bc3bcf1fa1b5376ab1ed43e17d2eb960305c397bf21b96e5558647a302e"}
Jul 14 22:10:51.207497 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:51.207054    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:10:51.226464 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:51.226415    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm" podStartSLOduration=1.8382414900000001 podStartE2EDuration="2.22640035s" totalImagesPullingTime="388.15886ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:10:51.225649265 +0000 UTC m=+1989.710741917" watchObservedRunningTime="2026-07-14 22:10:51.22640035 +0000 UTC m=+1989.711493002"
Jul 14 22:10:57.218008 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.217976    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:10:57.247735 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.247697    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"]
Jul 14 22:10:57.254636 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.254610    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:10:57.255805 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.255778    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"]
Jul 14 22:10:57.258941 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.258864    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-e98c02-serving-cert\""
Jul 14 22:10:57.374004 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.373967    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3c9b04a-acb1-4360-981f-04556a544bc9-maas-api-tls\") pod \"maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j\" (UID: \"b3c9b04a-acb1-4360-981f-04556a544bc9\") " pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:10:57.374199 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.374066    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44w5k\" (UniqueName: \"kubernetes.io/projected/b3c9b04a-acb1-4360-981f-04556a544bc9-kube-api-access-44w5k\") pod \"maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j\" (UID: \"b3c9b04a-acb1-4360-981f-04556a544bc9\") " pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:10:57.374199 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.374135    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3c9b04a-acb1-4360-981f-04556a544bc9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j\" (UID: \"b3c9b04a-acb1-4360-981f-04556a544bc9\") " pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:10:57.475227 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.475139    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44w5k\" (UniqueName: \"kubernetes.io/projected/b3c9b04a-acb1-4360-981f-04556a544bc9-kube-api-access-44w5k\") pod \"maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j\" (UID: \"b3c9b04a-acb1-4360-981f-04556a544bc9\") " pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:10:57.475227 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.475199    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3c9b04a-acb1-4360-981f-04556a544bc9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j\" (UID: \"b3c9b04a-acb1-4360-981f-04556a544bc9\") " pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:10:57.475436 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.475344    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3c9b04a-acb1-4360-981f-04556a544bc9-maas-api-tls\") pod \"maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j\" (UID: \"b3c9b04a-acb1-4360-981f-04556a544bc9\") " pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:10:57.475492 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:10:57.475475    2572 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-e98c02-serving-cert: secret "maas-api-e2e-shared-b-e98c02-serving-cert" not found
Jul 14 22:10:57.475563 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:10:57.475552    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c9b04a-acb1-4360-981f-04556a544bc9-maas-api-tls podName:b3c9b04a-acb1-4360-981f-04556a544bc9 nodeName:}" failed. No retries permitted until 2026-07-14 22:10:57.975529145 +0000 UTC m=+1996.460621778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b3c9b04a-acb1-4360-981f-04556a544bc9-maas-api-tls") pod "maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j" (UID: "b3c9b04a-acb1-4360-981f-04556a544bc9") : secret "maas-api-e2e-shared-b-e98c02-serving-cert" not found
Jul 14 22:10:57.475963 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.475946    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3c9b04a-acb1-4360-981f-04556a544bc9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j\" (UID: \"b3c9b04a-acb1-4360-981f-04556a544bc9\") " pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:10:57.484771 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.484745    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44w5k\" (UniqueName: \"kubernetes.io/projected/b3c9b04a-acb1-4360-981f-04556a544bc9-kube-api-access-44w5k\") pod \"maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j\" (UID: \"b3c9b04a-acb1-4360-981f-04556a544bc9\") " pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:10:57.980018 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.979988    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3c9b04a-acb1-4360-981f-04556a544bc9-maas-api-tls\") pod \"maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j\" (UID: \"b3c9b04a-acb1-4360-981f-04556a544bc9\") " pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:10:57.982347 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:57.982327    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3c9b04a-acb1-4360-981f-04556a544bc9-maas-api-tls\") pod \"maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j\" (UID: \"b3c9b04a-acb1-4360-981f-04556a544bc9\") " pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:10:58.167787 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:58.167747    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:10:58.354358 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:58.354332    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"]
Jul 14 22:10:58.356564 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:10:58.356539    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c9b04a_acb1_4360_981f_04556a544bc9.slice/crio-502d220ff51aa04474f7f8929b707c54d5a481c8c7e126eeb7100b2ccf2ec80f WatchSource:0}: Error finding container 502d220ff51aa04474f7f8929b707c54d5a481c8c7e126eeb7100b2ccf2ec80f: Status 404 returned error can't find the container with id 502d220ff51aa04474f7f8929b707c54d5a481c8c7e126eeb7100b2ccf2ec80f
Jul 14 22:10:59.267876 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:59.267836    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j" event={"ID":"b3c9b04a-acb1-4360-981f-04556a544bc9","Type":"ContainerStarted","Data":"be2fed3f1b6ac52ccef58ef9c240228b78fb08f17ac22ef6c79c33df23793c2a"}
Jul 14 22:10:59.268047 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:59.267919    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j" event={"ID":"b3c9b04a-acb1-4360-981f-04556a544bc9","Type":"ContainerStarted","Data":"502d220ff51aa04474f7f8929b707c54d5a481c8c7e126eeb7100b2ccf2ec80f"}
Jul 14 22:10:59.268047 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:59.267949    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:10:59.287305 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:10:59.287263    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j" podStartSLOduration=1.971186243 podStartE2EDuration="2.287249535s" totalImagesPullingTime="316.063292ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:10:59.285031477 +0000 UTC m=+1997.770124138" watchObservedRunningTime="2026-07-14 22:10:59.287249535 +0000 UTC m=+1997.772342179"
Jul 14 22:11:03.292194 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:03.292163    2572 generic.go:356] "Generic (PLEG): container finished" podID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerID="58f0102a9031c0b1181495f7a05612cda6be955d169ba9aa938ce0ef39bbdb91" exitCode=0
Jul 14 22:11:03.292631 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:03.292237    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn" event={"ID":"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c","Type":"ContainerDied","Data":"58f0102a9031c0b1181495f7a05612cda6be955d169ba9aa938ce0ef39bbdb91"}
Jul 14 22:11:03.292677 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:03.292655    2572 scope.go:117] "RemoveContainer" containerID="58f0102a9031c0b1181495f7a05612cda6be955d169ba9aa938ce0ef39bbdb91"
Jul 14 22:11:03.293661 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:03.293634    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:11:03.293731 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:03.293703    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:11:03.293775 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:03.293745    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 14 22:11:04.195943 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:04.195908    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:11:04.298769 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:04.298741    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn" event={"ID":"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c","Type":"ContainerStarted","Data":"d21b82b3c2eeeb2772716a3a1c4f97dd20266f42d17f4750925de9044d880529"}
Jul 14 22:11:04.825605 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:04.825570    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:11:04.825866 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:04.825648    2572 patch_prober.go:28] interesting pod/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 14 22:11:04.826019 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:04.825996    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn" podUID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 14 22:11:05.278790 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:05.278761    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:11:05.825535 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:05.825500    2572 patch_prober.go:28] interesting pod/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 14 22:11:05.826163 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:05.826127    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn" podUID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 14 22:11:06.824525 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:06.824488    2572 patch_prober.go:28] interesting pod/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 14 22:11:06.824857 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:06.824825    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn" podUID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 14 22:11:07.824749 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:07.824711    2572 patch_prober.go:28] interesting pod/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 14 22:11:07.825366 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:07.825333    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn" podUID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 14 22:11:08.824593 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:08.824553    2572 patch_prober.go:28] interesting pod/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 14 22:11:08.824902 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:08.824869    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn" podUID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 14 22:11:09.828476 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:09.828449    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:11:09.828855 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:09.828704    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:11:09.829277 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:11:09.829261    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:12:42.064168 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:12:42.064141    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 22:12:42.071286 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:12:42.071265    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 22:13:42.162188 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:13:42.162122    2572 scope.go:117] "RemoveContainer" containerID="e1b8f83e4e46d2bd4844bc72d4960beb25d598afa6d6ad1f1d7faf5e3538c92a"
Jul 14 22:16:55.333115 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:55.333014    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"]
Jul 14 22:16:55.335645 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:55.333307    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm" podUID="f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a" containerName="maas-api" containerID="cri-o://2f0c4d7dfcf8926c7b8048c00b5fd3b73bc8fefb40b62082edf03960550def20" gracePeriod=30
Jul 14 22:16:55.587715 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:55.587650    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:16:55.655972 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:55.655943    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-openshift-service-ca\") pod \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\" (UID: \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\") "
Jul 14 22:16:55.656180 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:55.656029    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-maas-api-tls\") pod \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\" (UID: \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\") "
Jul 14 22:16:55.656180 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:55.656158    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6ndz\" (UniqueName: \"kubernetes.io/projected/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-kube-api-access-x6ndz\") pod \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\" (UID: \"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a\") "
Jul 14 22:16:55.656356 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:55.656333    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a" (UID: "f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:16:55.656529 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:55.656503    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-openshift-service-ca\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:16:55.658158 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:55.658136    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a" (UID: "f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:16:55.658248 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:55.658159    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-kube-api-access-x6ndz" (OuterVolumeSpecName: "kube-api-access-x6ndz") pod "f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a" (UID: "f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a"). InnerVolumeSpecName "kube-api-access-x6ndz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:16:55.756922 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:55.756897    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-maas-api-tls\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:16:55.756922 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:55.756920    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6ndz\" (UniqueName: \"kubernetes.io/projected/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a-kube-api-access-x6ndz\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:16:56.154596 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:56.154564    2572 generic.go:356] "Generic (PLEG): container finished" podID="f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a" containerID="2f0c4d7dfcf8926c7b8048c00b5fd3b73bc8fefb40b62082edf03960550def20" exitCode=0
Jul 14 22:16:56.154596 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:56.154599    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm" event={"ID":"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a","Type":"ContainerDied","Data":"2f0c4d7dfcf8926c7b8048c00b5fd3b73bc8fefb40b62082edf03960550def20"}
Jul 14 22:16:56.154787 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:56.154615    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"
Jul 14 22:16:56.154787 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:56.154632    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm" event={"ID":"f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a","Type":"ContainerDied","Data":"f67e5bc3bcf1fa1b5376ab1ed43e17d2eb960305c397bf21b96e5558647a302e"}
Jul 14 22:16:56.154787 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:56.154653    2572 scope.go:117] "RemoveContainer" containerID="2f0c4d7dfcf8926c7b8048c00b5fd3b73bc8fefb40b62082edf03960550def20"
Jul 14 22:16:56.163559 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:56.163541    2572 scope.go:117] "RemoveContainer" containerID="2f0c4d7dfcf8926c7b8048c00b5fd3b73bc8fefb40b62082edf03960550def20"
Jul 14 22:16:56.163801 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:16:56.163783    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f0c4d7dfcf8926c7b8048c00b5fd3b73bc8fefb40b62082edf03960550def20\": container with ID starting with 2f0c4d7dfcf8926c7b8048c00b5fd3b73bc8fefb40b62082edf03960550def20 not found: ID does not exist" containerID="2f0c4d7dfcf8926c7b8048c00b5fd3b73bc8fefb40b62082edf03960550def20"
Jul 14 22:16:56.163865 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:56.163807    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f0c4d7dfcf8926c7b8048c00b5fd3b73bc8fefb40b62082edf03960550def20"} err="failed to get container status \"2f0c4d7dfcf8926c7b8048c00b5fd3b73bc8fefb40b62082edf03960550def20\": rpc error: code = NotFound desc = could not find container \"2f0c4d7dfcf8926c7b8048c00b5fd3b73bc8fefb40b62082edf03960550def20\": container with ID starting with 2f0c4d7dfcf8926c7b8048c00b5fd3b73bc8fefb40b62082edf03960550def20 not found: ID does not exist"
Jul 14 22:16:56.174858 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:56.174829    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"]
Jul 14 22:16:56.180608 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:56.180591    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-e8c0aa-98cf7b4d6-vzwtm"]
Jul 14 22:16:57.986781 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:16:57.986743    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a" path="/var/lib/kubelet/pods/f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a/volumes"
Jul 14 22:17:38.096209 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:38.096174    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"]
Jul 14 22:17:38.096752 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:38.096359    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn" podUID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerName="istio-proxy" containerID="cri-o://d21b82b3c2eeeb2772716a3a1c4f97dd20266f42d17f4750925de9044d880529" gracePeriod=30
Jul 14 22:17:39.244082 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:39.244051    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"]
Jul 14 22:17:39.244572 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:39.244282    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j" podUID="b3c9b04a-acb1-4360-981f-04556a544bc9" containerName="maas-api" containerID="cri-o://be2fed3f1b6ac52ccef58ef9c240228b78fb08f17ac22ef6c79c33df23793c2a" gracePeriod=30
Jul 14 22:17:39.696738 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:39.696718    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:17:39.738079 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:39.738056    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3c9b04a-acb1-4360-981f-04556a544bc9-maas-api-tls\") pod \"b3c9b04a-acb1-4360-981f-04556a544bc9\" (UID: \"b3c9b04a-acb1-4360-981f-04556a544bc9\") "
Jul 14 22:17:39.738232 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:39.738215    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44w5k\" (UniqueName: \"kubernetes.io/projected/b3c9b04a-acb1-4360-981f-04556a544bc9-kube-api-access-44w5k\") pod \"b3c9b04a-acb1-4360-981f-04556a544bc9\" (UID: \"b3c9b04a-acb1-4360-981f-04556a544bc9\") "
Jul 14 22:17:39.738309 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:39.738293    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3c9b04a-acb1-4360-981f-04556a544bc9-openshift-service-ca\") pod \"b3c9b04a-acb1-4360-981f-04556a544bc9\" (UID: \"b3c9b04a-acb1-4360-981f-04556a544bc9\") "
Jul 14 22:17:39.738701 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:39.738672    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3c9b04a-acb1-4360-981f-04556a544bc9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b3c9b04a-acb1-4360-981f-04556a544bc9" (UID: "b3c9b04a-acb1-4360-981f-04556a544bc9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:17:39.740120 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:39.740082    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3c9b04a-acb1-4360-981f-04556a544bc9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b3c9b04a-acb1-4360-981f-04556a544bc9" (UID: "b3c9b04a-acb1-4360-981f-04556a544bc9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:17:39.740254 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:39.740145    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3c9b04a-acb1-4360-981f-04556a544bc9-kube-api-access-44w5k" (OuterVolumeSpecName: "kube-api-access-44w5k") pod "b3c9b04a-acb1-4360-981f-04556a544bc9" (UID: "b3c9b04a-acb1-4360-981f-04556a544bc9"). InnerVolumeSpecName "kube-api-access-44w5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:17:39.831019 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:39.830961    2572 patch_prober.go:28] interesting pod/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 22:17:39.831019 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:39.831008    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn" podUID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 22:17:39.839855 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:39.839834    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44w5k\" (UniqueName: \"kubernetes.io/projected/b3c9b04a-acb1-4360-981f-04556a544bc9-kube-api-access-44w5k\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:17:39.839855 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:39.839855    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3c9b04a-acb1-4360-981f-04556a544bc9-openshift-service-ca\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:17:39.839993 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:39.839864    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3c9b04a-acb1-4360-981f-04556a544bc9-maas-api-tls\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:17:40.391411 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:40.391378    2572 generic.go:356] "Generic (PLEG): container finished" podID="b3c9b04a-acb1-4360-981f-04556a544bc9" containerID="be2fed3f1b6ac52ccef58ef9c240228b78fb08f17ac22ef6c79c33df23793c2a" exitCode=0
Jul 14 22:17:40.391832 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:40.391415    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j" event={"ID":"b3c9b04a-acb1-4360-981f-04556a544bc9","Type":"ContainerDied","Data":"be2fed3f1b6ac52ccef58ef9c240228b78fb08f17ac22ef6c79c33df23793c2a"}
Jul 14 22:17:40.391832 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:40.391423    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"
Jul 14 22:17:40.391832 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:40.391469    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j" event={"ID":"b3c9b04a-acb1-4360-981f-04556a544bc9","Type":"ContainerDied","Data":"502d220ff51aa04474f7f8929b707c54d5a481c8c7e126eeb7100b2ccf2ec80f"}
Jul 14 22:17:40.391832 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:40.391501    2572 scope.go:117] "RemoveContainer" containerID="be2fed3f1b6ac52ccef58ef9c240228b78fb08f17ac22ef6c79c33df23793c2a"
Jul 14 22:17:40.402087 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:40.402064    2572 scope.go:117] "RemoveContainer" containerID="be2fed3f1b6ac52ccef58ef9c240228b78fb08f17ac22ef6c79c33df23793c2a"
Jul 14 22:17:40.402478 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:17:40.402459    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be2fed3f1b6ac52ccef58ef9c240228b78fb08f17ac22ef6c79c33df23793c2a\": container with ID starting with be2fed3f1b6ac52ccef58ef9c240228b78fb08f17ac22ef6c79c33df23793c2a not found: ID does not exist" containerID="be2fed3f1b6ac52ccef58ef9c240228b78fb08f17ac22ef6c79c33df23793c2a"
Jul 14 22:17:40.402559 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:40.402490    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be2fed3f1b6ac52ccef58ef9c240228b78fb08f17ac22ef6c79c33df23793c2a"} err="failed to get container status \"be2fed3f1b6ac52ccef58ef9c240228b78fb08f17ac22ef6c79c33df23793c2a\": rpc error: code = NotFound desc = could not find container \"be2fed3f1b6ac52ccef58ef9c240228b78fb08f17ac22ef6c79c33df23793c2a\": container with ID starting with be2fed3f1b6ac52ccef58ef9c240228b78fb08f17ac22ef6c79c33df23793c2a not found: ID does not exist"
Jul 14 22:17:40.414368 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:40.414347    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"]
Jul 14 22:17:40.418973 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:40.418951    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-e98c02-5d66b9b648-95z9j"]
Jul 14 22:17:41.979848 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:41.979820    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3c9b04a-acb1-4360-981f-04556a544bc9" path="/var/lib/kubelet/pods/b3c9b04a-acb1-4360-981f-04556a544bc9/volumes"
Jul 14 22:17:42.096895 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:42.096870    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 22:17:42.105813 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:42.105794    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wfbd8_a732f775-e8f5-449a-bbc9-3444417b18a3/ovn-acl-logging/0.log"
Jul 14 22:17:43.354688 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.354664    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:17:43.412637 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.412574    2572 generic.go:356] "Generic (PLEG): container finished" podID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerID="d21b82b3c2eeeb2772716a3a1c4f97dd20266f42d17f4750925de9044d880529" exitCode=0
Jul 14 22:17:43.412637 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.412617    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"
Jul 14 22:17:43.412781 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.412651    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn" event={"ID":"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c","Type":"ContainerDied","Data":"d21b82b3c2eeeb2772716a3a1c4f97dd20266f42d17f4750925de9044d880529"}
Jul 14 22:17:43.412781 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.412726    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn" event={"ID":"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c","Type":"ContainerDied","Data":"1d8dc3416a8b6f1d080f2064fa2b406ab6009590327b4d1404cf4a313c6399a8"}
Jul 14 22:17:43.412781 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.412750    2572 scope.go:117] "RemoveContainer" containerID="d21b82b3c2eeeb2772716a3a1c4f97dd20266f42d17f4750925de9044d880529"
Jul 14 22:17:43.421202 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.421143    2572 scope.go:117] "RemoveContainer" containerID="58f0102a9031c0b1181495f7a05612cda6be955d169ba9aa938ce0ef39bbdb91"
Jul 14 22:17:43.429136 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.429098    2572 scope.go:117] "RemoveContainer" containerID="d21b82b3c2eeeb2772716a3a1c4f97dd20266f42d17f4750925de9044d880529"
Jul 14 22:17:43.429372 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:17:43.429356    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d21b82b3c2eeeb2772716a3a1c4f97dd20266f42d17f4750925de9044d880529\": container with ID starting with d21b82b3c2eeeb2772716a3a1c4f97dd20266f42d17f4750925de9044d880529 not found: ID does not exist" containerID="d21b82b3c2eeeb2772716a3a1c4f97dd20266f42d17f4750925de9044d880529"
Jul 14 22:17:43.429421 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.429381    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d21b82b3c2eeeb2772716a3a1c4f97dd20266f42d17f4750925de9044d880529"} err="failed to get container status \"d21b82b3c2eeeb2772716a3a1c4f97dd20266f42d17f4750925de9044d880529\": rpc error: code = NotFound desc = could not find container \"d21b82b3c2eeeb2772716a3a1c4f97dd20266f42d17f4750925de9044d880529\": container with ID starting with d21b82b3c2eeeb2772716a3a1c4f97dd20266f42d17f4750925de9044d880529 not found: ID does not exist"
Jul 14 22:17:43.429421 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.429396    2572 scope.go:117] "RemoveContainer" containerID="58f0102a9031c0b1181495f7a05612cda6be955d169ba9aa938ce0ef39bbdb91"
Jul 14 22:17:43.429618 ip-10-0-128-31 kubenswrapper[2572]: E0714 22:17:43.429601    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58f0102a9031c0b1181495f7a05612cda6be955d169ba9aa938ce0ef39bbdb91\": container with ID starting with 58f0102a9031c0b1181495f7a05612cda6be955d169ba9aa938ce0ef39bbdb91 not found: ID does not exist" containerID="58f0102a9031c0b1181495f7a05612cda6be955d169ba9aa938ce0ef39bbdb91"
Jul 14 22:17:43.429676 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.429628    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58f0102a9031c0b1181495f7a05612cda6be955d169ba9aa938ce0ef39bbdb91"} err="failed to get container status \"58f0102a9031c0b1181495f7a05612cda6be955d169ba9aa938ce0ef39bbdb91\": rpc error: code = NotFound desc = could not find container \"58f0102a9031c0b1181495f7a05612cda6be955d169ba9aa938ce0ef39bbdb91\": container with ID starting with 58f0102a9031c0b1181495f7a05612cda6be955d169ba9aa938ce0ef39bbdb91 not found: ID does not exist"
Jul 14 22:17:43.471529 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.471507    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-workload-certs\") pod \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") "
Jul 14 22:17:43.471613 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.471539    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-data\") pod \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") "
Jul 14 22:17:43.471613 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.471605    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hh29\" (UniqueName: \"kubernetes.io/projected/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-kube-api-access-6hh29\") pod \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") "
Jul 14 22:17:43.471704 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.471627    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istiod-ca-cert\") pod \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") "
Jul 14 22:17:43.471704 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.471655    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-workload-socket\") pod \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") "
Jul 14 22:17:43.471704 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.471681    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-token\") pod \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") "
Jul 14 22:17:43.471858 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.471712    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-credential-socket\") pod \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") "
Jul 14 22:17:43.471858 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.471738    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-envoy\") pod \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") "
Jul 14 22:17:43.471858 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.471759    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" (UID: "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:17:43.471858 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.471811    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-podinfo\") pod \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\" (UID: \"d8d84347-0b6f-4cfc-9a7a-64dda615ba2c\") "
Jul 14 22:17:43.472072 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.471992    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" (UID: "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:17:43.472072 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.472034    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" (UID: "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:17:43.472072 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.472056    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" (UID: "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 22:17:43.472274 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.472196    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-workload-certs\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:17:43.472274 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.472223    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istiod-ca-cert\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:17:43.472274 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.472240    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-workload-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:17:43.472274 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.472252    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-credential-socket\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:17:43.472645 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.472622    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-data" (OuterVolumeSpecName: "istio-data") pod "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" (UID: "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:17:43.473845 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.473811    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" (UID: "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:17:43.473973 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.473953    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-kube-api-access-6hh29" (OuterVolumeSpecName: "kube-api-access-6hh29") pod "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" (UID: "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c"). InnerVolumeSpecName "kube-api-access-6hh29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:17:43.474187 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.474165    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-token" (OuterVolumeSpecName: "istio-token") pod "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" (UID: "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:17:43.474246 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.474200    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" (UID: "d8d84347-0b6f-4cfc-9a7a-64dda615ba2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 22:17:43.573427 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.573396    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-data\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:17:43.573427 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.573426    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hh29\" (UniqueName: \"kubernetes.io/projected/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-kube-api-access-6hh29\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:17:43.573559 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.573438    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-token\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:17:43.573559 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.573446    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-envoy\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:17:43.573559 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.573454    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c-istio-podinfo\") on node \"ip-10-0-128-31.ec2.internal\" DevicePath \"\""
Jul 14 22:17:43.736331 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.736308    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"]
Jul 14 22:17:43.743886 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.743866    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-e8c0aa-openshift-default-5cb9645fc9-qdbnn"]
Jul 14 22:17:43.980978 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:43.980921    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" path="/var/lib/kubelet/pods/d8d84347-0b6f-4cfc-9a7a-64dda615ba2c/volumes"
Jul 14 22:17:51.765741 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:51.765714    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tt2wj_a4a21f3c-0409-4544-b9a4-2417a5f45581/manager/0.log"
Jul 14 22:17:51.892028 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:51.891983    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vzsdk_aa86720d-448c-4782-8625-e81428fa69bd/manager/0.log"
Jul 14 22:17:52.017535 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:52.017471    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-64ddf4d64b-xmzrx_738bc2f4-8810-4172-9281-2627a8738d24/maas-api/0.log"
Jul 14 22:17:52.406578 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:52.406494    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7469c76db5-65kcr_6d23bb74-b975-4669-8ce2-f83a79a66622/manager/0.log"
Jul 14 22:17:52.783659 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:52.783635    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c55cf7c4c-6hqcf_378365a2-113e-4918-9899-4320e423c6ce/copy-manifests/0.log"
Jul 14 22:17:52.790648 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:52.790628    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c55cf7c4c-6hqcf_378365a2-113e-4918-9899-4320e423c6ce/manager/0.log"
Jul 14 22:17:53.185203 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:53.185137    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-95pfb_18af709a-7505-4845-a38d-c796a2d9c485/postgres/0.log"
Jul 14 22:17:54.751398 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:54.751370    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-n8npt_257376ae-58e6-4a2e-9c67-58ec2db47968/manager/0.log"
Jul 14 22:17:55.132010 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:55.131928    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jjwrg_5f0db111-0cc0-4a6e-9947-8f227addfa0a/registry-server/0.log"
Jul 14 22:17:55.906417 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:55.906386    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf478mvb_77b8c1e6-0ede-4d79-9039-1b79b92a8719/istio-proxy/0.log"
Jul 14 22:17:56.404021 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:56.403966    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-h7lss_4fd51fe4-61c0-418c-bd03-0889b3ae7c71/istio-proxy/1.log"
Jul 14 22:17:56.526223 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:56.526200    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z7vtb_dbab53ae-c2e1-483d-9b76-4b0232031f77/payload-pre-processing/0.log"
Jul 14 22:17:57.164028 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:57.163999    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-cn9wr_b0593c40-e055-424a-ab8e-ab79ecf87784/main/0.log"
Jul 14 22:17:57.531360 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:17:57.531336    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbzwgmd_f974b4d2-14ae-4b32-88f5-2cc5a40213ea/main/0.log"
Jul 14 22:18:05.298892 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:05.298810    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tmv56_7dddc3f3-4833-4d05-8db0-86e663dde23c/global-pull-secret-syncer/0.log"
Jul 14 22:18:05.407238 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:05.407214    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hxqwh_18a6bb3a-2e83-4b23-9129-6612da3726f5/konnectivity-agent/0.log"
Jul 14 22:18:05.466140 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:05.466119    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-31.ec2.internal_3f71cbe28c74af33d6d21b6fef376a32/haproxy/0.log"
Jul 14 22:18:10.806195 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:10.806167    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-n8npt_257376ae-58e6-4a2e-9c67-58ec2db47968/manager/0.log"
Jul 14 22:18:10.923755 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:10.923690    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jjwrg_5f0db111-0cc0-4a6e-9947-8f227addfa0a/registry-server/0.log"
Jul 14 22:18:12.995793 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:12.995765    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65077af2-1e75-4cef-bd80-c52026caa31e/alertmanager/0.log"
Jul 14 22:18:13.022508 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.022486    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65077af2-1e75-4cef-bd80-c52026caa31e/config-reloader/0.log"
Jul 14 22:18:13.052655 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.052636    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65077af2-1e75-4cef-bd80-c52026caa31e/kube-rbac-proxy-web/0.log"
Jul 14 22:18:13.078230 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.078209    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65077af2-1e75-4cef-bd80-c52026caa31e/kube-rbac-proxy/0.log"
Jul 14 22:18:13.104254 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.104233    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65077af2-1e75-4cef-bd80-c52026caa31e/kube-rbac-proxy-metric/0.log"
Jul 14 22:18:13.131323 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.131273    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65077af2-1e75-4cef-bd80-c52026caa31e/prom-label-proxy/0.log"
Jul 14 22:18:13.161223 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.161204    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65077af2-1e75-4cef-bd80-c52026caa31e/init-config-reloader/0.log"
Jul 14 22:18:13.237187 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.237171    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-g684d_6ec894e0-b385-4e8b-98fc-fdff455b2d71/kube-state-metrics/0.log"
Jul 14 22:18:13.261997 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.261964    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-g684d_6ec894e0-b385-4e8b-98fc-fdff455b2d71/kube-rbac-proxy-main/0.log"
Jul 14 22:18:13.288776 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.288757    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-g684d_6ec894e0-b385-4e8b-98fc-fdff455b2d71/kube-rbac-proxy-self/0.log"
Jul 14 22:18:13.319339 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.319324    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-75c6f76555-wskwv_eb9cd0cf-6a37-4dcf-9ea1-7d4c04c59356/metrics-server/0.log"
Jul 14 22:18:13.349016 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.348996    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-6nbnh_07a31d45-196d-4795-a941-4b2529e2981b/monitoring-plugin/0.log"
Jul 14 22:18:13.381705 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.381655    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4rl7_c2a00549-6a72-4a01-b936-5f1ea204a44b/node-exporter/0.log"
Jul 14 22:18:13.408285 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.408267    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4rl7_c2a00549-6a72-4a01-b936-5f1ea204a44b/kube-rbac-proxy/0.log"
Jul 14 22:18:13.432893 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.432877    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4rl7_c2a00549-6a72-4a01-b936-5f1ea204a44b/init-textfile/0.log"
Jul 14 22:18:13.637568 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.637515    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-skkqq_33b82833-1e09-4f39-80b7-eaf479c2e7ba/kube-rbac-proxy-main/0.log"
Jul 14 22:18:13.665471 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.665452    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-skkqq_33b82833-1e09-4f39-80b7-eaf479c2e7ba/kube-rbac-proxy-self/0.log"
Jul 14 22:18:13.691622 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.691602    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-skkqq_33b82833-1e09-4f39-80b7-eaf479c2e7ba/openshift-state-metrics/0.log"
Jul 14 22:18:13.734581 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.734563    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a3be219-67cf-4b05-ac82-ad05f9d71b66/prometheus/0.log"
Jul 14 22:18:13.762909 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.762890    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a3be219-67cf-4b05-ac82-ad05f9d71b66/config-reloader/0.log"
Jul 14 22:18:13.789889 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.789872    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a3be219-67cf-4b05-ac82-ad05f9d71b66/thanos-sidecar/0.log"
Jul 14 22:18:13.816787 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.816743    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a3be219-67cf-4b05-ac82-ad05f9d71b66/kube-rbac-proxy-web/0.log"
Jul 14 22:18:13.848980 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.848964    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a3be219-67cf-4b05-ac82-ad05f9d71b66/kube-rbac-proxy/0.log"
Jul 14 22:18:13.875359 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.875339    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a3be219-67cf-4b05-ac82-ad05f9d71b66/kube-rbac-proxy-thanos/0.log"
Jul 14 22:18:13.912340 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.912285    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6a3be219-67cf-4b05-ac82-ad05f9d71b66/init-config-reloader/0.log"
Jul 14 22:18:13.962635 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.962616    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-8znpd_aa0024ef-3ab2-462f-8281-5cc4d1daf7c2/prometheus-operator/0.log"
Jul 14 22:18:13.998550 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:13.998501    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-8znpd_aa0024ef-3ab2-462f-8281-5cc4d1daf7c2/kube-rbac-proxy/0.log"
Jul 14 22:18:14.032814 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:14.032797    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-nks8c_f8462872-6171-43c1-8f49-78e4d4b14fe3/prometheus-operator-admission-webhook/0.log"
Jul 14 22:18:14.067189 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:14.067169    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-564f89c8b4-pf84v_92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9/telemeter-client/0.log"
Jul 14 22:18:14.096049 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:14.096012    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-564f89c8b4-pf84v_92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9/reload/0.log"
Jul 14 22:18:14.133465 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:14.133446    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-564f89c8b4-pf84v_92cb4e6e-5a0a-4c9e-8572-4d7b26083ae9/kube-rbac-proxy/0.log"
Jul 14 22:18:14.166406 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:14.166356    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f75556856-v6lgv_265a7a1d-0f5d-499f-ab05-197e0e1b6929/thanos-query/0.log"
Jul 14 22:18:14.189472 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:14.189431    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f75556856-v6lgv_265a7a1d-0f5d-499f-ab05-197e0e1b6929/kube-rbac-proxy-web/0.log"
Jul 14 22:18:14.213757 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:14.213739    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f75556856-v6lgv_265a7a1d-0f5d-499f-ab05-197e0e1b6929/kube-rbac-proxy/0.log"
Jul 14 22:18:14.237265 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:14.237249    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f75556856-v6lgv_265a7a1d-0f5d-499f-ab05-197e0e1b6929/prom-label-proxy/0.log"
Jul 14 22:18:14.267925 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:14.267908    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f75556856-v6lgv_265a7a1d-0f5d-499f-ab05-197e0e1b6929/kube-rbac-proxy-rules/0.log"
Jul 14 22:18:14.291212 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:14.291191    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f75556856-v6lgv_265a7a1d-0f5d-499f-ab05-197e0e1b6929/kube-rbac-proxy-metrics/0.log"
Jul 14 22:18:15.447119 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.447079    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"]
Jul 14 22:18:15.447544 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.447527    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerName="istio-proxy"
Jul 14 22:18:15.447544 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.447544    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerName="istio-proxy"
Jul 14 22:18:15.447666 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.447554    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c9b04a-acb1-4360-981f-04556a544bc9" containerName="maas-api"
Jul 14 22:18:15.447666 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.447561    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c9b04a-acb1-4360-981f-04556a544bc9" containerName="maas-api"
Jul 14 22:18:15.447666 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.447577    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerName="istio-proxy"
Jul 14 22:18:15.447666 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.447583    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerName="istio-proxy"
Jul 14 22:18:15.447666 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.447591    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a" containerName="maas-api"
Jul 14 22:18:15.447666 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.447597    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a" containerName="maas-api"
Jul 14 22:18:15.447666 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.447660    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerName="istio-proxy"
Jul 14 22:18:15.447666 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.447670    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8d84347-0b6f-4cfc-9a7a-64dda615ba2c" containerName="istio-proxy"
Jul 14 22:18:15.447972 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.447676    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3c9b04a-acb1-4360-981f-04556a544bc9" containerName="maas-api"
Jul 14 22:18:15.447972 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.447682    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f195b9b2-14a6-4a6c-af2d-a1d5bc938a1a" containerName="maas-api"
Jul 14 22:18:15.451261 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.451243    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.453991 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.453973    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7zq7r\"/\"openshift-service-ca.crt\""
Jul 14 22:18:15.455050 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.455030    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7zq7r\"/\"default-dockercfg-t7ph4\""
Jul 14 22:18:15.455148 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.455048    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7zq7r\"/\"kube-root-ca.crt\""
Jul 14 22:18:15.460370 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.460350    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"]
Jul 14 22:18:15.545414 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.545389    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-lib-modules\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.545532 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.545425    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-podres\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.545532 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.545446    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-sys\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.545532 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.545463    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntwts\" (UniqueName: \"kubernetes.io/projected/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-kube-api-access-ntwts\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.545646 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.545541    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-proc\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.646525 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.646505    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-lib-modules\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.646627 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.646542    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-podres\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.646627 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.646563    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-sys\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.646627 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.646588    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntwts\" (UniqueName: \"kubernetes.io/projected/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-kube-api-access-ntwts\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.646755 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.646635    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-sys\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.646755 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.646647    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-proc\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.646755 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.646665    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-lib-modules\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.646755 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.646674    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-podres\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.646755 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.646686    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-proc\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.655887 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.655867    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntwts\" (UniqueName: \"kubernetes.io/projected/6f9bd58d-f85f-4916-b50a-169e16eb1fd5-kube-api-access-ntwts\") pod \"perf-node-gather-daemonset-j6mvw\" (UID: \"6f9bd58d-f85f-4916-b50a-169e16eb1fd5\") " pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.762237 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.762216    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:15.896182 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:15.896159    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"]
Jul 14 22:18:15.898165 ip-10-0-128-31 kubenswrapper[2572]: W0714 22:18:15.898140    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6f9bd58d_f85f_4916_b50a_169e16eb1fd5.slice/crio-402c1f3360bf7fe3d72a3466a221897508668785be2ece1a110f0dfbe0ff69fb WatchSource:0}: Error finding container 402c1f3360bf7fe3d72a3466a221897508668785be2ece1a110f0dfbe0ff69fb: Status 404 returned error can't find the container with id 402c1f3360bf7fe3d72a3466a221897508668785be2ece1a110f0dfbe0ff69fb
Jul 14 22:18:16.586889 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:16.586856    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw" event={"ID":"6f9bd58d-f85f-4916-b50a-169e16eb1fd5","Type":"ContainerStarted","Data":"594dfb0a16922601ffdbf45b25211853a5f43089551555cb90e4a43efe111b81"}
Jul 14 22:18:16.587272 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:16.586910    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw" event={"ID":"6f9bd58d-f85f-4916-b50a-169e16eb1fd5","Type":"ContainerStarted","Data":"402c1f3360bf7fe3d72a3466a221897508668785be2ece1a110f0dfbe0ff69fb"}
Jul 14 22:18:16.587272 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:16.586944    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:16.605695 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:16.605647    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw" podStartSLOduration=1.605631275 podStartE2EDuration="1.605631275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:18:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:18:16.604122055 +0000 UTC m=+2435.089214704" watchObservedRunningTime="2026-07-14 22:18:16.605631275 +0000 UTC m=+2435.090723926"
Jul 14 22:18:16.655581 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:16.655561    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d7cd67df7-tg59k_1195769f-a892-4f15-9246-9f8774aa0b47/console/0.log"
Jul 14 22:18:18.513376 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:18.513350    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gsvz7_33b4819a-7965-45b2-9a63-855c9e7f009d/dns/0.log"
Jul 14 22:18:18.539704 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:18.539680    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gsvz7_33b4819a-7965-45b2-9a63-855c9e7f009d/kube-rbac-proxy/0.log"
Jul 14 22:18:18.621814 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:18.621788    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4l5xq_9b299cfd-4132-4261-a395-5426f00c0416/dns-node-resolver/0.log"
Jul 14 22:18:19.327588 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:19.327555    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7zd76_c0b91eda-ff5f-4e5d-bdb8-a4ac41c3dd77/node-ca/0.log"
Jul 14 22:18:20.391476 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:20.391442    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf478mvb_77b8c1e6-0ede-4d79-9039-1b79b92a8719/istio-proxy/0.log"
Jul 14 22:18:20.577314 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:20.577285    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-h7lss_4fd51fe4-61c0-418c-bd03-0889b3ae7c71/istio-proxy/0.log"
Jul 14 22:18:20.606786 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:20.606764    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-h7lss_4fd51fe4-61c0-418c-bd03-0889b3ae7c71/istio-proxy/1.log"
Jul 14 22:18:20.637993 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:20.637961    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z7vtb_dbab53ae-c2e1-483d-9b76-4b0232031f77/payload-pre-processing/0.log"
Jul 14 22:18:21.512946 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:21.512915    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vht6t_8fe050af-65e6-45ce-8fa0-0e925501070e/serve-healthcheck-canary/0.log"
Jul 14 22:18:22.106349 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:22.106313    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2pw2n_ff78d138-ff4f-47bd-9e8c-29b4cc13390b/kube-rbac-proxy/0.log"
Jul 14 22:18:22.129670 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:22.129649    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2pw2n_ff78d138-ff4f-47bd-9e8c-29b4cc13390b/exporter/0.log"
Jul 14 22:18:22.153996 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:22.153980    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2pw2n_ff78d138-ff4f-47bd-9e8c-29b4cc13390b/extractor/0.log"
Jul 14 22:18:22.601276 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:22.601245    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7zq7r/perf-node-gather-daemonset-j6mvw"
Jul 14 22:18:24.944916 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:24.944872    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tt2wj_a4a21f3c-0409-4544-b9a4-2417a5f45581/manager/0.log"
Jul 14 22:18:25.076687 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:25.076661    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vzsdk_aa86720d-448c-4782-8625-e81428fa69bd/manager/0.log"
Jul 14 22:18:25.113110 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:25.113089    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-64ddf4d64b-xmzrx_738bc2f4-8810-4172-9281-2627a8738d24/maas-api/0.log"
Jul 14 22:18:25.278626 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:25.278571    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7469c76db5-65kcr_6d23bb74-b975-4669-8ce2-f83a79a66622/manager/0.log"
Jul 14 22:18:25.458014 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:25.457954    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c55cf7c4c-6hqcf_378365a2-113e-4918-9899-4320e423c6ce/manager/0.log"
Jul 14 22:18:25.483557 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:25.483540    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c55cf7c4c-6hqcf_378365a2-113e-4918-9899-4320e423c6ce/copy-manifests/0.log"
Jul 14 22:18:25.672385 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:25.672366    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-95pfb_18af709a-7505-4845-a38d-c796a2d9c485/postgres/0.log"
Jul 14 22:18:26.223565 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:26.223538    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf478mvb_77b8c1e6-0ede-4d79-9039-1b79b92a8719/istio-proxy/0.log"
Jul 14 22:18:26.392317 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:26.392293    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-h7lss_4fd51fe4-61c0-418c-bd03-0889b3ae7c71/istio-proxy/0.log"
Jul 14 22:18:26.418209 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:26.418182    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-h7lss_4fd51fe4-61c0-418c-bd03-0889b3ae7c71/istio-proxy/1.log"
Jul 14 22:18:26.437041 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:26.437016    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z7vtb_dbab53ae-c2e1-483d-9b76-4b0232031f77/payload-pre-processing/0.log"
Jul 14 22:18:27.161620 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:27.161594    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65d6b5d88-zqwms_073abdaf-3293-41cc-9b7c-8e10e9ba49e2/manager/0.log"
Jul 14 22:18:27.741987 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:27.741957    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf478mvb_77b8c1e6-0ede-4d79-9039-1b79b92a8719/istio-proxy/0.log"
Jul 14 22:18:27.895906 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:27.895883    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-h7lss_4fd51fe4-61c0-418c-bd03-0889b3ae7c71/istio-proxy/0.log"
Jul 14 22:18:27.921180 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:27.921148    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-h7lss_4fd51fe4-61c0-418c-bd03-0889b3ae7c71/istio-proxy/1.log"
Jul 14 22:18:27.943646 ip-10-0-128-31 kubenswrapper[2572]: I0714 22:18:27.943626    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z7vtb_dbab53ae-c2e1-483d-9b76-4b0232031f77/payload-pre-processing/0.log"